Aws Data Engineer Lead (gdc)

Year    Bengaluru, Karnataka, India

Job Description


Meet our Team

We represent Hitachi Vantara to enterprise clients across industries, establishing business relationships to understand customer challenges so that we can deliver profitable business for Hitachi products, services and solutions. We collaborate as a team and cross-functionally to ensure the success of our customers; success that is celebrated and shared. Our solutions bring value to every line of business and we need people like you to build those deep relationships and to passionately articulate our value proposition.

What you'll be doing

  • Responsible for project prioritization, resource allocation and on time delivery of solutions
  • Require interaction with onshore/offshore counterparts to communicate business requirements in a technical design document
  • Lead and foster data engineers in their careers to produce higher quality solutions at a faster velocity through optimization training and code review
  • Multi-task across several ongoing projects and daily duties of varying priorities as required
  • Partner with business stakeholders to gather requirements and translate them into technical specifications and process documentation for IT counterparts (on-prem and offshore)
  • Support continuous improvement by investigating and presenting alternatives to processes and technologies to an architectural review board
  • Develop and ensure adherence to published system architectural decisions and development standards

What you bring to the team
  • Highly proficient in the architecture and development of an event driven data warehouse; streaming, batch, data modeling, and storage
  • Advanced database knowledge; creating/optimizing SQL queries, stored procedures, functions, partitioning data, indexing, and reading execution plans
  • Skilled experience in writing and troubleshooting Python/PySpark scripts to generate extracts, cleanse, conform and deliver data for consumption
  • Expert level of understanding and implementing ETL architecture; data profiling, process flow, metric logging and error handling
  • Good communication & client management skills

Mandatory skills:
  • 10+ years of industry experience combining development and data specific work stream
  • 4+ years leading a team (a minimum of 4 nos) and projects
  • 5+ years of experience with code development using Python, PySpark, SQL in atleast 3 previous engagements
  • 5+ years of experience with advanced level development in SQL/NoSQL scripting and complex stored procedures (Snowflake, SQL Server)
  • 2+ years of experience in data warehouse design/architecture, dimensional data modeling and ETL process development
  • 2+ years of experience with AWS services such as Glue (Spark), EMR, S3, Lambda, and Athena
  • 6+ months experience working in Snowflake data warehouses
  • 6+ months experience handling Streaming Services - Confluent Kafka and Kinesis (or equivalent) in atleast one previous hands on implementation
  • Bachelor's degree in Computer Science, MIS or related field (industry experience substitutable)

Nice to have skills:
  • Hands on experience in designing and developing applications using Java Spring Framework (Spring Boot, Spring Cloud, Spring Data etc)

Type of Project (Development/Support/Migration/Upgrade/etc....):

Shifts, If any: Must be willing to work from 1pm IST to 10pm IST to have overlap with US customer work hours

Client Interview (Yes/No) Yes



Our Company

Hitachi Vantara is part of the Global Hitachi family. We balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical reputation. We guide customers from what's now to what's next by unlocking the value of their data and applications to solve their digital challenges, achieving outcomes that benefit both business and society.

Our people are our biggest asset, they drive our innovation advantage and we strive to offer a flexible and collaborative workplace where they can thrive. Diversity of thought is welcomed and our employee base is represented by several active Employee Resource Group communities. We offer industry leading benefits packages (flexible working, generous pension and private healthcare) and promote a creative and inclusive culture. If driving real change gives you a sense of pride and you are passionate about powering social good, we'd love to hear from you.

Our Values

We strive to create an inclusive environment for all and are open to considering home working, compressed/flexible hours and flexible arrangements. Get in touch with us to explore how we might be able to accommodate your specific needs.

We are proud to say we are an equal opportunity employer and welcome all applicants for employment without attention to race, colour, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status. With Japanese roots going back over 100 years, our culture is founded on the values of our parent company expressed as the Hitachi Spirit:
  • Wa - Harmony, Trust, Respect
  • Makoto - Sincerity, Fairness, Honesty, Integrity
  • Kaitakusha-Seishin - Pioneering Spirit, Challenge

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD2915462
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Bengaluru, Karnataka, India
  • Education
    Not mentioned
  • Experience
    Year