Job Title:
Software Engineer II
We are currently looking for a dynamic, professional, team-oriented, self-motivated individual with excellent communication skills and a positive attitude to join our Data Engineering team. This profile has a responsibility of developing integrations, ETL, storage, and usage of data within an organization. The role is responsible for the implementation, integration, and expansion of the Data Platform system using big data, cloud technology and other trending technologies.
Candidate must have experience on Python, Spark, My SQL, Anyone of the Cloud technologies, preferred Google, Google Databricks.
Knowledge of working with Iceberg tables, Blob storages, S3 BucketsMinimum of 4 years work experience as a Data Engineer & 3+ years' experience in Data Warehouse design and development for large-scale complex Data Platform. Experience with star schemas, dimensional modeling, and extract transform load (ETL) design and development.
Expertise in cloud-based data platforms, such as Google, AWS, & Azure. In-depth knowledge of data modeling concepts and techniques, including relational, dimensional, and NoSQL data models
Experience with open table formats like Iceberg, Hudi and Delta.
Understanding of major programming/scripting languages like Java and/or R.
Expert with data integration technologies like Kafka and Spark.
Experience working with RDBMS like Oracle, SQL Server, MySQL and Postgres.
Developer will be responsible for developing the Cloud Data warehouse using Google or Azure Platform.
Candidate should be familiar with Python, Spark, Sql, No SQL, Dataproc, Airflow, DAG's, Automations, API integrations, Jupiter notebook, Databricks.
Good to have knowledge working on large datasets, data pipeline optimization/performance tuning, Azure / Google DWH & Data Lakes, Analytics
Experience working on Azure/Google Cloud services IaaS, PaaS
Understand organization strategy and ability to design information systems to deliver the strategy on Azure/Google Platform
Identify high-level business needs and lead the creation of detailed functional specs and other documentation, such as requirement traceability matrix, work-flow diagrams, use-cases etc
Experience developing integration architecture and plan the system integration with third-party solutions and services. Involvement in various cloud Infrastructure architecture with proven experience with designing solutions in line with Azure/Google architecture
Location:
IND Bangalore - 2nd Floor Divyasree Towers Bannerghatta Main Road
Language Requirements:
Time Type:
Full time
MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.