Job Description

Role and Responsibility Details:

Role: Data Engineer (a Data developer with experience in Python)

Years of Experience: 3-10 years

Work within Program:

Develop high-performance ETL pipelines on large datasets in the Azure cloud leveraging Databricks+Python as the BigData platform.

Required Skills

50% of work: Solid Python development skills is important. Knowledge and experience in Python for data manipulation or back-end API or framework development (NOT applications development unless a person with app development skills is OK and would like to work as a data engineer)

25% of work: Database Developer with strong knowledge of relational DB concepts and SQL on any relational DB

25% of work: Experience with any ETL framework/tool although SSIS preferred

Required but we can provide training and they can learn if lacking the experience in these areas

API Development in Python

Azure Data Factory (ADF)

SPARK, Databricks

Nice-to-have

Collaborative Agile experience

CI/CD skills

General Traits

Excellent Analytical & Communication Skills

:

Work within Program:

Develop high-performance ETL pipelines on large datasets in the Azure cloud leveraging Databricks+Python as the BigData platform.

Required Skills

50% of work: Solid Python development skills is important. Knowledge and experience in Python for data manipulation or back-end API or framework development (NOT applications development unless a person with app development skills is OK and would like to work as a data engineer)

25% of work: Database Developer with strong knowledge of relational DB concepts and SQL on any relational DB

25% of work: Experience with any ETL framework/tool although SSIS preferred

Required but we can provide training and they can learn if lacking the experience in these areas

API Development in Python

Azure Data Factory (ADF)

SPARK, Databricks

Nice-to-have

Collaborative Agile experience

CI/CD skills

General Traits

Excellent Analytical & Communication Skills

Qualifications:

• Bachelor of Technology in Computer Science,BE ,* Bachelor of Engineering in Computer Science

The Digital Group