Job Description

Experience: 6-9 years

Skills: ADF (Azure Data Factory) experience as that's a must. Ci/Cd is also required. Should have understanding about Data Governance

Requirements:


As a Data Engineer, you will be responsible for establishing and optimizing the flow of data throughout the organization while ensuring its security.


Executing end-to-end data pipeline, from designing the technical architecture, and developing the application to finally testing and implementing the proposed solution.


The Data Engineer will also be expected to actively participate in design and implementation of projects bearing a high degree of technical complexity and/or scalability and performance significance.


Identifying data sources, both internal and external, and working out a plan for data management that is aligned with organizational data strategy.


Collaborate cross-functionally with roles such as IT infrastructure, Digital/application development, and Legal to identify and highlight gaps and risks around Cybersecurity and Data Protection such as GDPR.

Experience & Key Competencies


3+ years of experience of SQL writing and data modelling skills, with a solid understanding of data technologies including RDBMS, No-SQL databases.


Experience with one or more of the following databases: SQL Server, MySQL, PostgreSQL, Oracle, Couch-base, Redis, Elastic Search or other NoSQL technologies.


Proven experience in building ETL/ELT pipelines, preferably from SQL to Azure services
Architecture experience of making ETL operations such as Medallion Architecture etc.


Familiarity with CI/CD practices for data pipelines and version control using Git


Experience or understanding of Data Governance, Data Quality, Data Issue Management.


Ensure compliance with all regulations, policies, and procedures.
Escalate issues/risks pro-actively to appropriate stakeholders.


Regularly communicate status and challenges to team members and management


Excellent and resourceful problem-solving skills, adaptable and willingness to learn.


Good analysis skills - to be able to join the dots across multiple applications and interfaces between them.

Skill Set


Experience with one or more of the following databases: SQL Server, MySQL, PostgreSQL, Oracle, Couch-base, Redis, Elastic Search or other NoSQL technologies.


Experience in Data factory and Data Lake technologies.


Rich Experience in data modelling techniques and creating various data models.


Experience in Azure cloud services and architecture patterns.


Understanding of RESTful APIs for data distribution.


Understanding of deployment architecture and infrastructure in both on-prem and cloud hosting environments

Job Types: Full-time, Permanent

Benefits:

Health insurance Paid time off Provident Fund
Schedule:

Day shift
Work Location: In person