Job Description

Experience: 6-9 years

Skills: ADF (Azure Data Factory) experience as that's a must. Ci/Cd is also required. Should have understanding about Data Governance

Requirements:

? As a Data Engineer, you will be responsible for establishing and optimizing the flow of data throughout the organization while ensuring its security.

? Executing end-to-end data pipeline, from designing the technical architecture, and developing the application to finally testing and implementing the proposed solution.

? The Data Engineer will also be expected to actively participate in design and implementation of projects bearing a high degree of technical complexity and/or scalability and performance significance.

? Identifying data sources, both internal and external, and working out a plan for data management that is aligned with organizational data strategy.

? Collaborate cross-functionally with roles such as IT infrastructure, Digital/application development, and Legal to identify and highlight gaps and risks around Cybersecurity and Data Protection such as GDPR.

Experience & Key Competencies

? 3+ years of experience of SQL writing and data modelling skills, with a solid understanding of data technologies including RDBMS, No-SQL databases.

? Experience with one or more of the following databases: SQL Server, MySQL, PostgreSQL, Oracle, Couch-base, Redis, Elastic Search or other NoSQL technologies.

? Proven experience in building ETL/ELT pipelines, preferably from SQL to Azure services? Architecture experience of making ETL operations such as Medallion Architecture etc.

? Familiarity with CI/CD practices for data pipelines and version control using Git

? Experience or understanding of Data Governance, Data Quality, Data Issue Management.

? Ensure compliance with all regulations, policies, and procedures.? Escalate issues/risks pro-actively to appropriate stakeholders.

? Regularly communicate status and challenges to team members and management

? Excellent and resourceful problem-solving skills, adaptable and willingness to learn.

? Good analysis skills - to be able to join the dots across multiple applications and interfaces between them.

Skill Set

? Experience with one or more of the following databases: SQL Server, MySQL, PostgreSQL, Oracle, Couch-base, Redis, Elastic Search or other NoSQL technologies.

? Experience in Data factory and Data Lake technologies.

? Rich Experience in data modelling techniques and creating various data models.

? Experience in Azure cloud services and architecture patterns.

? Understanding of RESTful APIs for data distribution.

? Understanding of deployment architecture and infrastructure in both on-prem and cloud hosting environments

Job Types: Full-time, Permanent

Benefits:

Health insurance Paid time off Provident Fund
Schedule:

Day shift
Work Location: In person