Job Description

:

We are seeking a highly skilled and experienced Lead Data Engineer to spearhead the design, development, and optimization of scalable data infrastructure. As a key member of our data team, you will be responsible for architecting data pipelines, leading data platform initiatives, and mentoring a team of data engineers to enable data-driven decision-making across the organization.

Key Skills

:

SQL, ETL Tools, Reporting Tools

Key Requirement :

? The day-to-day development activities will need knowledge of the below concepts.

? Expert-level knowledge in RDBMS (SQL Server) with clear understanding of SQL query writing, object creation and management and performance and optimisation of DB/DWH operations.

? Good understanding of Transactional and Dimensional Data Modelling, Star Schema, Facts/Dimensions, Relationships

? Good understanding of ETL concepts and exposure to at least one ETL service providing tool. (SSIS/ADF/Databricks/Airflow)

? Expert-level knowledge in at least one MS reporting/visualisation tool (Power BI/Azure Analysis Services) ? In-depth expertise in Azure Data Factory and Databricks, including building scalable data pipelines, orchestrating complex workflows, implementing dynamic and parameterized pipelines, and optimizing Sparkbased data transformations for large-scale integrations.

? Hands-on experience with Databricks Unity Catalog for centralized data governance, fine-grained access control, auditing, and managing data assets securely across multiple workspaces.

? Should have worked on at least 1 development lifecycle of one of the below:

? End-to-end ETL project (Involving any ETL tool)

? End-to-end reporting project (Involving a reporting too, Power BI & Analysis Services preferred)

? Ability to write and review test cases, test code and validate code.

? Ability to perform data analysis on different reports to come up with troubleshooting of missing data, suggest value added metrics and consult on best practices to the customer

? Good understanding of SDLC practices like source control, version management, usage of Azure Devops and CI/CD practices.

.

Project context:

? Should have the skill to fully understand the context and use-case of a project and have a personal vision for it -Play the role of interfacing with customer directly on a daily basis.

? Should be able to converse with functional users and convert requirements into tangible processes/models and documentation in available templates.

? Should be able to provide consultative options to customer on best way to execute projects

? Should have a good understanding of project dynamics - scoping, setting estimates, setting timelines, working around timelines in case of exceptions, etc.

? Should be able to demonstrate the ability to technically lead a team of developers and testers and perform design reviews, code reviews, etc.

? Should have a good understanding of presentation and communications skills - written or verbal, specially to express technical ideas / solutions.

Preferred skills:

? Knowledge of Python is a bonus

? Knowledge of Azure Devops, Source Control/Repos is good to have

FOR IMMEDIATE RESPONSE PLEASE SEND YOUR UPDATED CV TO

arun@qapsoftware.com

Job Type: Full-time

Benefits:

Provident Fund
Application Question(s):

How many years of Total IT experience you are having ? How many years of experience do you have working with SSIS /SSAS ? How many years of experience do you have working with Power BI dashboards connected to SSAS Tabular models? How many years of experience you are having with CI/CD in SQL server ?
Work Location: In person