Job Description

Job Purpose

Conduct technical analyses of existing data pipelines, ETL processes, and on-premises/cloud system, identify technical bottlenecks, evaluate migration complexities, and propose optimizations.

Desired Skills and experience

Candidates should have a B.E./B.Tech/MCA/MBA in Finance, Information Systems, Computer Science or a related field

7+ years of experience as a Data and Cloud architecture with client stakeholders

Strong experience in Synapse Analytics, Databricks, ADF, Azure SQL (DW/DB), SSIS.

Strong experience in Advanced PS, Batch Scripting, C# (.NET 3.0).

Expertise on Orchestration systems with ActiveBatch and AZ orchestration tools.

Strong understanding of data warehousing, DLs, and Lakehouse concepts.

Excellent communication skills, both written and verbal

Extremely strong organizational and analytical skills with strong attention to detail

Strong track record of excellent results delivered to internal and external clients

Able to work independently without the needs for close supervision and collaboratively as part of cross-team efforts

Experience with delivering projects within an agile environment

Experience in project management and team management

Key responsibilities include:

Understand and review PowerShell (PS), SSIS, Batch Scripts, and C# (.NET 3.0) codebases for data processes. Assess the complexity of trigger migration across Active Batch (AB), Synapse, ADF, and Azure Databricks (ADB). Define usage of Azure SQL DW, SQL DB, and Data Lake (DL) for various workloads, proposing transitions where beneficial. Analyze data patterns for optimization, including direct raw-to-consumption loading and zone elimination (e.g., stg/app zones). Understand requirements for external tables (Lakehouse) Lead project deliverables, ensuring actionable and strategic outputs. Evaluate and ensure quality of deliverables within project timelines Develop a strong understanding of equity market domain knowledge Collaborate with domain experts and business stakeholders to understand business rules/logics Ensure effective, efficient, and continuous communication (written and verbally) with global stakeholders Independently troubleshoot difficult and complex issues on dev, test, UAT and production environments Responsible for end-to-end delivery of projects, coordination between client and internal offshore teams and manage client queries Demonstrate high attention to detail, should work in a dynamic environment whilst maintaining high quality standards, a natural aptitude to develop good internal working relationships and a flexible work ethic * Responsible for Quality Checks and adhering to the agreed Service Level Agreement (SLA) / Turn Around Time (TAT)