Sr. Data Engineer

Year    KL, IN, India

Job Description

We would need the candidate to work from office for the first month during transition. Then can go into hybrid model. Experience Level - 8-10 years' experience No. of Positions - 1

Job Role/ (Please fill in the exact role expected out of the candidate)

What roles and responsibilities will be performed by the selected candidate? ?Senior Data Engineer will be responsible for designing, implementing, and maintaining data solutions on the Microsoft Azure Data platform and SQL Server (SSIS, SSAS, UC4 Atomic) ?Collaborate with various stakeholders, and ensuring the efficient processing, storage, and retrieval of large volumes of data ?Technical Expertise and Responsibilities oDesign, build, and maintain scalable and reliable data pipelines. oShould be able to design and build solutions in Azure data factory and Databricks to extract, transform and load data into different source and target systems. oShould be able to design and build solutions in SSIS oShould be able to analyze and understand the existing data landscape and provide recommendations/innovative ideas for rearchitecting / optimizing / streamlining to bring efficiency and scalability. oMust be able to collaborate and effectively communicate with onshore counterparts to address technical gaps, requirement challenges, and other complex scenarios. oMonitor and troubleshoot data systems to ensure high performance and reliability. oShould be highly analytical and detail-oriented with extensive familiarity with database management principles. oOptimize data processes for speed and efficiency. oEnsure the data architecture supports business requirements and data governance policies. oDefine and execute the data engineering strategy in alignment with the company's goals. oIntegrate data from various sources, ensuring data quality and consistency. oStay updated with emerging technologies and industry trends. oUnderstand the big picture business process utilizing deep knowledge in banking industry and translate them to data requirements. oEnabling and running data migrations across different databases and different servers oPerform thorough testing and validation to support the accuracy of data transformations and data verification used in machine learning models. oAnalyze data and different systems to define data requirements. oShould be well versed with Data Structures & algorithms. oDefine data mapping working along with business and digital team and data team. oData pipeline maintenance/testing/performance validation oAssemble large, complex data sets that meet functional / non-functional business requirements. oAnalyze and identify gaps on data needs and work with business and IT to bring in alignment on data needs. oTroubleshoot and resolve technical issues as they arise. oOptimize data flow and collection for cross-functional teams. oWork closely with Data counterparts at onshore, product owners, and business stakeholders to understand data needs and strategies. oCollaborate with IT and DevOps teams to ensure data infrastructure aligns with overall IT architecture. oImplement best practices for data security and privacy. oDrive continuous improvement initiatives within the data engineering function oOptimize data flow and collection for cross-functional teams. oUnderstand impact of data conversions as they pertain to servicing operations. oManage higher volume and more complex cases with accuracy and efficiency. What is the expectation from the candidate's current role/profile? ?Design and develop warehouse solutions using Azure Synapse Analytics, ADLS, ADF, Databricks, Power BI, Azure Analysis Services ?Should be proficient in SSIS, SQL and Query optimization. ?Should have worked in onshore offshore model managing challenging scenarios. ?Expertise in working with large amounts of data (structured and unstructured), building data pipelines for ETL workloads and generate insights utilizing Data Science, Analytics. ?Expertise in Azure, AWS cloud services, and DevOps/CI/CD frameworks. ?Ability to work with ambiguity and vague requirements and transform them into deliverables. ?Good combination of technical and interpersonal skills with strong written and verbal communication; detail-oriented with the ability to work independently. ?Drive automation efforts across the data analytics team utilizing Infrastructure as Code (IaC) using Terraform, Configuration Management, and Continuous Integration (CI) / Continuous Delivery (CD) tools such as Jenkins. ?Help build define architecture frameworks, best practices & processes. Collaborate on Data warehouse architecture and technical design discussions. ?Expertise in Azure Data factory and should be familiar with building pipelines for ETL projects. ?Expertise in SQL knowledge and experience working with relational databases. ?Expertise in Python and ETL projects ?Experience in data bricks will be of added advantage. ?Should have expertise in data life cycle, data ingestion, transformation, data loading, validation, and performance tuning.

Job Types: Full-time, Contractual / Temporary
Contract length: 8 months

Pay: ?70,000.00 - ?80,000.00 per month

Schedule:

Day shift
Application Question(s):

How many years of experience do you have as a Data Engineer? Are you proficient in SSIS, SQL and Query optimization? Do you have experience in designing and developing warehouse solutions using Azure Synapse Analytics, ADLS, ADF, Databricks, Power BI,
Azure Analysis Services ?

Are you willing to work on C2H positions for an MNC? Do you have more than 8 yrs of experience as a Data Engineer?
Work Location: In person

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD3720084
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Contract
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    KL, IN, India
  • Education
    Not mentioned
  • Experience
    Year