? Experience in Data Processing Flow with Gen AI application
? Experience working with Unstructured data
(Must Have)
? Worked on production with more than 10000 file injection
(Must Have)
? Experience in multi model injection
(Must Have)
? OCR capabilities
-----------Detailed JD------------
:
We are seeking an experienced Azure Data Engineer with expertise in Azure Data Factory, Azure Databricks, and Azure Data Fabric to lead the migration of our existing data pipeline and processing infrastructure. The ideal candidate will have a strong background in Azure cloud data services, big data analytics, and data engineering, with specific experience in Azure Data Fabric. We are looking for someone who has at least
6 months of hands-on experience with Azure Data Fabric
or has successfully completed at least
one migration
to Azure Data Fabric.
Key Responsibilities:
? Assess the current data architecture using Azure Data Factory and Databricks and develop a detailed migration plan to Azure Data Fabric.
? Design and implement end-to-end data pipelines within Azure Data Fabric, including data ingestion, transformation, storage, and analytics.
? Optimize data workflows to leverage Azure Data Fabric's unified platform for data integration, big data processing, and real-time analytics.
? Ensure seamless integration of data from SharePoint and other sources into Azure Data Fabric, maintaining data quality and integrity.
? Collaborate with business analysts and business stakeholders to align data strategies and optimize the data environment for machine learning and AI workloads.
? Implement security best practices, including data governance, access control, and monitoring within Azure Data Fabric.
? Conduct performance tuning and optimization for data storage and processing within Azure Data Fabric to ensure high availability and cost efficiency.
Key Requirements:
? Proven experience (5+ years) in Azure data engineering with a strong focus on Azure Data Factory and Azure Databricks.
? At least
6 months of hands-on experience with Azure Data Fabric
or completion of
one migration
to Azure Data Fabric.
? Hands-on experience in designing, building, and managing data pipelines, data lakes, and data warehouses on Azure.
? Expertise in Spark, SQL, and data transformation techniques within Azure environments.
? Strong understanding of data governance, security, and compliance in cloud environments.
? Experience with migrating data architectures and optimizing workflows on cloud platforms.
? Ability to work collaboratively with cross-functional teams and communicate technical concepts effectively to non-technical stakeholders.
? Azure certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect Expert) are a plus.
Job Types: Full-time, Permanent
Pay: ₹1,500,000.00 - ₹2,000,000.00 per year
Application Question(s):
Notice period
Current CTC
Expected CTC
Experience:
Data Engineering: 5 years (Preferred)
Azure Data Factory: 4 years (Required)
Azure Data Bricks: 4 years (Required)
Date processing with Gen AI: 2 years (Required)
Azure Data Fabric: 1 year (Required)
Work Location: Remote
Beware of fraud agents! do not pay money to get a job
MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.