Job Description

Azure Data Engineer

-----------------------

Job ID:

Clo-ETP-Ind-1097

Location:

India,Pune

Job Summary:

We are seeking a skilled and experienced Cloud Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, implementing, and maintaining data solutions on the Azure/AWS cloud platforms. The candidate should have a strong background in data engineering, including ETL processes, data warehousing, and database management. The role requires expertise in Databricks other relevant technologies. The Data Engineer will collaborate with cross-functional teams to ensure the successful delivery of scalable and efficient data solutions.



Minimum 3-5 Years of Experience in Data Integration platform on cloud (Azure preferred)

Responsibilities:

Solution Design and Architecture:

Collaborate with stakeholders to understand business requirements and design scalable data solutions on the cloud platforms. Create and maintain data architecture diagrams and documentation.

Data Ingestion and ETL:

Develop and implement ETL processes using Databricks, and other relevant tools. Design and optimize data pipelines to ensure efficient data processing and transformation.

Data Storage and Management:

Implement and manage Relational Databases, Snowflake and other data sources. Ensure data integrity, security, and compliance with industry best practices and organizational standards.

Data Transformation and Processing:

Utilize Databricks and other tools for data transformation and processing. Optimize queries and data processing workflows for performance and efficiency.

Monitoring and Optimization:

Implement monitoring solutions to track the performance and health of data solutions. Identify and resolve performance bottlenecks and optimize data processing workflows.

Collaboration and Communication:

Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders. Communicate effectively with technical and non-technical audiences, providing insights and recommendations.

Automation and Scripting:

Develop scripts and automation processes to streamline data engineering tasks.

Qualifications:

Bachelor's degree in Computer Science, Information Technology, or a related field. Proven experience as a Data Engineer with Azure/AWS cloud technologies. In-depth knowledge of Databricks, and other relevant Azure services. Strong proficiency in SQL, Python, and/or other scripting languages. Experience with data modeling, schema design, and database performance tuning. Familiarity with data warehousing concepts and best practices. Excellent problem-solving and analytical skills. Effective communication and collaboration skills.


If you meet these qualifications and are excited about the opportunity to work with cutting-edge cloud technologies to solve complex data challenges, we encourage you to apply. Join our team and be a key contributor to the success of our data-driven initiatives.