Job Description

Position: Data Engineer - Core Python (MT610FT RM 3738)

Job Summary:

We are seeking a highly skilled Data Engineer with a strong background in Python to join our dynamic team. The ideal candidate will have 6 to 10 years of experience in data engineering, with a proven track record of designing, building, and maintaining scalable data pipelines and architectures. You will play a crucial role in transforming raw data into actionable insights, enabling data driven decision making across the organization.

Skills Core Python + good to have PySpark

Responsibilities:

Design, develop, and maintain robust data pipelines and ETL processes to support data ingestion and transformation.


Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high quality data solutions.


Implement data models and architectures that support analytics and reporting needs.


Optimize data storage and retrieval processes for performance and scalability.


Ensure data quality and integrity through rigorous testing and validation processes.


Monitor and troubleshoot data pipeline performance, implementing improvements as necessary.


Stay updated with industry trends and best practices in data engineering and related technologies.


Document data processes, architectures, and workflows for knowledge sharing and compliance.

Mandatory Skills:

Strong proficiency in Python, with experience in data manipulation libraries such as Pandas and NumPy.


Extensive experience with SQL and relational databases (e.g., PostgreSQL, MySQL).


Hands on experience with data warehousing solutions and ETL tools.


Familiarity with big data technologies (e.g., Hadoop, Spark) is a plus.


Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services.


Strong understanding of data modeling concepts and best practices.


Excellent problem solving skills and attention to detail.

Preferred Skills:

Experience with data visualization tools (e.g., Tableau, Power BI).


Knowledge of machine learning concepts and frameworks.


Familiarity with containerization technologies (e.g., Docker, Kubernetes).


Experience with version control systems (e.g., Git).

Qualifications:

Bachelor's or Master's degree in Computer Science, Engineering, or a related field.


6 10 years of experience in data engineering or a related field.


Proven track record of successful data projects and implementations.


Strong communication skills and ability to work collaboratively in a team environment.

*

Job Category:

Digital_Cloud_Web Technologies

Job Type:

Full Time

Job Location:

BangaloreChennai

Experience:

6-10 years

Notice period:

0-30 days