Job Description

Company Name: VARITE India Private Limited
About The Client:
Client is an Indian multinational technology company specializing in information technology services and consulting. Headquartered in Mumbai, it is a part of the Tata Group and operates in 150 locations across 46 countries.
Essential Job Functions:

• Design, develop, implement, and maintain robust and scalable ETL pipelines using Python and SQL as well as AWS Glue and AWS Lambda for data ingestion, transformation, loading into various data targets (e.g., PostgreSQL, Client S3, Redshift, Aurora) and structured data management. Translate business requirements and data models into efficient and secure data processing solutions.
• Pull data using APIs and handle large datasets efficiently.
• Integrate data from various sources including REST APIs (OAuth, JWT, Basic Auth), CSVs, and relational databases ensuring accurate configuration, optimization and schema definitions.
• Optimize code and reduce ETL execution time through performance tuning and error handling best practices.
• Write, test, and deploy AWS Glue ETL scripts (Python/PySpark or Scala) to perform complex data transformations, cleansing, aggregation, and enrichment. Implement security best practices for data in transit and at rest.
• Automate job execution using cron or other scheduling tools and monitor pipeline health.
• Use Git for version control, maintaining CI/CD hygiene for data scripts and managing ETL code through various branching strategies.
• Troubleshoot and debug complex ETL workflows and provide RCA for failures.
• Work on Linux-based systems with shell scripting for operational support.
• Collaborate effectively with business users and data engineers through Pull Request (PR) / Merge Request (MR) workflows to gather requirements and document workflows.
• Ensure code quality, data quality, consistency, and timely delivery of all scheduled data loads while adhering to branching policies to ensure isolated changes and preventing conflicts with ongoing work.
• Participate in code review processes, providing constructive feedback and ensuring that proposed changes align with data integrity, performance, and security standards before merging into shared branches.
• Manage the promotion of ETL code across different environments (e.g., Development, Staging, Production) by adhering to defined branching and release strategies, ensuring smooth and controlled deployments.
• Participate in Agile rituals, such as daily stand-up meetings, and other project meetings to contribute to achieve project deliverables within required timeframe.
• Maintain regular communication with supervisor and continually update needs, priorities and risks to the supervisor.
• Critical analytical, problem-solving skills is essential. Be able to communicate clearly the message via oral communication and written communication.
• Possess an assertive communication style, but maintain a positive relationship with all team members and stakeholders. Strong focus on continuous learning and improvement

Qualifications:

• Skill Required: Digital: Client Web Service (AWS) Cloud Computing
• Experience Range: 6-8yrs

Essential Skills

• AWS Glue Hands-on experience in coding techniques with a proven record.
• Hands-on experience in end-to-end data workflows, including pulling data from third-party and in-house tools via APIs, transforming and loading it into data warehouses, and improving performance across the ETL lifecycle.
• Hands-on experience with scripting (Python, shell scripting), relational databases (PostgreSQL, Redshift), REST APIs (OAuth, JWT, Basic Auth), job scheduler (cron), version control system (Git), and in AWS environment.
• Hands-on experience in integrating data from various data sources. Understanding of Agile processes and principles.
• Good communication and presentation skills

Desirable:

• Hands-on experience in integrating data from various data sources. Understanding of Agile processes and principles.
• Good communication and presentation skills

How to Apply: Interested candidates are encouraged to respond/submit their updated resumes, and for additional job opportunities, please visit
Unlock Rewards: Refer Candidates and Earn.
If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program, where you'll receive a one-time referral bonus based on the following scale if the referred candidate completes a three-month assignment with VARITE.
Experience Level Bonus Referral: 0-2 years INR 5,000
2-6 years INR 7,500
6+ years INR 10,000
About VARITE: VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.
Equal Opportunity Employer:
VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.