Job Description

Job Summary

As a Sr. Developer you will play a pivotal role in optimizing and enhancing our data processing capabilities using PySpark and AWS technologies. Your expertise in Python and domain knowledge in Cards & Payments will drive impactful solutions. This hybrid role offers the flexibility of day shifts ensuring a balanced work-life integration.

Responsibilities

Optimize Pyspark applications to improve performance and resource utilization ensuring efficient data processing and analysis. Develop and maintain scalable solutions using AWS EC2 and AWS EMR to support business needs and data-driven decision-making. Implement PySpark frameworks to process large datasets enhancing data accessibility and insights for stakeholders. Collaborate with cross-functional teams to design and deploy robust data pipelines ensuring seamless integration with existing systems. Utilize Python programming to automate tasks and streamline workflows contributing to increased productivity and reduced operational costs. Analyze and interpret data within the Cards & Payments domain providing actionable insights to drive strategic initiatives. Ensure data security and compliance with industry standards safeguarding sensitive information and maintaining trust with clients. Troubleshoot and resolve technical issues related to Pyspark and AWS environments minimizing downtime and optimizing system performance. Participate in code reviews and provide constructive feedback to peers fostering a culture of continuous improvement and innovation. Document technical processes and solutions creating comprehensive guides for future reference and knowledge sharing. Stay updated with the latest advancements in PSpark and AWS technologies applying new techniques to enhance project outcomes. Engage in collaborative problem-solving sessions contributing to the development of creative solutions for complex challenges. Support the team in achieving project milestones and deliverables ensuring alignment with organizational goals and objectives.

Qualifications

Demonstrate proficiency in Spark Optimization techniques showcasing the ability to enhance data processing efficiency. Exhibit strong experience with AWS EC2 and AWS EMR highlighting expertise in cloud-based solutions and infrastructure management. Possess advanced skills in Apache Spark demonstrating capability in handling large-scale data processing tasks. Showcase expertise in Python programming emphasizing ability to automate processes and develop efficient solutions. Have domain knowledge in Cards & Payments providing insights and understanding of industry-specific challenges and opportunities. Display a minimum of 5 years of relevant experience ensuring a solid foundation in technical and domain skills. * Present a maximum of 8 years of experience indicating a balance of expertise and adaptability in evolving technologies.