Pyspark + Databricks

Year    TS, IN, India

Job Description

Job Summary




We are seeking a highly skilled Sr. Developer with 6 to 10 years of experience to join our team. The ideal candidate will have expertise in Databricks SQL Databricks Workflows and PySpark. Experience in the Cards & Payments domain is a plus. This is a hybrid work model with day shifts and no travel required.





Responsibilities



Develop and maintain scalable data pipelines using Databricks SQL and Databricks Workflows. Implement and optimize PySpark code for data processing and analytics. Collaborate with cross-functional teams to understand data requirements and deliver solutions. Ensure data quality and integrity through rigorous testing and validation. Provide technical guidance and support to junior developers. Monitor and troubleshoot data pipeline performance and resolve issues promptly. Participate in code reviews to maintain high coding standards. Stay updated with the latest industry trends and technologies in data engineering. Contribute to the continuous improvement of development processes and best practices. Document technical specifications and maintain comprehensive project documentation. Work closely with stakeholders to gather requirements and provide timely updates on project progress. Utilize domain knowledge in Cards & Payments to enhance data solutions. Ensure compliance with data security and privacy regulations.




Qualifications



Possess strong expertise in Databricks SQL and Databricks Workflows. Demonstrate proficiency in PySpark for data processing and analytics. Have experience in developing and maintaining scalable data pipelines. Show ability to collaborate effectively with cross-functional teams. Exhibit strong problem-solving skills and attention to detail. Have knowledge of data quality and validation techniques. Possess excellent communication and documentation skills. Experience in the Cards & Payments domain is a plus. Familiarity with data security and privacy regulations is desirable. Ability to work in a hybrid work model with day shifts. Minimum of 6 years and maximum of 10 years of relevant experience. Bachelors degree in Computer Science Engineering or a related field is preferred. * Strong commitment to continuous learning and professional development.

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD4423195
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    TS, IN, India
  • Education
    Not mentioned
  • Experience
    Year