Databricks + Pyspark

Year    OR, IN, India

Job Description

Job Summary




We are seeking a highly skilled Sr. Developer with 6 to 9 years of experience to join our dynamic team. The ideal candidate will have expertise in Delta Live Pipelines Python Databricks SQL Databricks Workflows and PySpark. This hybrid role involves working on cutting-edge projects that drive innovation and efficiency. The position is based on a day shift schedule with no travel requirements.





Responsibilities



Develop and implement robust data solutions using Delta Live Pipelines to enhance data processing capabilities. Collaborate with cross-functional teams to design and optimize Databricks SQL queries for improved performance. Utilize Python to automate data workflows and streamline processes ensuring high-quality data management. Oversee the deployment and maintenance of Databricks Workflows to support seamless data integration. Leverage PySpark to process large datasets efficiently contributing to data-driven decision-making. Ensure data accuracy and integrity by implementing best practices in data engineering and management. Provide technical guidance and support to junior developers fostering a collaborative team environment. Conduct regular code reviews to maintain high standards of code quality and performance. Identify and resolve technical issues promptly to minimize disruptions in data operations. Stay updated with the latest industry trends and technologies to continuously improve data solutions. Document processes and solutions to facilitate knowledge sharing and team collaboration. Engage in continuous learning to enhance skills and contribute to innovative solutions. Drive the implementation of data solutions that align with the companys strategic goals and societal impact.




Qualifications



Possess a strong background in Delta Live Pipelines and Databricks SQL with proven experience in data engineering. Demonstrate proficiency in Python and PySpark with a focus on developing scalable data solutions. Experience in designing and optimizing Databricks Workflows for efficient data integration. Strong problem-solving skills and the ability to troubleshoot complex data issues effectively. Excellent communication skills to collaborate with team members and stakeholders. A proactive approach to learning and adapting to new technologies and methodologies. A bachelors degree in Computer Science Information Technology or a related field is preferred.




Certifications Required




Databricks Certified Data Engineer Associate Python Certification

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD4488579
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    OR, IN, India
  • Education
    Not mentioned
  • Experience
    Year