Python Pyspark Azure

Year    AP, IN, India

Job Description

We are seeking a highly skilled and experienced Consultant to join our team. In this role, you will be responsible for designing and developing robust data pipelines using Apache Spark on Databricks. You will also be responsible for optimizing and troubleshooting existing pipelines for performance and reliability. As a Consultant, you will collaborate with data scientists and analysts to understand their requirements and ensure data quality, integrity, and security across various sources. Additionally, you will implement ETL processes and integrate with cloud platforms such as Azure, AWS, and GCP. Other responsibilities include maintaining and monitoring Databricks clusters and notebooks, documenting technical specifications and pipeline workflows, and staying updated on Databricks features and best practices. The ideal candidate will have at least 7 years of experience in a similar role and will work from our Virtusa office. If you are a self-motivated and detail-oriented individual with a passion for data and technology, we would love to hear from you.

About Virtusa





Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth -- one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.



Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.



Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD4097792
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    AP, IN, India
  • Education
    Not mentioned
  • Experience
    Year