Job Description

Project Role :

Custom Software Engineer

Project Role Description :

Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs.

Must have skills :

Databricks Unified Data Analytics Platform

Good to have skills :

NA

Minimum

5

year(s) of experience is required

Educational Qualification :

15 years full time education



Summary: The Senior Support Analyst will act as a subject matter expert for data platform operations, focusing on Databricks and related technologies. This role involves advanced troubleshooting, performance optimization, and mentoring junior analysts, ensuring high availability and reliability of data workflows across the enterprise. Key Responsibilities Advanced Incident Management: Lead resolution of complex technical issues related to Databricks clusters, jobs, and integrations. Performance Optimization: Analyze and optimize Spark jobs, cluster configurations, and resource utilization. Platform Governance: Ensure compliance with security, data governance, and operational standards. Automation & Efficiency: Develop scripts and tools to automate monitoring, alerting, and routine support tasks. Integration Expertise: Support connectivity between Databricks and enterprise systems (Azure Data Lake, AWS S3, Snowflake, etc.). Knowledge Management: Create and maintain advanced troubleshooting guides, SOPs, and best practices. Mentorship: Guide and train junior support analysts and business users on Databricks usage. Collaboration: Partner with data engineering, architecture, and governance teams for platform enhancements. Required Skills Databricks Expertise: Deep knowledge of Databricks notebooks, clusters, job scheduling, and Delta Lake. Programming: Strong proficiency in Python, SQL, and PySpark. Cloud Platforms: Hands-on experience with Azure or AWS integrated with Databricks. Data Engineering Concepts: Advanced understanding of ETL, data pipelines, and distributed computing. Monitoring & Automation: Experience with monitoring tools and scripting for automation. Problem-Solving: Ability to handle complex technical challenges and root cause analysis. Preferred Qualifications Experience with CI/CD pipelines for Databricks deployments. Familiarity with data governance frameworks and compliance standards. ITIL or similar certification for support processes. Exposure to MLflow and advanced analytics workflows.




15 years full time education