Job Description

Project Role :

Application Lead

Project Role Description :

Lead the effort to design, build and configure applications, acting as the primary point of contact.

Must have skills :

Microsoft Azure Analytics Services

Good to have skills :

Scala, Databricks Unified Data Analytics Platform, PySpark

Minimum

5

year(s) of experience is required

Educational Qualification :

15 years full time education



Summary: As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with various teams to understand their needs, developing innovative solutions, and ensuring that applications are optimized for performance and usability. You will engage in problem-solving activities, participate in team meetings, and contribute to the overall success of projects by delivering high-quality applications that align with business objectives. Roles & Responsibilities: o Expected to be an SME. o Develop and Optimize Data Pipelines using Scala and SQL in Databricks to handle large-scale data transformations and batch/streaming workloads. o Design and Implement ETL Processes by leveraging Databricks notebooks, Delta Lake, and scala-based custom scripts for data ingestion and curation. o Collaborate with Data Analysts and Stakeholders to understand data needs and deliver accurate, performant, and reusable data solutions. o Maintain and Monitor Job Performance, identify bottlenecks and apply tuning techniques to improve pipeline efficiency on the Databricks platform. ________________________________________ Professional & Technical Skills : o Experience in application development and deployment in Azure environments. o Proficient in building scalable, distributed data pipelines using Scala and Databricks with a deep understanding DataFrame APIs, and Spark optimization techniques. o Experience on Scala language for scripting, data manipulation, and integrating third-party libraries within data engineering workflows. o Expertise in SQL for data extraction, transformation, complex joins, and performance tuning across relational and distributed data stores. o Experience in working with Azure Delta Lake, versioned data, schema evolution, and managing CDC (Change Data Capture) scenarios in a cloud-based environment. o Good to have experience in PySpark o Familiarity with data integration and ETL processes. o Best practices in CI/CD, code versioning (Git), and DevOps for data projects. Additional Information: - The candidate should have minimum 5 years of experience in Microsoft Azure Analytics Services. - This position is based at our Bengaluru office. - A 15 years full time education is required.




15 years full time education