Job Description

Project Role :

Application Lead

Project Role Description :

Lead the effort to design, build and configure applications, acting as the primary point of contact.

Must have skills :

Microsoft Azure Analytics Services

Good to have skills :

NA

Minimum

7.5

year(s) of experience is required

Educational Qualification :

15 years full time education



Summary: As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that application requirements are met, overseeing the development process, and providing guidance to team members. You will also engage in problem-solving activities, ensuring that the applications are optimized for performance and usability while maintaining effective communication with stakeholders to align on project goals and timelines. Roles & Responsibilities: o Expected to be an SME. o Develop and Optimize Data Pipelines using PySpark and SQL in Databricks to handle large-scale data transformations and batch/streaming workloads. o Design and Implement ETL Processes by leveraging Databricks notebooks, Delta Lake, and PySpark -based custom scripts for data ingestion and curation. o Collaborate with Data Analysts and Stakeholders to understand data needs and deliver accurate, performant, and reusable data solutions. o Maintain and Monitor Job Performance, identify bottlenecks and apply tuning techniques to improve pipeline efficiency on the Databricks platform. ________________________________________ Professional & Technical Skills : o Experience in application development and deployment in Azure environments. o Proficient in building scalable, distributed data pipelines using PySpark and Databricks with a deep understanding DataFrame APIs, and Spark optimization techniques. o Experience on PySpark for scripting, data manipulation, and integrating third-party libraries within data engineering workflows. o Expertise in SQL for data extraction, transformation, complex joins, and performance tuning across relational and distributed data stores. o Experience in working with Azure Delta Lake, versioned data, schema evolution, and managing CDC (Change Data Capture) scenarios in a cloud-based environment. o Good understanding of Data warehousing/ ETL concepts. o Good to have: experience in Scala. o Familiarity with data integration and ETL processes. o Best practices in CI/CD, code versioning (Git), and DevOps for data projects. Additional Information: o - The candidate should have minimum 8 years of experience in Microsoft Azure Analytics Services. o - This position is based at our Bengaluru office. o - A 15 years full time education is required.




15 years full time education