Job Description

Project Role :

Application Lead

Project Role Description :

Lead the effort to design, build and configure applications, acting as the primary point of contact.

Must have skills :

Data Engineering

Good to have skills :

Cloud Infrastructure

Minimum

7.5

year(s) of experience is required

Educational Qualification :

15 years full time education



Summary: We are seeking a StreamSets SME with deep expertise in IBM StreamSets and working knowledge of cloud infrastructure to support ongoing client engagements. The ideal candidate should have a strong data engineering background with hands-on experience in metadata handling, pipeline management, and discovery dashboard interpretation. As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that project goals are met, facilitating discussions to address challenges, and guiding your team through the development process. You will also engage in strategic planning to align application development with organizational objectives, ensuring that all stakeholders are informed and involved in key decisions throughout the project lifecycle. Key Responsibilities: o Lead and manage the configuration, monitoring, and optimization of StreamSets pipelines. o Work closely with client teams and internal stakeholders to interpret metadata extracts and validate pipeline inputs from StreamSets and Pulse Discovery Dashboards. o Evaluate metadata samples provided by the client and identify gaps or additional requirements for full extraction. o Coordinate with SMEs and client contacts to validate technical inputs and assessments. o Support the preparation, analysis, and optimization of full metadata extracts for ongoing project phases. o Collaborate with cloud infrastructure teams to ensure seamless deployment and monitoring of StreamSets on cloud platforms. o Provide SME-level inputs and guidance during design sessions, catch-ups, and technical reviews. o Ensure timely support during critical assessments and project milestones. Roles & Responsibilities: - Expected to be an SME. - Collaborate and manage the team to perform. - Responsible for team decisions. - Engage with multiple teams and contribute on key decisions. - Provide solutions to problems for their immediate team and across multiple teams. - Facilitate knowledge sharing and mentoring within the team to enhance overall performance. - Monitor project progress and implement necessary adjustments to meet deadlines and quality standards. Preferred Qualifications: o Proven experience in StreamSets (IBM preferred) pipeline development and administration. o Familiarity with Discovery Dashboard and metadata structures. o Exposure to cloud platforms such as AWS, including infrastructure setup and integration with data pipelines. o Strong communication skills for client interaction and stakeholder engagement. o Ability to work independently in a fast-paced, client-facing environment. Professional & Technical Skills: - Must To Have Skills: Proficiency SME in IBM StreamSets - Good To Have Skills: Experience with Cloud Infrastructure. Proficiency in Data Engineering. - Strong understanding of data modeling and ETL processes. - Experience with big data technologies such as Hadoop or Spark. - Familiarity with database management systems, including SQL and NoSQL databases. Additional Information: - The candidate should have minimum 7.5 years of experience in Data Engineering. - This position is based at our Bengaluru office. - A 15 years full time education is required.




15 years full time education