Job Description

Technical Program Manager - AI Evaluation & Automation (1 roles)



Role Overview



We are seeking a highly skilled Technical Program Manager (TPM) to lead an AI evaluation and automation program focused on dataset development, model assessment, and toolchain integration for Google's AI products (e.g., Gemini CLI, Code Review Agent). This role will drive governance, stakeholder alignment, and delivery excellence across multi-disciplinary engineering teams.



Key Responsibilities


Own end-to-end program governance, including planning, execution, and reporting of AI evaluation workstreams.

Translate Google's evaluation and labeling guidelines into operational execution plans and success metrics.

Manage cross-functional alignment between AI engineers, raters, and automation teams.

Define KPIs and ensure timely delivery of datasets, evaluation pipelines, and benchmarking reports.

Lead risk, dependency, and quality management across distributed teams.

Present progress, insights, and recommendations to Google stakeholders and leadership.

Ensure compliance with data handling, labeling, and security policies.


Required Skills & Experience


8-12 years of experience in technical program or product management, preferably in AI/ML or data-driven environments.

Deep understanding of machine learning evaluation processes, LLM workflows, and automation tools.

Proven experience managing cross-geography teams and agile delivery models.

Proficiency with Google AI ecosystem tools (Vertex AI, Gemini CLI, BigQuery, Looker).

Excellent communication, stakeholder management, and documentation skills.

Familiarity with Git-based systems (GitHub, GitLab, Bitbucket).


Preferred Qualifications


Experience managing AI evaluation or model benchmarking programs.

Background in software engineering or data science.

PMP or Agile certification preferred.

About Virtusa

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth -- one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.


Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.


Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.