Job Description

Key Responsibilities


Oversee day to day operations of the human evaluation team.


Lead calibration sessions ensure consistent application of rubrics.


Review flagged responses and resolve ambiguous or edge case evaluations.


Document any rubric or tooling issues and escalate systemic concerns.


Drive continuous improvement in evaluation quality and team performance.


Support onboarding and training for new evaluators.


Tools & Systems


All tools described above for the evaluator role


Performance tracking dashboards( post 6-8 months into the project)


Client reporting and documentation templates


QA automation scripts or tooling (as needed)


Domain & Skill Requirements


Proficient in geospatial analysis: Strong understanding of spatial data, map structures, and geographic context.


Expertise in GIS tools, especially Google Earth Pro (placemarks, polygons, historical imagery).


Familiarity with remote sensing data: Analysing historical/current satellite images and interpreting vector data (points, lines, polygons).


Experience in data annotation and labelling: Assigning names, descriptions, and styles to geographic features.


Geospatial visualization: Creating and interpreting maps in Google Earth Pro.


Familiarity with Google Maps, spatial boundaries, and map-based QA workflows.


Comfortable with rubric-based assessments and rating scales (e.g., Likert, Pass/Fail).


Excellent observation and analytical skills.


Stakeholder management and reporting expertise.


Experience auditing and maintaining quality standards across a team.


Ability to lead team calibration sessions and ensure evaluation consistency across raters.


Proven experience in mentoring, coaching, and performance management of evaluation teams.


Bonus: Experience with LLM feedback cycles or AI evaluations.

About Virtusa

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth -- one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.



Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.



Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.