Job Description

Test Strategy Planning


Define QA strategy for AI/ML services, microservices, and APIs across environments.


Translate requirements and ML acceptance criteria into test plans and traceable test cases.


Establish performance baselines and SLOs for models and services.


Test Design Execution


Unit testing (PyTest/unittest) for data transformations, feature engineering utilities, and model wrappers.


Integration testing for pipelines (data ingestion training validation deployment) and microservices.


API testing (REST/GraphQL) for inference endpoints, auth flows, and rate limits.


Performance load testing to validate latency, throughput, and p95/p99 targets.


Build automated test suites in Python and integrate them into CI/CD.


AI/ML Quality Validation


Validate model outputs against ground truth, statistical thresholds, and confidence scoring rules.


Test for model regression across versions; maintain golden datasets and baseline metrics (accuracy, F1, ROC-AUC, precision/recall, calibration).


Perform data quality checks (schema, drift, leakage) and monitor post-deployment drift.


Verify explainability artifacts SHAP/feature importance) where applicable.


Observability Defect Management


Instrument tests with logs/metrics/traces; create dashboards for quality gates.


Triage defects, conduct root cause analysis, and drive closure.


Required Skills Qualifications


Python proficiency for test automation and data validation (PyTest/unittest, requests/httpx).




.

About Virtusa

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth -- one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.


Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.


Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.