At VTEST, we believe "Testing is not just a job, it's a craft." If you are passionate about ensuring quality and want to be part of a growing team, we would love to hear from you.
About VTEST
Founded in 2015 in Pune, VTEST (
www.vtestcorp.com) is a pure-play Software Testing services firm based out of Pune, India registered in Atlanta, US and Melbourne, Australia and recognized with
Great Place to Work
&
NASSCOM
certified. VTEST works with clients across the globe and employs Manual and Automation Testers to implement best testing practices for all types of testing. Our testers work Remote or from VTEST and client offices across India and international locations.
Position:
SDET
Experience:
1 to 4 Years
Location:
Work From Office, HSR Layout, Bangalore
Employment Type:
Full-time
Joining Availability:
Immediate
About the Role
We are seeking a
forward-thinking Agentic QA Engineer
with a passion for quality, automation, and AI-assisted testing. In this role, you'll leverage
agentic AI tools
, intelligent automation frameworks, and traditional QA methods to ensure end-to-end product quality, faster release cycles, and smarter validation processes.
You'll collaborate closely with developers, data scientists, and automation engineers to build
next-gen quality pipelines
that integrate
AI-driven testing, self-healing automation, and intelligent defect prediction.
Key Responsibilities
Test and validate AI agents and LLM workflows to ensure correctness and stability.
Design and execute test cases to evaluate agentic behavior, prompt responses, and task accuracy.
Use DeepEval to create and automate evaluation frameworks for LLM and agent testing.
Identify, document, and track bugs, performance issues, or logic errors.
Collaborate with developers, prompt engineers, and data scientists to improve system quality.
Develop and maintain test documentation including plans, cases, and reports.
Ensure AI agents handle contexts, prompts, and tasks as intended in real-world scenarios.
Contribute to building automated QA pipelines for continuous testing and monitoring of agents.
Required Skills & Qualifications
1-4 years of experience in QA, software testing, or AI testing.
Strong understanding of Generative AI, LLM agents, and autonomous workflows.
Experience with manual testing and familiarity with automation testing frameworks.
Hands-on experience or working knowledge of DeepEval for evaluating LLM outputs.
Good analytical, debugging, and documentation skills.
Familiarity with Java or Python for writing scripts or automation utilities.
Excellent collaboration and communication abilities.
Good To Have
Experience with LangChain, CrewAI, AutoGen, or similar agentic frameworks.
Understanding of AI evaluation metrics (accuracy, coherence, relevance, hallucination detection).
Exposure to CI/CD, test automation, or model monitoring tools.
Why Join Us:
Permanent Role
with long-term career growth opportunities
Exposure to
global clients
and projects
Collaborative and performance-driven culture
Website
www.vtestcorp.com
LinkedIn
https://www.linkedin.com/company/vtest/
Facebook
https://www.facebook.com/vtestcorp
Instagram
https://www.instagram.com/vtest_software/
Beware of fraud agents! do not pay money to get a job
MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.