Job Description

We are hiring for AI Tester

Experience: 3 to 5 Years

Job Type: Full-Time

Location: Noida (Hybrid Working Model)

Roles & Responsibilities:

1. AI & LLM Evaluation:

? Design and execute evaluation strategies for Large Language Models (LLMs), focusing on metrics like Accuracy, Hallucination, Tone, and Relevance.

? Identify and document AI-specific defects.

2. Automation & Scripting:

? Develop and maintain automated test scripts using Python or JavaScript/TypeScript to validateAI pipelines.

? Utilize tools like Playwright or Selenium for UI testing of AI-integrated web applications API & Integration Testing:

? Perform robust API testing using Postman or programmatic methods (Rest Assured/Python Requests) to validate AI model endpoints.

? Ensure efficient token usage, latency standards, and proper error handling in API responses.

4. CI/CD & DevOps Integration:

? Integrate automated AI evaluation suites into Jenkins pipelines for continuous testing.

? Analyze logs and metrics using tools like CloudWatch or Datadog to identify performance bottlenecks

Skills:

? AI/LLM Exposure: Practical understanding of Generative AI concepts, Prompt Engineering, and

LLM Evaluation techniques (RAG, Fine-tuning concepts).

? Programming: Hands-on experience with Python (highly preferred for AI tasks) or

JavaScript/TypeScript.

? API Testing: Proficient in Postman (creating collections, assertions) and testing RESTful APIs.

? Core QA Tools: Experience with Git for version control, Jira for defect tracking, and Jenkins for CI/CD.

? Data Handling: Comfortable working with JSON/JSONL formats and handling data for test scenarios.

Desired Skills:

? Familiarity with AI Evaluation frameworks like DeepEval, Ragas.

? Experience with cloud platforms (AWS: EC2, Lambda, S3) for setting up test environments.

? Knowledge of Docker basics for containerized testing.

? Basic understanding of Performance Testing tools (JMeter/k6).

interested candidates share cv on hr@resolink.in

Job Type: Full-time

Pay: ?500,000.00 - ?2,000,000.00 per year

Benefits:

Flexible schedule Health insurance
Education:

Bachelor's (Preferred)
Experience:

AI Tester: 3 years (Required) AWS: 1 year (Required) JavaScript: 1 year (Required) Python: 1 year (Required) APIs: 1 year (Required) CI/CD: 1 year (Required)
Work Location: In person