Job Description

Who we are

At 3CLogic, we are big believers that our people are the most important asset we have and that winning is a team sport.


3CLogic is a fast growing, venture-backed, SaaS "startup" with our headquarters in Rockville, Maryland. Some of our roles are local to the main office and others are remote, but we have talented individuals working from everywhere as we continue to build our safety-first hybrid remote and in-person culture, and we care more about what you might bring to our team and where you want to go in your career than where you are located.


We realize you've very likely read tons of job descriptions that look a whole lot like this one. But what we can't put in words is why we would love to hear from you. You've heard the term "living in the gray area," right? Well, a great fit for 3CLogic is someone who wants to live in technicolor. There's never a gray moment here! We are all entrepreneurs at heart, who believe that when you bring your full self to work, the possibilities are infinite.


If your interest is piqued, let's chat! We'd love to show you, rather than tell you, what makes us special, and find a place in our organization where you can thrive.

What we do

Ever call a company or organization for help and wait on hold forever only to get to a person who can't help you? Well we are the ones that fix that!


3CLogic is a global provider of voice AI, Contact Center, and SMS solutions to enterprise and Global 2000 organizations worldwide - think 7-Eleven, Swiss Railways, Regeneron, Northeastern University, Hyatt Hotels, or LabCorp. Organizations leverage our technology and services every day to increase the quality of service to their customers/employees, improve the performance of the agents serving them, lower their operational costs, and optimize how easy it is to analyze and manage it all. We make calling for help a positive experience and efficient channel for everyone!


A strategic ServiceNow and SAP partner, 3CLogic is paving the way for organizations to digitally transform customer and employee experiences, deliver conversational voice self-service offerings, enable remote work at scale, and leverage AI to drive better business outcomes.

General Job Details:

Position Name:

AI Tester

Experience:

3 to 5 Years

Job Type:

Full-Time

Location

: Sector-142, Noida (Hybrid Working Model)

Position Summary:

We are looking for an innovative

AI Quality Engineer

to join our team. In this role, you will go beyond traditional software testing to ensure the accuracy, safety, and reliability of our Generative AI and LLM-based applications. You will combine your solid foundation in QA automation (Python/TS/Playwright) and API testing with emerging skills in

Prompt Engineering

and

LLM Evaluation

.


If you are a QA professional who is excited about how AI works, loves to "break" models, and wants to be at the forefront of AI testing, this role is for you.

Key Responsibilities:

1. AI & LLM Evaluation:

Design and execute evaluation strategies for Large Language Models (LLMs), focusing on metrics like

Accuracy, Hallucination, Tone, and Relevance

. Perform

Prompt Engineering

and testing to optimize model outputs and ensure alignment with business requirements.. Identify and document AI-specific defects.

2. Automation & Scripting:

Develop and maintain automated test scripts using

Python

or

JavaScript/TypeScript

to validate AI pipelines. Utilize tools like

Playwright

or

Selenium

for UI testing of AI-integrated web applications.

3. API & Integration Testing:

Perform robust API testing using

Postman

or programmatic methods (Rest Assured/Python Requests) to validate AI model endpoints. Ensure efficient token usage, latency standards, and proper error handling in API responses.

4. CI/CD & DevOps Integration:

Integrate automated AI evaluation suites into

Jenkins

pipelines for continuous testing. Analyze logs and metrics using tools like

CloudWatch

or Datadog to identify performance bottlenecks

Skills:

AI/LLM Exposure:

Practical understanding of Generative AI concepts,

Prompt Engineering

, and

LLM Evaluation

techniques (RAG, Fine-tuning concepts).

Programming:

Hands-on experience with

Python

(highly preferred for AI tasks) or JavaScript/TypeScript.

API Testing:

Proficient in

Postman

(creating collections, assertions) and testing RESTful APIs.

Core QA Tools:

Experience with

Git

for version control,

Jira

for defect tracking, and

Jenkins

for CI/CD.

Data Handling:

Comfortable working with

JSON/JSONL

formats and handling data for test scenarios.

Soft Skills

: Strong analytical and problem-solving abilities, effective communication, an ownership mindset, and a willingness to learn and adapt.

Qualifications:

Bachelor's degree in Computer Science, Information Technology, or a related field with 70% or equivalent.

Desired Skills:

Familiarity with AI Evaluation frameworks like

DeepEval

,

Ragas

. Experience with cloud platforms (

AWS

: EC2, Lambda, S3) for setting up test environments. Knowledge of

Docker

basics for containerized testing. Basic understanding of Performance Testing tools (JMeter/k6).

Benefits:

Flexible Working Hours. Hybrid Working Style. Personal Accidental Insurance. Health Insurance to Self, Spouse and two kids. 5 days working week.



uAgXDndmS8