Job Description

Job Summary for GenAI Ops Specialist
Location: Bengaluru
Experience Level: 2+ Years
---
Key Responsibilities
- Workflow Integration & Deployment:
- Design, implement, and manage workflows for integrating and deploying GenAI applications on Azure, Amazon, or Snowflake platforms.
- Analyze systems and applications, provide recommendations, and execute enhancements.
- Platform Engineering:
- Collaborate with teams to integrate AI solutions into existing workflows and systems.
- Configure and manage infrastructure for scalability, reliability, and availability.
- Lifecycle Management:
- Develop and implement best practices for lifecycle management of large language AI models (versioning, testing, validation).
- Troubleshooting & Optimization:
- Troubleshoot and resolve performance and deployment issues for large language AI models.
- Continuous Learning:
- Stay updated with advancements in large language AI models and ops technologies.
- Infrastructure Design:
- Design and suggest best practices for infrastructures that support model fine-tuning and troubleshooting.
- Documentation:
- Create and maintain comprehensive documentation for AI/ML/LLM processes and systems.
- Security Integration:
- Integrate security best practices throughout the development lifecycle to safeguard platforms.
- Monitoring & Logging:
- Implement robust monitoring, logging, and LLMOps best practices for proactive issue resolution.
- Responsible AI Guardrails:
- Ensure governance of Responsible AI metrics via proper system infrastructure and monitoring.
- Data Privacy & Governance:
- Ensure user data privacy and compliance with data governance regulations.
---
Requirements
- Education:
- Bachelor's or Master's in Statistics, Economics, Operations Research, Data Science, Computer Science, or related field.
- Experience:
- 2+ years in GenAI applications management, model monitoring/validation, I/O guardrails, and FinOps monitoring.
- Technical Skills:
- Understanding of OpenAI, Llama, Claude, Arctic, Mistral LLMs and their deployment (cloud/on-premises, API integration).
- Experience with AI/ML frameworks and tools (e.g., Langchain, Semantic Kernel, TensorFlow, PyTorch).
- Experience with cloud platforms (AWS, Azure, Snowflake) and containerization (Docker, Kubernetes).
- Advanced and secure coding in Python, PySpark, or TypeScript.
- Exposure to Vector/Graph/SQL databases, workflow platforms, and non-deterministic automated testing.
- Soft Skills:
- Strong cross-cultural communication and negotiation skills.
- Ability to manage collaboration across time zones.
- Excellent problem-solving, attention to detail, communication, and teamwork skills.
- Additional Knowledge:
- Working knowledge of LibreChat is a plus.
---
Preferred Qualifications
- 2+ years in AI operations, DevOps, or related field.
- Experience with MLOps and CI/CD pipelines.
- Knowledge of data engineering and pipeline management.
- Certification in AI/ML or cloud technologies.

Skills Required