Job Description

Role Summary:


We are seeking an experienced Senior Generative AI Architect to lead the design, development, and deployment of an AI Gateway that connects generative AI applications (developed in Python and C) with enterprise-grade LLM services such as Azure OpenAI and AWS Bedrock. This role is critical to building a robust, scalable infrastructure that enables seamless communication between Gen AI components and LLM endpoints.


The ideal candidate is a hands-on with deep expertise in architecting and productionizing Gen AI applications, and a proven ability to guide engineering teams toward high-quality outcomes.




Key Responsibilities:


Architectural Leadership


Design and document scalable, reliable, and maintainable architectures for Gen AI applications.


Ensure solutions meet production-grade standards and enterprise requirements.


Technical Decision Making


Evaluate trade-offs in technology choices, design patterns, and frameworks.


Align decisions with Gen AI best practices and software engineering principles.


Team Guidance


Mentor and guide architects and engineers.


Foster a collaborative, innovative, and high-performance development environment.


Hands-On Development


Actively contribute to prototyping and implementation using C and Python.


Drive research and development of core AI Gateway components.


Product Development Mindset


Build a responsible and scalable AI Gateway considering:


Cost efficiency


Security and compliance


Upgradeability


Ease of use and integration




Required Qualifications:


Technical Expertise


Extensive experience in API-based projects and full lifecycle deployment of Gen AI/LLM applications.


Strong hands-on proficiency in C and practical experience with Python.


Cloud & DevOps


Expertise in Docker, Kubernetes, and OpenShift for containerization and orchestration.


Working knowledge of:


Azure AI Services: OpenAI, AI Search, Document Intelligence


AWS Services: EKS, SageMaker, Bedrock


Security & Access Management


Familiarity with Okta for secure identity and access management.


LLM & Gen AI Tools


Experience with LangChain, LlamaIndex, and OpenAI SDKs in C.


Monitoring & Troubleshooting


Proven ability to monitor, trace, and debug complex distributed AI systems.




Personal Attributes:


Strong leadership and mentorship capabilities.


Excellent communication skills for both technical and non-technical audiences.


Problem-solving mindset with attention to detail.


Passion for advancing AI technologies in production environments.




Preferred Experience:


Prior leadership in large-scale, production-grade AI initiatives.


Experience in enterprise technology projects involving Gen AI.

About Virtusa

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth -- one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.



Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.



Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.