Job Description

Our customer's product is an AI-powered platform that helps businesses make better decisions and work more efficiently. It uses advanced analytics and machine learning to analyze large amounts of data and provide useful insights and predictions. The platform is widely used in various industries, including healthcare, to optimize processes, improve customer experiences, and support innovation. It integrates easily with existing systems, making it easier for teams to make quick, data-driven decisions to deliver cutting-edge solutions.

Requirements

A master or bachelor's degree in computer science or related field from a top university; 4+ years; hands-on experience in Machine Learning (ML) with production LLM systems; Good fundamentals of machine learning, deep learning and fine-tuning models (LLM) including: Understanding of transformer architectures Prompt engineering expertise Embeddings and vector search; Experienced in backend API design with FastAPI, async patterns, rate limiting; Experience with vector DB including: Pinecone, Weaviate, or Chroma Embedding storage and similarity search Hybrid search implementations; Strong programming expertise in Python is must including: Async programming (asyncio, async/await) Type hints and Pydantic SOLID principles and design patterns. PySpark/Scala is optional; Experience in ML Ops to measure and track model performance including: MLFlow for model tracking Langfuse for LLM observability (strongly preferred) Model versioning and A/B testing; Experience in working with NLP & computer vision including: Text extraction and preprocessing Document understanding (layout, tables) OCR processing o GPT-4 Vision integration; Experience in implementing: Feature engineering pipelines Real-time inferencing systems Batch prediction pipelines Model serving with FastAPI; Experience in ML frameworks including: HuggingFace (transformers, datasets) - mandatory o Keras/TensorFlow/PyTorch

- LangChain - strongly preferred

LlamaIndex for RAG.

Nice to have skills:

Understanding of DevOps, CI / CD including: Docker containerization, Azure DevOps pipelines or GitHub Actions, Kubernetes (nice to have) Data security including: Multi-tenant data isolation, Secure key management (Azure Key Vault), Audit trail implementation Experience in designing on cloud platform including: Azure (strongly preferred): Azure OpenAI, Blob Storage, Key Vault, Container Registry, AWS or GCP Experience in data engineering in Big Data systems including: Large-scale data processing, ETL/ELT pipelines

Responsibilities:

Developing and implementing scalable backend systems, APIs, and microservices using FastAPI Install best practices for software development, ensure designs meet requirements, and deliver high-quality work on schedule Writing application backend codes using Python, SQL, async/await patterns, using strong object-oriented principles, asynchronous programming Implementing dependency injection patterns using dependency injector library Integrating Azure OpenAI (GPT-4, GPT-4 Vision) with proper retry logic and error handling Building LLM observability using Langfuse for tracking prompts, tokens, costs, and latency Developing prompt management systems with versioning and fallback mechanisms Implementing Celery workflows for async task processing and complex pipelines Building multi-tenant architectures with client data isolation Developing layered architecture (Service, Foundation, Orchestration, DAL patterns) Implementing cost optimization for LLM usage (prompt caching, batch processing, token optimization) Troubleshooting backend application codes with structured logging and distributed tracing Developing and implementing back-end architecture following SOLID principles and design patterns Integrating third-party APIs (Veeva Vault, Adobe PDF Services, OCR services) Documenting application changes and developing updates using OpenAPI/Swagger

Benefits

Awesome projects with an impact Udemy courses of your choice Team-buildings, events, marathons & charity activities to connect and recharge Workshops, trainings, expert knowledge-sharing that keep you growing Clear career path Absence days for work-life balance * Flexible hours & work setup - work from anywhere and organize your day your way