Job Description

About Albertsons Companies India
Albertsons Companies is a leading food and drug retailer in the United States. As of February 22, 2025, the Company operated 2,270 retail stores with 1,728 in-store pharmacies, 405 associated fuel centers, 22 dedicated distribution centers and 19 manufacturing facilities. Albertsons Companies India is a vital extension of the Albertsons Companies Inc. workforce and important to the next phase in the company & technology journey to support millions of customers & lives every day.

Position Title: Staff Engineer AIOps
:
Roles & responsibilities:

• Design, implement, and manage ML pipelines on Databricks, leveraging Unity Catalog for data governance and managing ML workflows using Genie and Mosaic Gateway.
• Automate CI/CD processes for ML workflows, ensuring reproducible and reliable experiments.
• Deploy and monitor model serving architectures across multi-cloud environmentsspecifically running Databricks on GCP while supporting model invocations on OpenAIs cloud.
• Integrate LangChain and other framework connectors to enable agent-based architectures that call external APIs (e.g., OpenAI APIs for generative models) within a Databricks context.
• Implement end-to-end model tracking and versioning using MLflow, ensuring clear lineage and reproducibility.
• Develop and maintain shared tooling and workflows to support data scientists, focusing on robust infrastructure and streamlined deployment across GCP and Azure.
• Design and maintain mechanisms for secure and efficient data access and movement across cloud boundaries, using Databricks cross-cloud features.
• Configure and monitor performance metrics and logging across environments, ensuring observability and compliance for training and serving workloads.
• Partner with compliance and security teams to ensure ethical and secure model deployments while managing secrets and keys for API access.
• Collaborate with other engineering teams to create best practices around unit catalog, governance, and cross-cloud deployment.

Experience:
Required Qualifications:

• Bachelors/Masters degree in Computer Science, Engineering, or a related field.
• 7+ years of professional experience in MLOps/ML engineering, including large-scale deployment on Databricks.
• Proven expertise with Databricks components like Unity Catalog, Genie, Mosaic Gateway, and MLflow.
• Experience orchestrating multi-cloud architectures, particularly using Databricks on GCP for development and training, with inference performed via external services such as OpenAIs APIs.
• Strong proficiency in Python and integration of external libraries such as LangChain and OpenAIs API within Databricks notebook workflows.
• Experience designing and automating CI/CD pipelines for ML workloads with tools like Jenkins, GitHub Actions, or Databricks Workflows.
• Strong understanding of inter-cloud data movement, secure API access, and best practices for compliance and governance.
• Hands-on experience with container orchestration (Docker, Kubernetes) and infrastructure-as-code tools (Terraform).
• Familiarity with model monitoring, observability tools, and performance profiling on GPU and CPU resources.

Preferred Qualifications:

• Experience deploying ML applications for pricing or optimization algorithms.
• Contributions to open-source projects related to Databricks, MLflow, or MLOps frameworks.
• Understanding of AI safety, compliance, and governance frameworks.
• Experience mentoring junior engineers and establishing MLOps best practices across an organization.

Must Have Skills:

• Databricks expertise, Multi-Cloud Architecture & Deployment, CI/CD for Machine Learning, Python Programming & Framework Integration, Model Monitoring, Compliance

Skills Required