Job Description

Job Summary:

We are seeking a forward-thinking Databricks Architect to lead the adoption and integration of Databricks as our enterprise AI/ML platform. This individual will establish the technical architecture, drive innovation, and ensure seamless collaboration with internal infrastructure teams to align with organizational standards. The ideal candidate will empower our data science community with self-service model development and deployment capabilities, while ensuring global deployment of AI models in compliance with data sovereignty regulations. As a key consultant and influencer, you will be expected to bring contemporary best practices, foster team growth, and continuously improve our data and AI capabilities.

Key Responsibilities

Architecture Leadership

: Design, implement, and optimize scalable, secure, and compliant Databricks-based AI/ML architectures that support advanced analytics, data engineering, and machine learning workloads.

Collaboration & Compliance

: Partner with internal infrastructure, security, and compliance teams to ensure all solutions meet organizational standards and regulatory requirements, including data sovereignty and global deployment needs.

Data Integration

: Architect and implement robust integrations with diverse internal and external data sources, enabling efficient data ingestion, transformation, and access for analytics and AI/ML workflows.

Self-Service Enablement

: Develop frameworks, tools, and documentation to enable data scientists and analysts to develop, train, and deploy models independently, fostering a culture of self-service and innovation.

ModelOps Strategy

: Develop and implement a comprehensive ModelOps strategy to manage model lifecycle, governance, versioning, and deployment at scale. Ensure seamless integration with existing DevOps and DataOps practices623.

Performance & Governance

: Optimize Databricks workflows, clusters, and jobs for performance, cost-efficiency, and reliability. Establish and enforce data governance, security, and lineage practices.

Consulting & Innovation

: Serve as a trusted advisor to stakeholders, providing thought leadership, best practices, and innovative solutions to complex data and AI challenges. Lead discovery workshops, proof-of-concept initiatives, and technology evaluations.

Team Building & Mentorship

: Mentor and upskill team members, promote knowledge sharing, and build high-performing, cross-functional teams focused on excellence in data and AI.

Global Deployment

: Architect and support worldwide deployment of AI models, ensuring compliance with regional data sovereignty laws and organizational policies.

Required Skills & Experience

Proven Experience: 5+ years architecting and implementing enterprise-grade data and AI/ML solutions, preferably with Databricks, Apache Spark, and cloud platforms (AWS, Azure, GCP). Technical Expertise: Deep understanding of data lakehouse architectures, ETL/ELT pipelines, data governance, and security best practices. ModelOps Strategy: Demonstrated experience in developing and implementing a ModelOps strategy, including model lifecycle management, versioning, governance, and deployment automation. Consulting & Communication: Strong consulting, stakeholder management, and communication skills, with a track record of influencing senior leadership and driving technology adoption. Innovation & Initiative: Demonstrated ability to drive innovation, introduce contemporary practices, and lead technology transformations. Education: Bachelor's or Master's degree in Computer Science, Engineering, or a related field, or equivalent experience.

Desirable Attributes

Thought Leadership: Ability to define and communicate architecture vision, roadmaps, and best practices to both technical and non-technical audiences. Continuous Improvement: Passion for learning, sharing knowledge, and staying ahead of industry trends in data and AI. Customer Focus: Commitment to delivering measurable business value and exceptional user experiences.

Business Hours Support:

CST Hours (5.30pm - 2.30am IST)

Qualifications

Bachelor's Degree

Range of Year Experience-Min Year

7

Range of Year Experience-Max Year

9