Databricks Architect

Year    TN, IN, India

Job Description

1. As a Databricks Architect, you will:



Design, implement, and optimize scalable end-to-end data architectures using Databricks on cloud platforms (Azure, AWS, or GCP). Lead the development of both batch and real-time data processing pipelines using Spark, PySpark, and Delta Lake. Define and enforce data security and governance best practices across all stages of data handling. Collaborate closely with business stakeholders, data engineers, and developers to deliver integrated enterprise-grade data solutions. Monitor Databricks infrastructure performance, manage cluster resources, and execute cost-optimization strategies. Develop and maintain architectural documentation and roadmaps while continuously improving system efficiency. Stay up to date with emerging technologies, trends, and best practices in the cloud data ecosystem.

2. What You Bring to the Table:



7-8 years of overall experience in data engineering, data architecture, or similar roles. Minimum of 3 years hands-on experience with Databricks and Apache Spark (Spark SQL, PySpark). Strong proficiency in Python and SQL for data processing and automation. Solid experience implementing data solutions on public cloud platforms (Azure preferred; AWS/GCP a plus). Hands-on knowledge of Delta Lake, Synapse Analytics, Data Lakes, and cloud-native data services. Experience in designing data models, schemas, and robust ETL/ELT pipelines. Familiarity with BI/Visualization tools such as Power BI or Tableau. Strong understanding of data security, privacy, and compliance in cloud environments. Bachelor's or Master's degree in Computer Science, Information Technology, or a related field. (Preferred) Databricks certification (e.g., Databricks Certified Data Engineer).

3. You Should Possess the Ability to:



Architect and lead scalable data solutions across complex enterprise environments. Optimize performance of data jobs and manage resources within Databricks efficiently. Translate business requirements into actionable technical designs. Mentor team members and foster a culture of innovation and best practices. Communicate technical concepts effectively to both technical and non-technical stakeholders. Work independently in fast-paced, agile environments while managing multiple priorities. Own the architectural vision and align it with business and technical goals.

4. What We Bring to the Table:



A dynamic and forward-thinking environment working with leading cloud and data technologies. Opportunities to lead innovative projects that solve real-world business problems. A collaborative, supportive team culture focused on continuous learning and growth. Exposure to diverse industries and enterprise-level data architecture challenges. * Agile work environment that encourages autonomy and creativity.

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD4011071
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    TN, IN, India
  • Education
    Not mentioned
  • Experience
    Year