Job Description

Job Title: Attacama- Migration DE lead
Location: Bangalore
Experience: 8-11 years
:
- 9 to 12 years of experience
- Must-have skills:
- Databricks
- Python
- SQL
- Spark
- Jenkins
- Airflow
- Bitbucket
- Nice-to-have skills:
- Advanced Python
- ETL tool experience (Azure Data Factory, Informatica, etc.)
- 5+ years in developing data lakes and data marts on Databricks
- Develop and maintain ETL processes using Databricks notebooks
- Implement and optimize data pipelines for transformation and integration
- AWS Data Lake services (Glue, IAM), Spark, Python, SQL expertise
- Write complex SQL queries for data retrieval and analysis
- Perform database performance tuning and optimization
- Strong understanding of data warehouses and data marts
- Experience with system architectures and design patterns
- Strong collaboration, communication, and problem-solving skills
- Design Databricks data solutions (Delta Lake, data warehouse, data marts)
- Apply best practices in data modeling and ETL pipelines (streaming and batch)
- Conduct stakeholder engagement, proof of concepts, and demos
- Code review and Bitbucket merge management