Job Description

Job Title: Attacaam Migration- Sr DE
Location: Bangalore
Experience: 5-11 years
:
- Must have:
- Databricks
- Python
- SQL
- Spark
- Jenkins
- Airflow
- Bitbucket
- Nice to have:
- Python
- Understanding of ETL tools (Azure Data Factory, Informatica, etc.)
Roles & Responsibilities:
- 3+ years of experience in developing data lakes and data marts on Databricks
- Develop and maintain ETL processes using Databricks notebooks
- Optimize data pipelines for data transformation and integration
- Proven skills in AWS Data Lake services (AWS Glue, IAM), Spark, Python, and SQL
- Write complex SQL queries for data retrieval and analysis
- Perform database performance tuning and optimization
- Develop data warehouses, data marts, and follow design patterns
- Strong collaboration and communication skills
- Excellent problem-solving and analytical thinking
- Ability to work in fast-paced environments with tight schedules
- Present complex ideas clearly to peers and management
Key Responsibilities:
- Understand client requirements and deliver data engineering solutions
- Develop solutions using Databricks Delta Lake, streaming, AWS, ETL, and data modeling
- Design, develop, and manage data pipelines, data quality, ETL, and documentation