Databricks Architect

Year    GJ, IN, India

Job Description

JOB DESCRIPTION:

Key Skills:

SQL, ETL Tools, Reporting Tools

Key Requirements:

The day-to-day development activities will need knowledge of the below concepts.

? Expert-level knowledge in RDBMS (SQL Server) with clear understanding of

SQL query writing, object creation and management and performance and

optimisation of DB/DWH operations.

? Good understanding of Transactional and Dimensional Data Modelling, Star

Schema, Facts/Dimensions, Relationships

? Good understanding of ETL concepts and exposure to tools such as Azure

Data Factory, Azure Databricks, Airflow.

? In-depth expertise in Azure Data Factory and Databricks, including building

scalable data pipelines, orchestrating complex workflows, implementing

dynamic and parameterized pipelines, and optimizing Spark-based data

transformations for large-scale integrations.

? Hands-on experience with Databricks Unity Catalog for centralized data

governance, fine-grained access control, auditing, and managing data assets

securely across multiple workspaces.

? Should have worked on at least 1 development lifecycle of one of the below:

? End-to-end ETL project (Involving above mentioned ETL tools)

? Ability to write and review test cases, test code and validate code.

? Good understanding of SDLC practices like source control, version

management, usage of Azure Devops and CI/CD practices.

Project context:

? Should have the skill to fully understand the context and use-case of a project

and have a personal vision for it - Play the role of interfacing with customer

directly on a daily basis.

? Should be able to converse with functional users and convert requirements

into tangible processes/models and documentation in available templates.

? Should be able to provide consultative options to customer on best way to

execute projects

? Should have a good understanding of project dynamics - scoping, setting

estimates, setting timelines, working around timelines in case of exceptions,

etc.

Preferred skills:

? Knowledge of Python is a bonus

? Knowledge of SSIS is a bonus

? Knowledge of Azure Devops, Source Control/Repos is good to have.

Job Types: Contractual / Temporary, Freelance
Contract length: 3 months

Work Location: In person

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD4175767
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    GJ, IN, India
  • Education
    Not mentioned
  • Experience
    Year