Job Description

Freelancing Opportunity

Job Title:

Data Observability Engineer

Experience:

5+ years

About the Role

Seeking a

Data Observability Engineer

to design, build, and maintain systems ensuring

data reliability, quality, traceability, and visibility

across the organization. The role involves developing observability frameworks, managing

Azure Data Lake Storage (ADLS)

, and implementing

metadata management and governance frameworks

.

Key Responsibilities

Build data observability frameworks to monitor

freshness, accuracy, lineage, and anomalies

. Automate

alerts, logging, and monitoring

for data pipelines using tools like

Monte Carlo, Databand, Great Expectations, OpenLineage, Airflow logging

. Implement

centralized log aggregation

(Azure Monitor, Log Analytics, ELK) and ensure full data traceability. Manage and optimize

ADLS Gen2

--architecture, access control, lifecycle, and governance compliance. Design metadata frameworks integrating with

Azure Purview, Collibra, Amundsen

, enabling data discoverability and compliance.

Required Skills

5+ years in

Data Engineering / Data Platform

roles. Strong with

Azure Data Lake Storage

and the

Azure data ecosystem

. Proficient in

Python, SQL, Airflow, Databricks, Synapse

. Experience with

data observability and monitoring tools

(Datadog, Monte Carlo, Great Expectations, OpenLineage). Knowledge of

data governance, lineage, and compliance

(GDPR, HIPAA).

Preferred Skills

Experience building

custom observability or metadata tools

. Familiarity with

modern data stack

(dbt, Snowflake, Kafka, Delta Lake). Understanding of

scalable data architectures

and

CI/CD, IaC

(Terraform, ARM templates).
Job Types: Part-time, Freelance
Contract length: 12 months

Pay: ₹30,000.00 - ₹40,000.00 per month

Benefits:

Work from home
Experience:

total work: 7 years (Required)
Shift availability:

Night Shift (Required) Overnight Shift (Required)
Work Location: Remote