Senior Data Engineer

Year    IN, India

Job Description

At Meazure Learning

, we aim to empower open-minded, inquisitive, and driven people, and we love how each new addition to the team adds to our culture. Here, you can positively impact the careers of millions of test-takers and reshape the education technology landscape by working toward one vision:

"To provide life-long learners across the globe the freedom to pursue their academic dreams and career aspirations safely, securely, and conveniently."


Our Vision starts with our values--

Hungry, Humble, and Smart.

We are looking for team members who model drive for results, think of the organization and team first without ego or agenda, and lead with emotional intelligence. This is the foundation of success for all employees at Meazure Learning.

The Role:




The

Sr. Data Engineer I

will be responsible for designing, building, and maintaining scalable data pipelines and systems to support the organization's data-driven initiatives. This role will work closely with data scientists, analysts, and other stakeholders to ensure data is easily accessible, clean, and reliable for analysis and reporting. The Sr. Data Engineer I will help drive improvements in data architecture and performance, ensuring that data can be leveraged for actionable insights to drive the business forward.

The Responsibilities:



Data Pipeline Development:



Design, build, and maintain scalable and reliable data pipelines to process and transform large volumes of data from various sources. Should have experience using tools such as

Azure Data Factory, AWS Glue, or Apache Airflow

. Work with cross-functional teams to understand data requirements and ensure that data is collected, processed, and stored in an optimal way for analytics and reporting. Implement and optimize

ETL / ELT

processes to ensure efficient and accurate data delivery to stakeholders using

Python, SQL, and PySpark

, integrating data from APIs, SaaS systems, and on-premises sources. Implement

data quality validation frameworks

and automated monitoring for data accuracy and timeliness.

Data Modeling & Architecture:



Design and implement data models that support business intelligence and analytics needs, ensuring data is structured efficiently and meets reporting and analytical requirements. Should have practical exposure to

Snowflake, Azure Synapse, or Redshift

. Develop and manage

data warehouses and data lakes

using

Azure Data Lake Storage (ADLS), S3, or Delta Lake

, ensuring performance, scalability, and cost optimization. Implement

data partitioning, clustering, and indexing strategies

to enhance query performance. Collaborate with data architects to define and evolve the

enterprise data architecture

and adopt

Data Mesh or Lakehouse

principles where applicable

Collaboration & Cross-Functional Support:



Work closely with data scientists, data analysts, and other teams to understand data needs and ensure data is available for analysis and reporting. Work closely with

BI teams

to ensure seamless data flow and integration with visualization tools such as

Power BI, Tableau, or Looker

. Collaborate with DevOps and platform teams to ensure

CI/CD integration

and

infrastructure-as-code (IaC)

deployment using

Terraform or CloudFormation

. Provide technical expertise to other departments by developing data solutions that support key business objectives. Troubleshoot and resolve data-related issues, ensuring the reliability and accuracy of the data.

Continuous Improvement & Optimization:



Optimize data workflows for

performance, scalability, and cost efficiency

, leveraging

Spark optimization

,

Snowflake query tuning

, and

auto-scaling techniques

. Expertise in

Snowflake architecture

, including virtual warehouses, time travel, and query optimization. Continuously monitor and improve data pipeline performance, addressing any bottlenecks or inefficiencies. Stay current with emerging trends in

data engineering, cloud-native architecture, and AI-driven data management


Documentation & Best Practices:



Create and maintain thorough documentation of data pipeline workflows, data models, and architectural decisions. Promote data engineering best practices and contribute to establishing standards for data quality, security, and governance. Promote CI/CD, version control (Git), and Agile methodologies in data engineering workflows.

The Desired Attributes:



Advanced Data Engineering Skills:

Strong experience with Azure (ADF, Synapse, ADLS, Databricks) and/or AWS (Glue, Redshift, S3, Lambda) cloud ecosystems

.

Proficiency in Python, SQL, and PySpark, with experience building modular, reusable data frameworks.

ETL / ELT Experience:

Solid understanding and experience building, maintaining, and optimizing ETL / ELT pipelines, including handling complex data transformations.

BI & Analytics Integration:

Hands-on experience with Power BI, including DAX, data modeling, and performance tuning. Familiarity with data cataloging and lineage tools

.

Data Architecture Expertise:

Knowledge of data modeling, database design, and big data technologies, with the ability to design scalable data infrastructure

.

Problem-Solving and Analytical Thinking:

Strong ability to diagnose and solve technical issues and optimize data processing workflows.

Collaboration Skills:

Ability to work well within cross-functional teams and with business stakeholders to understand their data needs. Ability to communicate complex technical concepts clearly and effectively to non-technical stakeholders.

Attention to Detail:

Strong focus on data quality and accuracy to ensure that data is reliable and suitable for analytics.

Experience:

At least 5-8 years of experience as a data engineer or in a related role, with a proven track record of building and maintaining data systems.

Educational Background:

A degree in Computer Science, Engineering, Data Science, or a related field, or equivalent professional experience.

The Benefits:



Company-Sponsored Health Insurance Competitive Pay Remote work Healthy Work Culture Career Growth Opportunities Learning and Development Programs Referral Award Program Company-Provided IT Equipment (for remote team members) Transportation Program (for on-site team members) Company-Provided Meals (for on-site team members) 14 Company-Provided Holidays Generous Leave Program

Learn more at

www.meazurelearning.com





Meazure Learning is an Equal Opportunity Employer and Prohibits Discrimination and Harassment of Any Kind: Meazure Learning is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. All employment decisions at Meazure Learning are based on business needs, job requirements, and individual qualifications, without regard to race, color, religion or belief, national, social or ethnic origin, sex (including pregnancy), age, physical, mental or sensory disability, HIV Status, sexual orientation, gender identity and/or expression, marital, civil union or domestic partnership status, past or present military service, family medical history or genetic information, family or parental status, or any other status protected by the laws or regulations in the locations where we operate. Meazure Learning will not tolerate discrimination or harassment based on any of these characteristics.




Monday through Friday

2:00 PM - 11:00 PM IST

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD4696476
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    IN, India
  • Education
    Not mentioned
  • Experience
    Year