Information Technology / Data & Analytics Division
Reporting To:
Head - Data & Digital Infrastructure
Role Summary
The Data Engineer will be responsible for designing, developing, and maintaining robust data pipelines and architectures that support the Ministry's digital transformation initiatives. The role involves integrating multiple data sources, ensuring data accuracy and availability, and supporting analytics, reporting, and evidence-based policy decisions.
Key Responsibilities
Design, build, and maintain
data pipelines and ETL/ELT processes
to collect, transform, and store data from various systems and external sources.
Develop and maintain
data warehouses and data lakes
to support analytical and operational reporting needs.
Ensure
data quality, consistency, and integrity
across all systems and platforms.
Implement
data governance and security controls
in line with Ministry standards and compliance frameworks.
Collaborate with
data analysts, system owners, and digital teams
to ensure alignment with ministry-wide data strategies.
Monitor and optimize data performance, scalability, and cost-efficiency of data infrastructure.
Support
open data and interoperability initiatives
to enhance transparency and information sharing across departments.
Prepare technical documentation, workflows, and architecture diagrams for reference and audit purposes.
Research and recommend emerging data technologies to enhance the Ministry's digital capabilities.
Required Qualifications and Experience
Bachelor's degree in
Computer Science, Information Technology, Data Engineering, or related discipline
.
Minimum
3-5 years of experience
in data engineering or a related technical role.
Strong proficiency in
SQL
and
data processing languages
(Python, Scala, or Java).
Hands-on experience with
data integration tools
and
big data frameworks
(e.g., Apache Spark, Hadoop, PySpark).
Proficiency in
data modeling, schema design
, and working with
relational and NoSQL databases
.
Knowledge of
cloud-based data platforms
(AWS, Azure, or Google Cloud) and their analytics services.
Familiarity with
workflow/orchestration tools
(e.g., Apache Airflow, NiFi).
Strong understanding of
data governance, security, and metadata management
.
Excellent analytical, documentation, and communication skills.
Preferred Qualifications
Master's degree in
Data Science, Analytics, or Computer Engineering
.
Certifications in
Cloud Data Engineering
(AWS, Azure, GCP).
Experience in
public sector or government data systems
.
Exposure to
real-time data streaming
technologies (Kafka, Kinesis).
Understanding of
digital transformation and smart government initiatives