Senior Engineer, Data Engineering

Year    KA, IN, India

Job Description

Equal Opportunity Employer



All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, national origin, protected veteran status, or disability status. EEO/Disabled/Vets



:



About the Role



We are looking for a Senior Data Engineer



with experience in excellent analytical



abilities in GCP BigQuery, ETL/BI, Python,



Composer/Airflow, SQL, GCP Services -



with the ability to operate in an agile



environment and keen to detail while



understanding the larger data warehouse.



Skills & Competencies



? A minimum of 4.5+ years of



working experience as a hands-on



data engineering is a must



? Advanced Degree in the field of



Computer Science, Data



Engineering, Data Analytics or



equivalent discipline



? Strong programming experience



with Python, SQL, ETL and



efficiently querying big datasets



using SQL



? Prior experience with CircleCI



CI/CD, Terraform and Github



version control is a must



? Solid understanding of Data



Collection, Data Ingestion, Data



Integration, and Data Operations



& Maintenance



? Implement data governance



practices, including data quality,



security, and compliance, in line



with organizational standards.



? Domain knowledge on News,



Media & Communications is an



added advantage



R E S P O N S I B I L I T I E S



? Design, build, and maintain scalable



ETL/ELT pipelines in Google Cloud, using



tools like Cloud Composer (Airflow), and



BigQuery.



? Collaborate with cross-functional teams to



define data architecture and data



warehouse requirements



? Automate data pipelines, ETL/ELT



processes, and data integration workflows



using infrastructure-as-code (IaC) and



configuration management tools



? Deep understanding of BigQuery,



including SQL, optimization techniques,



partitioning, clustering, and performance



tuning.



? Deliver production quality, modular,



reproducible code in Python, SQL



? Implement continuous integration and



continuous deployment (CI/CD) pipelines



for data pipelines and data-related



applications



? Keep abreast of the latest developments



in the field through continuous learning



and proactively champion promising new



methods relevant to the problems at hand.



Our Tech Stack


Google Cloud Platform is IaaS

BigQuery, GCS, Python, SQL

Composer / Airflow - orchestration


tools


Terraform, CircleCI, CI/CD, GIthub,


Jira, Confluence



This job is posted with NTS Technology Services Pvt. Ltd.



Job Category:



News Corp is a global, diversified media and information services company focused on creating and distributing authoritative and engaging content to consumers throughout the world. The company comprises businesses across a range of media, including: news and information services, book publishing, digital real estate services, cable network programming in Australia, and pay-tv distribution in Australia.



Headquartered in New York, the activities of News Corp are conducted primarily in the United States, Australia, and the United Kingdom.

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD4936239
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    KA, IN, India
  • Education
    Not mentioned
  • Experience
    Year