Job Description

Project Role :

Application Developer

Project Role Description :

Design, build and configure applications to meet business process and application requirements.

Must have skills :

Google BigQuery

Good to have skills :

NA

Minimum

3

year(s) of experience is required

Educational Qualification :

15 years full time education



Job Summary: We are looking for a skilled Data Engineer with strong expertise in Google BigQuery and Apache Airflow to design, develop, and manage robust data pipelines and workflows on the Google Cloud Platform (GCP). The ideal candidate will have hands-on experience in building scalable ETL/ELT pipelines, orchestrating workflows using Airflow, and leveraging BigQuery for data warehousing and analytics. Key Responsibilities: o Design and implement data pipelines using Apache Airflow for orchestration. o Develop and optimize ELT/ETL workflows to process large-scale datasets in Google BigQuery. o Write efficient and modular SQL queries and scripts for data transformation and analysis. o Implement data quality checks, monitoring, and alerts within pipelines. o Collaborate with data analysts, scientists, and product teams to understand requirements. o Integrate external data sources (e.g., APIs, S3, GCS, Cloud Storage) into BigQuery. o Optimize BigQuery usage and cost (e.g., partitioning, clustering, query tuning). o Use GCP services such as Cloud Functions, Cloud Composer, Dataflow, or Pub/Sub as needed. o Maintain technical documentation and ensure proper version control and CI/CD pipelines. o Support production data workflows and participate in on-call/incident resolution as needed. Professional & Technical Skills: - Must To Have Skills: Proficiency in Google BigQuery. - Strong understanding of data warehousing concepts and ETL processes. - Experience with SQL and database management. - Familiarity with cloud computing platforms and services. - Ability to troubleshoot and optimize application performance. Additional Information: - The candidate should have minimum 3 years of experience in Google BigQuery. - This position is based at our Bengaluru office. - A 15 years full time education is required.




15 years full time education