Data Engineer

Year    Gandhinagar, GJ, IN, India

Job Description

Must have:


3 to 5 years of professional experience as a data engineer and 1+ years of professional experience as a senior data engineer


Must have strong working experience in Python and its various data analysis packages - Pandas / NumPy


Must have strong understanding of prevalent cloud ecosystems and experience in one of the cloud platforms - AWS / Azure / GCP.


Must have strong working experience in one of the leading MPP Databases - Snowflake / Amazon Redshift / Azure Synapse / Google Big Query


Must have strong working experience in one of the leading data orchestration tools in cloud - Azure Data Factory / Amazon Glue / Apache Airflow


Must have experience working with Agile methodologies, Test Driven Development, and implementing CI/CD pipelines using one of leading services - GITLab / Azure DevOps / Jenkins / AWS Code Pipeline / Google Cloud Build


Must have Data Governance / Data Management / Data Quality project implementation experience


Must have experience in big data processing using Spark


Must have strong experience with SQL databases (SQL Server, Oracle, Postgres etc.)
Must have stakeholder management experience and very good communication skills
Must have working experience on end-to-end project delivery including requirement gathering, design, development, testing, deployment, and warranty support


Must have working experience with various testing levels, such as, unit testing, integration testing and system testing


Working experience with large, heterogeneous datasets in building and optimizing data pipelines, pipeline architectures

Nice to have:


Working experience in DataBricks notebooks and managing DataBricks clusters


Experience in Data Modelling tool such as Erwin or ER Studio


Experience in one of the data architectures, such as Data Mesh or Data Fabric


Has handled real time data or near real time data


Experience in one of the leading Reporting & analysis tools, such as Power BI, Qlik, Tableau or Amazon Quick Sight


Working experience with API integration


General insurance / banking / finance domain understanding

Job Types: Full-time, Permanent

Pay: ₹671,754.20 - ₹1,526,127.93 per year

Benefits:

Health insurance Leave encashment Paid sick time Paid time off Provident Fund
Schedule:

Day shift Monday to Friday Weekend availability
Supplemental Pay:

Performance bonus Yearly bonus
Work Location: In person

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD3757910
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Gandhinagar, GJ, IN, India
  • Education
    Not mentioned
  • Experience
    Year