Data Engineer

Year    Gandhinagar, GJ, IN, India

Job Description

Must have:

? 3 to 5 years of professional experience as a data engineer and 1+ years of professional experience as a senior data engineer

? Must have strong working experience in Python and its various data analysis packages - Pandas / NumPy

? Must have strong understanding of prevalent cloud ecosystems and experience in one of the cloud platforms - AWS / Azure / GCP.

? Must have strong working experience in one of the leading MPP Databases - Snowflake / Amazon Redshift / Azure Synapse / Google Big Query

? Must have strong working experience in one of the leading data orchestration tools in cloud - Azure Data Factory / Amazon Glue / Apache Airflow

? Must have experience working with Agile methodologies, Test Driven Development, and implementing CI/CD pipelines using one of leading services - GITLab / Azure DevOps / Jenkins / AWS Code Pipeline / Google Cloud Build

? Must have Data Governance / Data Management / Data Quality project implementation experience

? Must have experience in big data processing using Spark

? Must have strong experience with SQL databases (SQL Server, Oracle, Postgres etc.) ? Must have stakeholder management experience and very good communication skills ? Must have working experience on end-to-end project delivery including requirement gathering, design, development, testing, deployment, and warranty support

? Must have working experience with various testing levels, such as, unit testing, integration testing and system testing

? Working experience with large, heterogeneous datasets in building and optimizing data pipelines, pipeline architectures

Nice to have:

? Working experience in DataBricks notebooks and managing DataBricks clusters

? Experience in Data Modelling tool such as Erwin or ER Studio

? Experience in one of the data architectures, such as Data Mesh or Data Fabric

? Has handled real time data or near real time data

? Experience in one of the leading Reporting & analysis tools, such as Power BI, Qlik, Tableau or Amazon Quick Sight

? Working experience with API integration

? General insurance / banking / finance domain understanding

Job Types: Full-time, Permanent

Pay: ?671,754.20 - ?1,526,127.93 per year

Benefits:

Health insurance Leave encashment Paid sick time Paid time off Provident Fund
Schedule:

Day shift Monday to Friday Weekend availability
Supplemental Pay:

Performance bonus Yearly bonus
Work Location: In person

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD3757910
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Contract
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Gandhinagar, GJ, IN, India
  • Education
    Not mentioned
  • Experience
    Year