Data Engineer

Year    Pune, Maharashtra, India

Job Description


Passionate people create exceptional things

Did you know that the solutions we develop are a key part of most industries? Electronics, medical research, renewable energy, food production, infrastructure and many more.

We\xc2\xb4re everywhere! Working with us means working with the latest technologies and groundbreaking, sustainable innovations. With our inclusive and caring environment, you get the support and inspiration you need to grow.

Here, your ideas are embraced, and you never stop learning. Interested in being part of our team?

Join us on our journey for a better tomorrow.

Your Role

Atlas Copco is a leading global Industrial Group having vision of "First in Mind, First in Choice". Our culture is founded on three core values of commitment, interaction and innovation. They guide us in everything we do and reflect how we behave internally and in our relationships with our stakeholders.

Digital Technology Practice at GECIA (Global Engineering Centre, India), part of Atlas Copco, is contributing significantly to vision of the Group by focusing on developing global talent, expanding portfolio and competence on futuristic competencies, driving Innovation and achieving operational excellence to drive customer success.

As a Data Engineer your mission will be to build and maintain enterprise , production-grade data pipelines, considering business requirements and data platform standards. You must have hands on experience in building ETL flows , using CI CD pipelines , using cloud technologies such as Azure Data lake, ADF, DataBricks, Visualisations tools such as Power BI. Additioanally SQL is a must. Knowledge of Python will be added advantage.

Examples of technologies you will be working with: Azure Data Lake Storage, Delta Lake, Azure Data Factory, Databricks, Azure SQL, Azure Dev Ops.

You would be a part of Data Analytics Team of Global Engineering Center (GECIA) of Atlas Copco India Private Ltd and supporting Industrial Tools Business Area. As a Data Engineer within our Data Anlytics Competence team, you will lead the management and organisation of data for our custom-built applications and bringing the Data Driven meaningful insights. You will be instrumental at every stage of the project lifecycle from extracting, transforming, and loading (ETL) data, to managing data pipelines and cloud infrastructure.

Key responsibilities and responsibility:

  • Build, configure, deploy, and support a production-grade, scalable and secure data platform
  • Build and support long-term, production-grade data pipelines that ingest, store, transform, process, and expose data from producer to consumer, based on business requirements
  • Develop data pipelines using a code-first approach in line with the platform standards and practices
  • Translate functional requirements into a technical design
  • Provide and maintain technical documentation. You will develop the visuals in Power BI for as expected by Stake holders.
  • Train and handover common data engineering related maintenance and monitoring activities to the Data Operations & Quality Team
  • Share technology and platform expertise with colleague data engineers, product owners and other people in the organization
To succeed, you will need

Skills & Experience:

The ideal candidate will have a good blend of business and technical skills. Specific requirements for this position include:

General skills:
  • You have a bachelor\'s or master\'s degree in computer science, engineering, or equivalent by experience
  • You have a minimum work experience of 3 years with data engineering in relavent domain
  • The ideal candidate has strong and demonstrable hands-on experience with data engineering on cloud-based data platforms using Databricks (Spark), preferably based on MS Azure technology: Azure Storage, Azure SQL database, Azure data factory, Azure Databricks
  • Good coding skills (Python, SQL, or Scala)
  • Experience with following concepts or technologies is considered a plus: Data Lake Storage, SQL, Hive, Presto, Databricks, Spark, Delta Lake, Hadoop, HDInsights, Cloudera, Hortonworks, MapR, Azure Functions, Azure Synapse, Azure Analysis Services, Power BI, Python, SQL, Scala, Java, C#, Azure AD, Ranger, Docker, Kubernetes, Azure, AWS, Kafka, StreamSets, REST
  • Experience of working on MS Power BI
  • Experience and understanding of agile methodologies and the SCRUM framework are a plus.
  • Experience with tools like Jira and confluence is a plus
Important areas of Expertise:
  • Storage: Best of breed (Cloud) storage solutions, both for unstructured and structured data
  • Ingestion: Streaming and batch ingestion from source systems both in the cloud and on-premises, private and public
  • Transformation: Code-first approach using Spark (Databricks)
  • Analytic engines: Deploy, configure, and operationalize analytics engines and its clustered infrastructure
  • Exposure/Integration: Expose data based on consumption use-cases like data science, self-service analytics, business intelligence and operational APIs for process integration
  • Data Platform: Health, logging, monitoring, debugging, automation
Competences:
  • You have a passion for innovation and technologies, combined with strong technical and analytical skills.
  • You are customer oriented, enthusiastic, and professional
  • You have a \xe2\x80\x9ccan-do\xe2\x80\x9d mindset, \xe2\x80\x9chands-on\xe2\x80\x9d approach and are decisive. You are not afraid of making errors and are willing to learn by doing
  • You are a strong communicator with excellent collaboration skills and are customer focused
  • You have self-drive and passion
  • You are flexible and prepared to work outside of business hours if required to meet a deadline.
  • You have a proactive attitude and always strive for continuous improvement
  • You are able to cooperate with different levels in the organization, with different people and cultures
  • You can maintain good relations with external parties
  • You are stress resistant.
  • You are result oriented and quality focused on terms of processes.
In return, we offer you

An opportunity to work with 150 years old, leading global product company

An opportunity where you are empowered to drive your own professional journey

A challenging role focused on Data Engineering.

Global exposure and opportunities through internal mobility

Freedom and authority to act

A culture where we care about each other and world around us

Best in class total reward program covering Insurances, Higher Education, flexible work timing

\xe2\x80\x8b

City
Pune

Last Day to Apply

08/04/2024

Diverse by nature and inclusive by choice
Bright ideas come from all of us. The more unique perspectives we embrace, the more innovative we are. Together we build a culture where difference is valued and we share a deep sense of purpose and belonging.

Atlas Copco

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD3257779
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Pune, Maharashtra, India
  • Education
    Not mentioned
  • Experience
    Year