Data Engineer Databricks

Year    India, India

Job Description


Vestas is the world leader in wind technology and a driving-force in the development of the wind power industry. Vestas\' core business comprises the development, manufacture, sale, marketing, and maintenance of Wind Turbines. Come and join us at Vestas! Applications, Controls & Electrical Modelling & Analytics Module Plant Monitoring & Reliability Plant Monitoring & Reliability Sub Module, within Modelling & Analytics Module (M&A), Part of Vestas Power Solutions, is responsible for the products and services related to Vestas Monitoring and Reliability solutions and offerings. We have a comprehensive and diverse team that consists of everything from Health Monitoring Engineers/Specialists and Reliability Engineers/ Specialists, Data engineers, Data Analysts, and Data Scientists. The department is responsible for developing world class Plant Monitoring Products & Solutions - Health Monitoring, Condition Monitoring, Power Quality Monitoring, Reliability and VTMs. This ranges across real-time data collection from thousands of power plants with Health Monitoring systems, and data analytics on a Health Monitoring & Reliability setup supporting multiple data applications, Diagnostics, Monitoring solutions for our customers. The goal is to bring down the cost of energy by leveraging the vast amount of data that Vestas collects and stores from power plants around the globe. Vestas Modelling & Analytics module is on a journey of transitioning into a Cloud based data platform for condition monitoring data. You will be the core Data engineer responsible for design and implementation of this transition and become the design owner of the new cloud based platform for modern data product offerings of Condition monitoring data. The primary scope of work will be sourcing of data from distributed on-premise data systems to one centralized Databricks infrastructure. Responsibilities Design and support database and table schemas for new and existent data sources Translate business needs into technical data designs Design and implement implementation of ETL (Extract, Transform, Load) data pipelines Work on feasibility studies of new technologies through proof of concepts Work with data science and analytics development teams in Plant Monitoring & Reliability area and cross functional teams across M&A Module and IT teams (Digitalization) to ensure best practice, performance and reliability is in place Qualifications Minimum of 5-7 years\' Relevant experience with Masters\' or PhD degree in STEM (Science, Technology, Engineering, and Mathematics) Work experience where data engineering and Data warehouse development was a major part of your work Experience in automating software deployments & tests, and following a continuous delivery and deployment model Experience with mathematical modeling Competencies Must have Databricks, Spark, Pandas, Python, Azure cloud, Data factory, SQL, Data/DeltaLake, git, Azure DevOps, testing, CI/CD Good to have Cloud infrastructure deployment and IaC, Azure Biceps and ARM templates, Snowflake, Snowpark, Unity Catalog, dbt, Scala/Rust/R Familiarity with: Statistics, signal processing, Jupyter notebooks, data testing, and data science best-practices Data warehouse data models and proficiency with ETL tools MS SQL, SSIS, SSAS (MDX/DAX) JIRA or similar tools Experience with Cloud platform (SNOWFLAKE) Knowledge of Kafka, C# DevOps process and associated tools, e.g. Azure DevOps What We Offer We offer you the opportunity to make a difference and to work in a multicultural and international company, where you have the possibility to improve your skills and develop professionally. Additional Information: Your primary location will be in Chennai. Please note: We do amend or withdraw our jobs and reserve the right to do so at any time, including prior to the advertised closing date. Please be advised to apply on or before 18th May 2024. BEWARE - RECRUITMENT FRAUD It has come to our attention that there are a number of fraudulent emails from people pretending to work for Vestas. Read more via this link,https://www.vestas.com/en/careers/our-recruitment-process DEIB Statement At Vestas, we recognize the value of diversity, equity, and inclusion in driving innovation and success. We strongly encourage individuals from all backgrounds to apply, particularly those who may hesitate due to their identity or feel they do not meet every criterion. As our CEO states, Expertise and talent come in many forms, and a diverse workforce enhances our ability to think differently and solve the complex challenges of our industry. Your unique perspective is what will help us powering the solution for a sustainable, green energy future.

foundit

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD3282017
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    India, India
  • Education
    Not mentioned
  • Experience
    Year