Data Engineer

Year    Bangalore, Karnataka, India

Job Description


Req ID: 418200 Leading societies to a low carbon future, Alstom develops and markets mobility solutions that provide the sustainable foundations for the future of transportation. Our product portfolio ranges from high-speed trains, metros, monorail, and trams to integrated systems, customised services, infrastructure, signalling and digital mobility solutions. Joining us means joining a caring, responsible, and innovative company where more than 70,000 people lead the way to greener and smarter mobility, worldwide Smart Transportation is a strategic program that aims at developing Alstom new offering in mobility. This set of initiatives will mainly consist in new digital solutions but will also cover some other \'smart\' solutions in energy efficiency, traffic operations, or passenger services. To achieve this objective Alstom has created a Digital Factory that aims at being at the forefront of digital revolution by developing expertise in machine learning, data science, video analysis, sensor design, roaming data capture, etc. and building its digital assets. Alstom are now looking for the Data Engineer , who will be leading the data engineering activities for building the MDP based solutions within a lean startup pathway and in collaboration of IoT experts, data scientists, software engineers and data Architects. RESPONSIBILITIES: Define, develop, manage & sustain the data ingestion and processing bricks used by the Data Platform, such as: Multi-tenant data collector and storage Multi-tenant streaming and data processing Shared data model, including NoSQL modeling Data management and security components Develop IT solutions with partners (start-ups, IT companies, other industrial companies, suppliers, universities, research institutes) to package Software as a Service (SaaS) offering along with the ML engineers and Data Scientists. SKILLS & EDUCATION 10+ years in IT and/or digital companies or startups. Proven experience in designing and developing scalable solutions with data processing engine for production grade application. (example Apache Spark, Apache NIFI, Airflow, Python, Scala, Object Storage) Maintain the data pipelines and perform data normalization and transformations Ensure data records are well structure as per requirement Deep understanding of Python. Knowledge of different packages of python used for data engineering Knowledge of Scala and Spark will be considered as an advantage. Experience working with Container technologies - Docker, Kubernetes. Deep understanding of different data storage, database and orchestration tools. Experience in designing highly scalable distributed applications and addressing scaling, and performance problems. Work closely with data scientist, data analysts, and ml engineers focused on delivering high-quality data and analytic applications on the cloud. Experience in designing relational and non-relational databases - PostgreSQL/Cassandra and eliminating performance bottlenecks. Develop and enhance new & existing pipelines to meet ongoing business requirements while keeping performance, reliability, efficiency, and security in mind. Design and create reusable ELT components and frameworks that encourage best practices for developing ELT and ML data pipelines. Experienced with the production of real-time streaming data applications. Experienced in creating prototypes and proofs of concept for iterative development. Proven track record of providing leadership for a solution, offering practical solutions and recommendations to clients. Demonstrated teamwork and collaboration in a professional setting Proven capabilities with worldwide teams. Job Location : Bangalore Alstom is the leading company in the mobility sector, solving the most interesting challenges for tomorrow\'s mobility. That\'s why we value inquisitive and innovative people who are passionate about working together to reinvent mobility, making it smarter and more sustainable. Day after day, we are building an agile, inclusive and responsible culture, where a diverse group of people are offered opportunities to learn, grow and advance in their careers, with options across functions and geographic locations. Are you ready to join a truly international community of great people on a challenging journey with a tangible impact and purpose Equal opportunity statement: Alstom is an equal opportunity employer committed to creating an inclusive working environment where all our employees are encouraged to reach their full potential, and individual differences are valued and respected. All qualified applicants are considered for employment without regard to race, colour, religion, gender, sexual orientation, gender identity, age, national origin, disability status, or any other characteristic protected by local law. Job Type:Experienced

foundit

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD3130790
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Bangalore, Karnataka, India
  • Education
    Not mentioned
  • Experience
    Year