Data Operations Engineer

Year    Bangalore, Karnataka, India

Job Description


Wabtec Corporation is a leading global provider of equipment, systems, digital solutions and value-added services for freight and transit rail. Drawing on nearly four centuries of collective experience across Wabtec, GE Transportation and Faiveley Transport, the company has unmatched digital expertise, technological innovation, and world-class manufacturing and services, enabling the digital-rail-and-transit ecosystems. Wabtec is focused on performance that drives progress, creating transportation solutions that move and improve the world. Wabtec has approximately 27,000 employees in facilities throughout the world. Visit the company\xe2\x80\x99s new website at: .

It\xe2\x80\x99s not just about your career\xe2\x80\xa6 or your job title\xe2\x80\xa6it\xe2\x80\x99s about who you are and the impact you are going to make on the world. Do you want to go into uncharted waters\xe2\x80\xa6do things that haven\xe2\x80\x99t been done to make yours and someone else\'s life better? Wabtec has been doing that for decades and we will continue to do so! Through our people, leadership development, services, technology and scale, Wabtec delivers better outcomes for global customers by speaking the language of industry.

Summary:

Wabtec IT Data & Analytics (DnA) Team\xe2\x80\xa6at the forefront of the business priorities in building a next generation data and analytics ecosystem\xe2\x80\xa6is looking to work into the operations of large-scale data analytics solutions and platform operations.

This hands-on position is responsible for BigData support to provide technical expertise and lead a team of data operations contractors in maintaining our Data Lake platform, application support and maintenance operations. We expect this person is self-motivated, a quick learner and who has worked on AWS & has experience on working with cloud platform hosting BigData / Hadoop distributed data environment. This Operations Engineer is a technical professional responsible for participating in the design, development, testing, implementation, and the support of the Cloud platform ecosystem. This role also supports efforts to create infrastructure to streamline development and deployment of applications using modern Cloud DevOps practices.

If you are enthusiastic and passionate about NextGen platform hosting and maintaining infra- operations, then we are looking for you!

Duties and Responsibilities:

  • Responsible for maintaining large scale production EMR cluster
  • Well versed with AWS - EMR/ S3, and other AWS services and dashboards. Preferred - AWS certification for EMR cluster management
  • Strong knowledge of Kerberos for operation and debugging issues in Hadoop
  • Point of contact for Hadoop related issues coming from Application teams and internal clusters, responsible for troubleshooting and recommendation for Spark and MR jobs. Should be able to use existing logs to debug the issue
  • Responsible for implementation and ongoing administration of Hadoop infrastructure including monitoring, tuning, and troubleshooting
  • Improve scalability, service reliability, capacity, and performance of the cluster and applications running in the cluster
  • Triage production issues when they occur with other operational teams
  • Conduct ongoing maintenance across our large-scale deployments across the time zones and countries
  • Write automation code for managing large Big Data clusters
  • Identify ways to improve infra reliability, efficiency, and quality.
Minimum Qualifications & Eligibility Requirements:
  • Bachelor\'s Degree in Information Systems, Information Technology (IT), Computer Science, or Engineering from an accredited college or university
  • Overall 4+ Years of Professional experience in Information Technology with Platform Operations or DevOps or similar
  • Minimum of 3+ years of experience working with cloud-based platforms in an enterprise environment with large scale Data hosting on Bigdata technologies or Data Lake process
  • Strong Experience in Hadoop Administration - AWS EMR is preferred
  • Strong Experience in Hadoop - HDFS, MapReduce, Yarn, Pig, Zookeeper.
  • Strong Experience in Hadoop SQL tools - Hive and Presto
  • any Scripting Knowledge - Shell, Perl, python, groovy, terraform, ansible
  • Strong Experience in Linux OS
  • Experience on AWS services/network - Instances, Security Groups, Bootstrap actions, S3 Buckets, VPC/Subnet
  • Strong Experience with Hadoop security and Governance - LDAP Integrations, Kerberos.
  • Strong Performance tuning experience on Hive, Presto and MapReduce/Yarn.
  • Strong Experience in monitoring, debugging, and troubleshooting of services.
  • Knowledge on Datadog
  • Familiarity or expertise with various tools & technologies include Python/ Spark / Scala / Sqoop & scalr, terraform, ansible, Jenkins, CICD, and S3/ Glue /EMR/ RedShift/ RDS/ Kinesis/ Elastic search etc is a plus
Knowledge, Skills and Abilities:
  • Critical thinking, decision making, troubleshooting and problem-solving skills
  • Ability to support multiple initiatives simultaneously and work in a fast-paced environment
  • Excellent verbal & written communication skills, including communicating technical issues to non-technical audiences
  • Ability to acquire any specialized domain knowledge required to be more effective in all platform operations activity
  • Ability to operate in a fast-paced environment with a sense of of urgency, ownership, and accountability
  • Adaptable/Flexible: being open to change in response to new information, different or unexpected circumstances, and having the ability to navigate ambiguous situations
  • Highly self-motivated with the ability to work independently, passionate about business & attention to details
Wabtec Corporation is committed to taking on the world\xe2\x80\x99s toughest challenges. In order to fulfill that commitment we rely on a culture of leadership, diversity and inclusiveness. We aim to employ the world\xe2\x80\x99s brightest minds to help us create a limitless source of ideas and opportunities. We believe in hiring talented people of varied backgrounds, experiences and styles\xe2\x80\xa6people like you! Wabtec Corporation is committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or expression, or protected Veteran status. If you have a disability or special need that requires accommodation, please let us know.

Wabtec

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD3026751
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Bangalore, Karnataka, India
  • Education
    Not mentioned
  • Experience
    Year