Job Description

What We'll Bring: Need experienced Hadoop Admin

What You'll Bring:

We are looking for an experienced Hadoop administrator to assist in managing a rapidly growing MapR Distribution Platform in a multi-tenancy environment. This role will work closely with the engineering & development teams and will be responsible for capacity planning, service configuration, cluster expansion, monitoring, tuning, and overall ongoing support of the cluster environment. Responsibility also includes researching and recommending methods and technologies to improve cluster operation and user experience.

Job Responsibilities:

Manage the Hadoop distribution on Linux instances, including configuration, capacity planning, expansion, performance tuning and monitoring

Work with data engineering team to support development and deployment of Spark and Hadoop jobs

Work with end users to troubleshoot and resolve incidents with data accessibility

Contribute to planning and implementation of software and hardware upgrades

Recommend and implement standards and best practices related to cluster administration

Research and recommend automated approaches to cluster administration

Responsible for Capacity Planning, Infrastructure Planning based on the workloads and future requirements

Install MapR-Hadoop for different environments (Dev, Model, Production, Disaster Recovery

Provide support and maintenance and its eco-systems include HDFS, Yarn, Hive, Spark, etc.

Work with delivery teams for Provisioning of users into Hadoop.

Support OS patching of cluster nodes.

Optimize and Performance tuning of the cluster by changing the parameters based on the benchmarking results.

Impact You'll Make:

Qualifications:

A minimum of bachelor's degree in computer science or equivalent.

5+ years' experience managing full stack Hadoop distribution (preferably MapR), Including monitoring

Experience with administering Linux production environment

Strong knowledge of Yarn configuration in a multi-tenancy environment.

Working knowledge of automation tools

Strong written and verbal communication skills

Excellent analytical and problem-solving skills

Must have the ability to identify complex problems and review related information to develop and evaluate options and implement solutions.

TransUnion Job Title

Engineer, Database Administration and Storage