Hadoop Administrator

Year    Pune, Maharashtra, India

Job Description

b'


Position Type : Full time Type Of Hire : Experienced (relevant combo of work and education) Education Desired : Bachelor\'s Degree Travel Percentage : 0% Hadoop Administrator - Bangalore/ Pune/Chennai/Gurgaon- 6-12Years Are you curious, motivated, and forward-thinking? At FIS you\xe2\x80\x99ll have the opportunity to work on some of the most challenging and relevant issues in financial services and technology. Our talented people empower us, and we believe in being part of a team that is open, collaborative, entrepreneurial, passionate and above all fun. What You Will Be Doing: Service Management: Administer, configure, and maintain Hadoop ecosystem services within both Cloudera Data Platform (CDP) and Cloudera Distributed Hadoop (CDH), including HDFS, YARN, Hive, Spark, Ranger, Sentry, Kerberos security, KMS, KTS, Zookeeper, and more. Job Scheduling and Workflow Management: Utilize Oozie, Zena, Airflow to schedule and orchestrate complex data jobs and workflows, meeting business requirements efficiently. This includes day-end SLA jobs to ensure timely data processing. Security and Access Control: Manage security measures such as Kerberos authentication, safeguarding Hadoop clusters and data in both CDP and CDH environments. Implement and maintain role-based access control (RBAC) policies in Ranger and Sentry. Job Monitoring and Tuning: Set up robust monitoring systems, including advanced tools like Unravel, to track cluster health, job execution, and resource utilization in both CDP and CDH environments. Continuously fine-tune configurations for optimized performance. Issue Resolution and Troubleshooting: Identify and troubleshoot issues related to job failures, data processing, and cluster performance in both CDP and CDH environments. Develop and implement solutions to mitigate recurring problems. Cross-Functional Collaboration: Act as a bridge between technical teams, including application support, development, and scheduling. Facilitate effective communication to understand and address their requirements and issues. Collaboration: Collaborating with different team to install patch, Haodop updates, version upgrade across CDP and CDH environments. Contribute to the development of data engineering solutions when required. Automation and Scripting: Create and maintain automation scripts for administrative tasks and provisioning, applying Infrastructure as Code (IAC) principles for efficient cluster management in both CDP and CDH. Documentation and Reporting: Maintain detailed documentation of configurations, procedures, and best practices for both CDP and CDH environments. Generate reports on cluster health, job scheduling, and performance metrics. What You Will Bring:
  • Bachelor\'s degree in computer science, information technology, or a related field (Master\'s preferred).
  • Proven experience as a Hadoop Administrator and Big Data Engineer, with expertise in managing a wide range of Hadoop ecosystem services across CDP and CDH environments, including day-end SLA jobs.
  • Deep understanding of security practices, including Kerberos, Ranger, and Sentry, in both CDP and CDH.
  • Proficiency in job scheduling and orchestration using Zena, Oozie, and Airflow across both environments.
  • Strong scripting skills (e.g., Bash, Python) and experience with automation frameworks.
  • Excellent problem-solving and troubleshooting abilities.
  • Exceptional communication and collaboration skills, with the ability to engage effectively with diverse teams.
  • Familiarity with advanced monitoring tools like Unravel.
  • Relevant certifications (e.g., Cloudera Certified Administrator, AWS Certified Big Data) are advantageous.
What we offer you
  • A multifaceted job with a high degree of responsibility and a broad spectrum of opportunities
  • A broad range of professional education and personal development possibilities \xe2\x80\x93 FIS is your final career step!
  • A competitive salary and benefits
  • A variety of career development tools, resources and opportunities
Privacy Statement FIS is committed to protecting the privacy and security of all personal information that we process in order to provide services to our clients. For specific information on how FIS protects personal information online, please see the Online Privacy Notice. Sourcing Model Recruitment at FIS works primarily on a direct sourcing model; a relatively small portion of our hiring is through recruitment agencies. FIS does not accept resumes from recruitment agencies which are not on the preferred supplier list and is not responsible for any related fees for resumes submitted to job postings, our employees, or any other part of our company. #pridepass

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD3253270
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Pune, Maharashtra, India
  • Education
    Not mentioned
  • Experience
    Year