Job Description

The health and safety of our employees and candidates is very important to us. Due to the current situation related to the Novel Coronavirus (2019-nCoV), we’re leveraging our digital capabilities to ensure we can continue to recruit top talent at the HSBC Group. As your application progresses, you may be asked to use one of our digital tools to help you through your recruitment journey. If so, one of our Resourcing colleagues will explain how our video-interviewing technology will be used throughout the recruitment process and will be on hand to answer any questions you might have. Some careers shine brighter than others. If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions. We are currently seeking an experienced professional to join our team in the role of a Consultant Specialist. In this role, you will: Data Engineer will be part of core big data technology and design team. Person would be entrusted to developed solutions/design ideas, identify design ideas to enable the software to meet the acceptance and success criteria. Work with architects/BA to build data component on the data environment. As a key member of the technical team alongside Engineers, Data Scientists and Data Users, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process:

• Software design, Scala & Spark development, automated testing of new and existing components in an Agile, DevOps and dynamic environment
• Promoting development standards, code reviews, mentoring, knowledge sharing
• Product and feature design, scrum story writing
• Data Engineering and Management
• Product support & troubleshooting
• Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring
• Liaison with BAs to ensure that requirements are correctly interpreted and implemented
• Participation in regular planning and status meetings. Input to the development process – through the involvement in Sprint reviews and retrospectives. Input into system architecture and design.
• Peer code reviews.
• 3rd line support.

Requirements
To be successful in this role, you should meet the following requirements:

• Ability to build data models using Hadoop technologies.
• Programming experience in Java or Scala.
• Experience with most of the following technologies (Apache Hadoop, Kafka, Apache Spark, YARN, Hive, Apache Atlas, SQL, RESTful services).
• Experience in testing, monitoring, administering, optimizing and operating multiple Hadoop / Spark clusters across cloud providers - GCP and on premise datacentres, primarily in Python, Java and Scala
• Sound working knowledge on Unix/Linux Platform
• Experience with GCP and/or AWS is preferable and advantageous
• Knowledge of working with data is advantageous
• Hands-on experience building data pipelines using Hadoop components Hive, and Spark SQL.
• Experience with industry standard version control tools (Git, GitHub), automated deployment tools (Ansible & Jenkins) and requirements management in JIRA
• Hands on experience on cloud preferably Google Cloud platform
• Experience on Debugging the Code issues and then publishing the highlighted differences to the development team/Architects.
• Hands on Python/shell, ELK, Kubernetes, containers.
• Hands on experience on Data migration and data processing on the Google Cloud stack, specifically:

• BigQuery

• Cloud DataProc

• Cloud Storage

• Cloud DataFlow

• Cloud DataPrep

• Cloud PubSub

• Cloud Composer

• Cloud BigTable

The successful candidate will also meet the following requirements:

• Forward thinking, independent, creative, and self-sufficient; who can work with less documentation, has exposure testing complex multi-tiered integrated applications. Ability to work with minimal supervision on own initiative and on multiple tasks simultaneously.
• Excellent communication, interpersonal, and decision making skills
• Strong team-working skills, working in global teams across multiple time zones
• Good knowledge on Data warehouse concepts.
• Knowledge on Software Development Life Cycle (SDLC), and Methodologies like DevOps, Agile, Scrum
• Willingness to learn and quick to adapt to changing requirements
• Identify project issues, communicate them and assist in their resolution.
• Assist in continuous improvement efforts in enhancing project team methodology and performance.
• Cooperative team focused attitude;
• Needs to be a Self-starter, proactive.

You’ll achieve more when you join HSBC. www.hsbc.com/careers HSBC is committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working and opportunities to grow within an inclusive and diverse environment. Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement, which is available on our website. Issued by – HSBC Software Development India