Big Data Developer with experience in Pyspark, Scala, Hive HDFS
Expertise in building high-performing, scalable, enterprise-grade applications
Responsibility
Data acquisition Design, Data loading, Data Conversion, Data Modelling with relational and dimensional
Work with stakeholders including the Executive, Product, Data, analytics, and Design teams to assist with data-related technical issues and support their data infrastructure needs and strive for greater functionality in our data systems. Support the data pipeline flow for machine learning and advanced analytics solutions with the aim of improving yields from the business and enable improved customer experience.
Make the data products production-ready and deployable for use of internal customers.
Conducting functional and non-functional testing on large scale data platforms like unit testing, integrations testing, system testing, performance testing and volume testing.
Handling incident and exception management and building robust data pipelines.
Provide recommendations for data improvement, quality, and efficiency of data.
Ensure and support the data architecture utilized by business, data scientists and analysts.
Development of data processes for data modelling, mining, and data production.
Design and implement backup and recovery strategy
Business
FCSO
Processes
Good verbal and written communication skills
Strong analytical and problem solving and ability to prioritize and organize multiple task
Self-managing and ability to lead project solution end-to-end.
Ability to learn and adapt to new technologies and frameworks
Good programming & debugging skills with Code Quality measures
Ability to handle raw and unstructured data.
Good understanding of software development life cycle using Agile/Waterfall models & Process adherence
Understanding of Coding standards, Design patterns and guidelines. Understanding on source control, versioning, branching etc.
Database - strong RDBMS skills around writing efficient SQL\xe2\x80\x99s and complex procedures.
Strong Knowledge/hands-on in Big Data Technologies \xe2\x80\x93 Python Spark, Scala, HDFS, MapReduce, Sqoop Toolset such as HIVE, KAFKA, SPARK, Shell Scripting, & Any reporting tools like (Tableau, Dataiku, Alteryx, Paxata, MSTR, SAS & Dremio, SRE knowledge)
Good to hssave knowledge in CDP stacks.
Familiar with Enterprise Data Warehouse and Reference Data Management is a plus
Good Knowledge with Control M, Airflow, ETL process, Hadoop
Familiar with Spark, Data API, MLP
Familiar in SQL scripting, VB scripting and Python
Good Experience with Unix / Linux and batch scripting is a plus
To develop and execute the Automation Framework especially complimenting Data Warehouse domain
Familiar with Performance Testing (e.g. volume testing) and Disaster Recovery Testing is a plus
Familiar with JIRA and Confluence
Good Experience in DevOps Integration and Deployment.
Regulatory & Business Conduct
Display exemplary conduct and live by the Group\xe2\x80\x99s Values and Code of Conduct.
Take personal responsibility for embedding the highest standards of ethics, including regulatory and business conduct, across Standard Chartered Bank. This includes understanding and ensuring compliance with, in letter and spirit, all applicable laws, regulations, guidelines and the Group Code of Conduct.
Lead the [country / business unit / function/[team] to achieve the outcomes set out in the Bank\xe2\x80\x99s Conduct Principles.
Effectively and collaboratively identify, escalate, mitigate and resolve risk, conduct and compliance matters.
Our Ideal Candidate Role Specific Technical Competencies
Big Data Technologies (Python Spark, Scala Spark, HDFS & Map Reduce etc)
Cloud Technology
Unix Shell Scripting
SQL
DataIQ
Big Data Technologies
Control-M
DevOps
About Standard Chartered We\'re an international bank, nimble enough to act, big enough for impact. For more than 160 years, we\'ve worked to make a positive difference for our clients, communities, and each other. We question the status quo, love a challenge, and enjoy finding new opportunities to grow and do better than before. If you\'re looking for a career with purpose and you want to work for a bank making a difference, we want to hear from you. You can count on us to celebrate your unique talents. And we can\'t wait to see the talents you can bring us. Our purpose, to drive commerce and prosperity through our unique diversity, together with our brand promise, to be here for good are achieved by how we each live our valued behaviours. When you work with us, you\'ll see how we value difference and advocate inclusion. Together we:
Do the right thing and are assertive, challenge one another, and live with integrity, while putting the client at the heart of what we do
Never settle, continuously striving to improve and innovate, keeping things simple and learning from doing well, and not so well
Be better together, we can be ourselves, be inclusive, see more good in others, and work collectively to build for the long term
In line with our Fair Pay Charter, we offer a competitive salary and benefits to support your mental, physical, financial and social wellbeing.
Core bank funding for retirement savings, medical and life insurance, with flexible and voluntary benefits available in some locations
Time-off including annual, parental/maternity (20 weeks), sabbatical (12 weeks maximum) and volunteering leave (3 days), along with minimum global standards for annual and public holiday, which is combined to 30 days minimum
Flexible working options based around home and office locations, with flexible working patterns
Proactive wellbeing support through Unmind, a market-leading digital wellbeing platform, development courses for resilience and other human skills, global Employee Assistance Programme, sick leave, mental health first-aiders and all sorts of self-help toolkits
A continuous learning culture to support your growth, with opportunities to reskill and upskill and access to physical, virtual and digital learning
Being part of an inclusive and values driven organisation, one that embraces and celebrates our unique diversity, across our teams, business functions and geographies - everyone feels respected and can realise their full potential.
Recruitment assessments - some of our roles use assessments to help us understand how suitable you are for the role you\'ve applied to. If you are invited to take an assessment, this is great news. It means your application has progressed to an important stage of our recruitment process.