Specialist, Data Engineering

Year    Chennai, Tamil Nadu, India

Job Description


Roles and Responsibility
JOb Summary

  • Big Data Developer with experience in Pyspark, Scala, Hive HDFS
  • Expertise in building high-performing, scalable, enterprise-grade applications
Responsibility
  • Data acquisition Design, Data loading, Data Conversion, Data Modelling with relational and dimensional
  • Work with stakeholders including the Executive, Product, Data, analytics, and Design teams to assist with data-related technical issues and support their data infrastructure needs and strive for greater functionality in our data systems. Support the data pipeline flow for machine learning and advanced analytics solutions with the aim of improving yields from the business and enable improved customer experience.
  • Make the data products production-ready and deployable for use of internal customers.
  • Conducting functional and non-functional testing on large scale data platforms like unit testing, integrations testing, system testing, performance testing and volume testing.
  • Handling incident and exception management and building robust data pipelines.
  • Provide recommendations for data improvement, quality, and efficiency of data.
  • Ensure and support the data architecture utilized by business, data scientists and analysts.
  • Development of data processes for data modelling, mining, and data production.
  • Design and implement backup and recovery strategy
Business
  • FCSO
Processes
  • Good verbal and written communication skills
  • Strong analytical and problem solving and ability to prioritize and organize multiple task
  • Self-managing and ability to lead project solution end-to-end.
  • Ability to learn and adapt to new technologies and frameworks
  • Good programming & debugging skills with Code Quality measures
  • Ability to handle raw and unstructured data.
  • Good understanding of software development life cycle using Agile/Waterfall models & Process adherence
  • Understanding of Coding standards, Design patterns and guidelines. Understanding on source control, versioning, branching etc.
  • Database - strong RDBMS skills around writing efficient SQL\xe2\x80\x99s and complex procedures.
  • Strong Knowledge/hands-on in Big Data Technologies \xe2\x80\x93 Python Spark, Scala, HDFS, MapReduce, Sqoop Toolset such as HIVE, KAFKA, SPARK, Shell Scripting, & Any reporting tools like (Tableau, Dataiku, Alteryx, Paxata, MSTR, SAS & Dremio, SRE knowledge)
  • Good to hssave knowledge in CDP stacks.
  • Familiar with Enterprise Data Warehouse and Reference Data Management is a plus
  • Good Knowledge with Control M, Airflow, ETL process, Hadoop
  • Familiar with Spark, Data API, MLP
  • Familiar in SQL scripting, VB scripting and Python
  • Good Experience with Unix / Linux and batch scripting is a plus
  • To develop and execute the Automation Framework especially complimenting Data Warehouse domain
  • Familiar with Performance Testing (e.g. volume testing) and Disaster Recovery Testing is a plus
  • Familiar with JIRA and Confluence
  • Good Experience in DevOps Integration and Deployment.
Regulatory & Business Conduct
  • Display exemplary conduct and live by the Group\xe2\x80\x99s Values and Code of Conduct.
  • Take personal responsibility for embedding the highest standards of ethics, including regulatory and business conduct, across Standard Chartered Bank. This includes understanding and ensuring compliance with, in letter and spirit, all applicable laws, regulations, guidelines and the Group Code of Conduct.
  • Lead the [country / business unit / function/[team] to achieve the outcomes set out in the Bank\xe2\x80\x99s Conduct Principles.
  • Effectively and collaboratively identify, escalate, mitigate and resolve risk, conduct and compliance matters.
Our Ideal Candidate
Role Specific Technical Competencies
  • Big Data Technologies (Python Spark, Scala Spark, HDFS & Map Reduce etc)
  • Cloud Technology
  • Unix Shell Scripting
  • SQL
  • DataIQ
  • Big Data Technologies
  • Control-M
  • DevOps
About Standard Chartered
We\'re an international bank, nimble enough to act, big enough for impact. For more than 160 years, we\'ve worked to make a positive difference for our clients, communities, and each other. We question the status quo, love a challenge, and enjoy finding new opportunities to grow and do better than before. If you\'re looking for a career with purpose and you want to work for a bank making a difference, we want to hear from you. You can count on us to celebrate your unique talents. And we can\'t wait to see the talents you can bring us.
Our purpose, to drive commerce and prosperity through our unique diversity, together with our brand promise, to be here for good are achieved by how we each live our valued behaviours. When you work with us, you\'ll see how we value difference and advocate inclusion. Together we:
  • Do the right thing and are assertive, challenge one another, and live with integrity, while putting the client at the heart of what we do
  • Never settle, continuously striving to improve and innovate, keeping things simple and learning from doing well, and not so well
  • Be better together, we can be ourselves, be inclusive, see more good in others, and work collectively to build for the long term
In line with our Fair Pay Charter, we offer a competitive salary and benefits to support your mental, physical, financial and social wellbeing.
  • Core bank funding for retirement savings, medical and life insurance, with flexible and voluntary benefits available in some locations
  • Time-off including annual, parental/maternity (20 weeks), sabbatical (12 weeks maximum) and volunteering leave (3 days), along with minimum global standards for annual and public holiday, which is combined to 30 days minimum
  • Flexible working options based around home and office locations, with flexible working patterns
  • Proactive wellbeing support through Unmind, a market-leading digital wellbeing platform, development courses for resilience and other human skills, global Employee Assistance Programme, sick leave, mental health first-aiders and all sorts of self-help toolkits
  • A continuous learning culture to support your growth, with opportunities to reskill and upskill and access to physical, virtual and digital learning
  • Being part of an inclusive and values driven organisation, one that embraces and celebrates our unique diversity, across our teams, business functions and geographies - everyone feels respected and can realise their full potential.
Recruitment assessments - some of our roles use assessments to help us understand how suitable you are for the role you\'ve applied to. If you are invited to take an assessment, this is great news. It means your application has progressed to an important stage of our recruitment process.

Visit our careers website

Standard Chartered

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD3042680
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Chennai, Tamil Nadu, India
  • Education
    Not mentioned
  • Experience
    Year