Job Description

Company Description
Discover the Unexpected Experian is the world’s leading global information services company. We are listed on the London Stock Exchange (EXPN) and are a constituent of the FTSE 100 Index. We’re passionate about unlocking the power of data in order to transform lives and create opportunities for consumers, businesses and society. For more than 125 years, we’ve helped businesses grow, consumers and small businesses gain access to financial services, and economies and communities flourish – and we’re not done. Our 18k amazing employees in 40+ countries believe the possibilities for you, and the world, are growing. We’re investing in the future, through new technologies, talented people and innovation so we can help create a better tomorrow. To do this we employ the greatest and brightest minds that share our purpose and want to make a difference. Experian Asia Pacific's culture, people and environments are key differentiators. We focus on what truly matters; diversity and inclusion, work/life balance, flexible working, development, equity, engagement, collaboration, wellness, reward & recognition, volunteering... the list goes on. We’re committed to fostering a strong sense of belonging and a place where you can bring your true self to work. Our uniqueness is that we truly value yours. We’re an award winning organisation due to our strong people first focus. This includes Top Employer™ and Great Place To Work™ accreditations. Learn more at www.experianplc.com


Ascend Sandbox is an integrated BigData and analytics platform. Our clients, some of the America’s largest financial institutions, use this platform to understand consumer credit behavior and build models for credit decisioning, marketing and account review purposes. We are looking for an expert platform engineer with in-depth knowledge on BigData analytics & public cloud platforms to help us run this peta-byte scale BigData platform and provide the best possible experience for our clients. What You’ll Do Here

• Responsible for continuous platform enhancements, upgrades, availability, reliability and security of the Ascend Sandbox platform.
• Provide end-to-end observability of our Ascend Sandbox platform.
• Responsible for resolving incidents reported by Sandbox users and take preventive actions.
• Help Sandbox users with troubleshooting failed MapReduce/Hive/Spark applications.
• Help Sandbox users to improve the performance and optimize their MapReduce/Hive/Spark applications.
• Participate in follow-the-sun on-call rotation to address any emergency production incidents affecting the Sandbox platform.

Qualifications

• 
  Deep understanding of Linux, networking fundamentals and security.
• Solid professional coding experience with at least one scripting language - Shell, Python etc.
• Experience working with AWS cloud platform and infrastructure.
• Experience managing large BigData clusters in production (at least one of - Cloudera, Hortonworks, EMR)
• Excellent knowledge and solid work experience providing observability for BigData platforms using tools like Prometheus, InfluxDB, Dynatrace, Grafana, Splunk etc.
• Experience managing BigData clusters with compute decoupled from storage (Eg: S3) on public cloud platforms.
• Expert knowledge on Hadoop Distributed File System (HDFS) and Hadoop YARN.
• Decent knowledge of various Hadoop file formats like ORC, Parquet, Avro etc.
• Deep understanding of Hive (Tez), Hive LLAP, Presto and Spark compute engines.
• Ability to understand query plans and optimize performance for complex SQL queries on Hive and Spark.
• Hands on experience supporting Spark with Python (PySpark) and R (SparklyR, SparkR) languages.
• Experience working with Data Analysts, Data Scientists and at least one of these related analytical applications like SAS, R-Studio, JupyterHub, H2O etc.

Additional Information

Experian Careers - Creating a better tomorrow together Find out what its like to work for Experian by clicking here