Job Description

Section
D&AI - Domestic 2W & IB - Data Science & BI
Job posted on
Mar 2, 2022
Employee Type
White Collar
Experience range
1 year - 3 years

Position description:

• Cultivate a customer-centric, results-driven Data Engineering solutions.

• Partner with internal teams and external vendors to ingest, store and enrich data throughout the organization within the enterprise data lake and underlying warehouses/data marts/etc.

• Operate as a thought leader with the ability to guide, influence, and inspire peak performance across the data architecture design and ETL functions.

• Lead large-scale integration and re-platforming efforts with CRM and Customer Engagement Platform (CEP) systems – both internally and externally – to enhance the data and marketing platform infrastructure.

• Collaborate with Business leaders, Data Science, IT and Digital App Development teams on implementing machine learning algorithms at scale to facilitate audience intelligence, segmentation and personalization initiatives.

• Collaborate with Business Intelligence and extended analytics groups on data mart optimizations, query tuning, and data model designs with a focus on delivering actionable insights.

• Work strategically to align data assets, storage, and computation/query layers to support long-term data platform goals, help define data models, publish metadata, guide best practice ETL standards.

• Make sound architectural decisions across relational, multi-dimensional, distributed and object-based storage platforms.

• Expertise in Python Programming, Spark-Data frames, Spark Streaming, Spark-SQL.

• Expertise in building complex business logics using Spark.

• Experience working on Data bricks (preferred) or Azure HDInsight.

• Experience in Azure App Services, Azure Function App, Azure Logic App.

• Deep Understanding of Azure Blob Storage and Delta Lake concepts.

• Experience on Data Orchestration tool preferably Azure Data Factory.

• Experience on Performance tuning/optimisation on Spark.

• Parsing & Processing of unstructured and semi-structured data.

• Collaborate with internal and customers functional and technical teams to ensure Azure based solutions are appropriately Engineered, Tested, & Deployed.

• Experience in building Data Catalogues, Metadata, Logging & Alerting in the Data Pipelines.

• Understanding of different Storage technologies on Cloud.

• Ability to be up to date with new offerings on the Cloud.

• Ability to translate business requirements / problems into technical Architectures utilizing Azure & Complementary Services and Technologies.

• Bachelors/Master’s degree that emphasizes analyzing, displaying, or reporting on data (e.g., computer science, math, engineering, economics, statistics)