Job Description

Microsoft’s Cloud business is experiencing explosive growth, and the Capacity, Supply Chain & Provisioning (CSCP) organization is responsible for enabling the infrastructure underlying this growth. Our mission is to deliver the world’s computer with an industry-leading supply chain. CSCP is responsible for strategic sourcing, customer demand forecasting, capacity planning and management, supply chain planning and execution, capacity provisioning, and decommissioning and dispositioning of datacenter assets worldwide.

Global Capacity Team manages cloud capacity for customers globally across different resources and regions – Compute, Storage, PaaS services, bare metal services etc. The Analytics and Insights team provides backbone analytics views for daily, weekly and monthly processes and operations. To support this a BI analytics platform is built on cloud with various architectural components – data ingestion pipelines, transformation, data quality, analytics and data storage, security and visualization.
The analytics platform provides an environment of high opportunity and impact and we are looking for a strong and experienced Data Engineer who can deliver robust data infrastructure to power world-class analytics solutions at cloud scale to optimize and improve Azure customer capacity experiences working closely with business partners, other engineering teams and data scientists.

Responsibilities

• Collaborate/Interface with leadership and diversified business users to gather requirements and delivering end to end reporting solutions including design and development of new Power BI reports and dashboards.
• Participate in tactical and strategic planning discussions for various projects and/or products to enable business with definition, tracking and reporting of key metrics.
• Synthesize and analyze complex, high-volume, high-dimensionality data from varying sources using a variety of tools and data analysis techniques. Understand and translate business needs into optimized data models supporting long-term solutions.
• Own, design, implement and maintain of robust data pipeline along with Power BI dashboards to support organization-wide strategic initiatives; work with development team to develop and implement effective ETL and monitoring in Data Platform to support end to end BI landscape.
• Develop best practices for standard naming conventions and coding practices to ensure consistency of data models with maintenance of metadata, data catalog and documentation for internal business users.
• Understand and implement best practices for partitioning, compression, parallelization to optimize user experience and usability of reports.
• Drive scale and service improvements of existing data processes and pipelines by implementing automation, data tuning and performance concepts creatively.
• Effectively set and manage stakeholder expectations, which result in high or improved customer satisfaction. Effectively drive alignment with stakeholders on key issues, identify and facilitate an effective decision-making process.
• Recommend improvements in methodologies or frameworks to achieve consistent, predictable, and repeatable processes and projects.
• Maintain conceptual, logical and physical data models along with corresponding metadata.
• Build a “data analysis practice” with both full- and self-service models for investigations, and a regular engagement rhythm to empower the entire organization with data-driven decisions.
• Provide quick turnaround data analysis along with relevant data visualizations on ad-hoc/recurring basis to generate insights to help guide decision-makers and executives.
• Identify process and system improvement opportunities by monitoring existing metrics, analyzing data, and partnering with internal teams.
• Help internal business customers troubleshoot and optimize SQL and ETL solutions to solve reporting problems.
• Participating in team’s live-site activities.

Qualifications

Required

• 10+ years of experience architecting, designing, and operating large scale big data services.
• 10+ year experience with Azure Big Data stack (Data Lake, Spark, Hadoop) and distributed processing like Apache Spark, Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Factory, Azure Data Lake Storage, Azure Machine Learning, Azure Cognitive Services, Azure Databricks, Azure Data Explorer, PowerBI.
• 10+ years development experience on large-scale big data solutions including databases (SQL/No-SQL) and ETL / Data pipelines using cloud services.
• Ability to write high quality, maintainable, and robust code, often in Azure SQL, Azure Data Factory or similar cloud/ETL technologies for big data.
• Self-starter with a strong passion for using data to influence business decisions and strategy investments.
• Have basic understanding of programming languages such as Python, Ruby , Java, .NET.
• Ability to intelligently integrate a wide range of data sources and analysis to answer core business questions and discover growth opportunities.
• Excellent oral and written communication skills and ability to present and discuss data models and analysis to a range of audiences across development, operations, and business teams in Microsoft.
• Ability to work cross-functionally, be detail oriented ,build and maintain trust with internal stakeholders in a fast and agile development environment.
• Exceptional ability to effectively negotiate and collaborate across teams and organizations.
• Preferred experience working with cloud services with a strong understanding of cloud databases, compute, data streaming and storage.

Preferred

• Hands-on expertise on Python, complex SQL development and Kusto query language
• Modern DevOps practices (including Git, CI/CD, Azure DevOps/VSTS)
• Deep technical knowledge/experience on architecting, developing, and deploying enterprise Big Data engineering solutions
• Deep practical experience troubleshooting performance problems, tuning and optimizing big data solutions
• Architecture – the ability to create and explain 3-tier architecture diagrams, system context diagrams, system interaction diagrams, etc.
• Experience in big data workloads like HDInsight, Hadoop, Spark
• Advanced Analytics including Azure Databricks, visualization tools as Power BI
• Azure Synapse Analytics
• High throughput logging systems/databases like Azure Log Analytics, ELK Stack or similar
• Experience with any analytical / visualization tool (Power BI, Cognos, OBIEE, etc.) is a plus
• Undergrad degree in Engineering
• Strong communication skills

CLOUD SCREENING REQUIREMENT
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

#cscpjobs #gctjobs

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.