Job Description

Business Segment: S&P Global Engineering Solutions

The Role: Principal Data Engineer

The Team: S&P Global Engineering Solutions solves for tomorrow\xe2\x80\x99s challenges today by transforming workflows and end-user experiences with data, insights and technology.

The Impact: The candidate will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams.

What\xe2\x80\x99s in it for you: The candidate has experience translating developer, data scientist, and business needs into a vision of what should be built. This means skillfully choosing and deploying big data technologies and infrastructure (e.g. Kafka, Spark, DynamoDB, Neo4j), building frameworks atop to facilitate autonomous use for these internal customers, and abstracting production solutions so they feel like \xe2\x80\x9cmagic\xe2\x80\x9d for your stakeholders such that things \xe2\x80\x9cjust fall into place.\xe2\x80\x9d As Principal Data Engineer, you have a diversity of software development experience rather than a single tool suite or paradigm. You are hands-on, data-driven, and highly collaborative. You should enjoy being "full stack" in the sense that you own a product from beginning to end by designing, constructing, integrating, testing, documenting, and supporting your creations. You have a passion for engineering best-practices and the ability to lucidly communicate with fellow engineers as well as non-technical colleagues. You will present and communicate team status to the Technology leaders and Executive team. Technical Business Analyst role with the above will be an added advantage. This role includes acting as an interface between the SME and the developers. You will be responsible for converting the SME requirements into a clearly defined user story.

Responsibilities:
Assume technological and administrative responsibilities for a focused team (2-3 members)

Provide (thought) leadership in technology direction, technical services, vendor partnership, and industry standards adoption.

Are \xe2\x80\x9cbiased to action\xe2\x80\x9d and not easily blocked by problems and difficulties, instead taking ownership

Believe in monitoring, QA, and security as a first-class citizen in any data product.

Able to understand requirements in context to design solutions, rather than take them at face value.

Excited to design data platforms and tools that abstract implementation details for developers, analysts, and data scientists, enabling data transit and storage \xe2\x80\x9cas a service.\xe2\x80\x9d

Dedicated to automation, documentation, and collaboration at all stages of the engineering workflow.

Sensitive to the balance of performance and cost with the ability to communicate and optimize for the requirements of each.

Passionate about mentoring colleagues and educating the organization on data engineering best practices.

Maintain an excellent understanding of the business long term goals and strategy and ensure that designs are aligned with these - able to see the forest through the trees.

Efficiently integrating new systems, programs, and applications with business operations and services.

Ensuring end-user proficiency with new systems, programs, and applications across departments.

Qualifications

Degree in Computer Science, related field, or equivalent experience.

Eight (8) or more years of increasing responsibility in technical data roles, with 3 or more years of experience as a data engineer lead.

Expertise in various big data technologies both open source and cloud native, AWS preferred (Kafka/Kinesis, Spark/EMR, Snowflake, Presto/Athena, Airflow, Hive, Drill).

Expertise in data model design with sensitivity to usage patterns and goals \xe2\x80\x93 schema, scalability, immutability, idempotency, etc.

Mastery of at least two of the following languages \xe2\x80\x93 Scala, Python, Java, Go.

Expertise in the suite of NoSQL models and frameworks.

Track record of choosing the right transit, storage, and analytical technology to simplify and optimize user experience.

Real-world experience developing highly scalable solutions using micro-service architecture designed to democratize data to everyone in the organization.

Able to function autonomously and successfully in ambiguous situations.

Return to Work
Have you taken time out for caring responsibilities and are now looking to return to work? As part of our Return to Work initiative, we are encouraging enthusiastic and talented returners to apply, and will actively support your return to the workplace.

Level (relevant for internal applicants only): 8

The Location: Bangalore

About Company Statement:
S&P Global delivers essential intelligence that powers decision making. We provide the world\xe2\x80\x99s leading organizations with the right data, connected technologies and expertise they need to move ahead. As part of our team, you\xe2\x80\x99ll help solve complex challenges that equip businesses, governments and individuals with the knowledge to adapt to a changing economic landscape.
S&P Global Engineering Solutions solves for tomorrow\xe2\x80\x99s challenges today by transforming workflows and end-user experiences with data, insights and technology

-----------------------------------------------------------

Equal Opportunity Employer
S&P Global is an equal opportunity employer and all qualified candidates will receive consideration for employment without regard to race/ethnicity, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, marital status, military veteran status, unemployment status, or any other status protected by law. Only electronic job submissions will be considered for employment.

If you need an accommodation during the application process due to a disability, please send an email to: EEO.Compliance@spglobal.com and your request will be forwarded to the appropriate person.

US Candidates Only: The EEO is the Law Poster http://www.dol.gov/ofccp/regs/compliance/posters/pdf/eeopost.pdf describes discrimination protections under federal law.

----------------------------------------------------------- 20 - Professional (EEO-2 Job Categories-United States of America), IFTECH202.2 - Middle Professional Tier II (EEO Job Group), SWP Priority \xe2\x80\x93 Ratings - (Strategic Workforce Planning)

Job ID: R21109
Posted On: 2023-01-04
Location: Bangalore, Karnataka, India