Job Description

Lead Data Engineer DevOps

- Data Warehouse Performance Engineer

We are looking for Datawarehouse Performance Engineers who are passionate about data warehousing, love to analyze data management systems and workloads to make them faster and easier to use. You will work with the data and cloud engineering team to develop performance bottleneck analysis, analyze and recommend performance scaling inputs into new features, analyze regressions in performance, scale performance for new cloud instance, database versions and database features. You should have a forward-looking attitude and an inclination for digging deep to attack difficult and complex performance problems, and drive improvements to deliver for our customers.

This is a unique and rare opportunity to get in on floor within a fast-growing business and help shape the technology, process, and the business. You will bring deep technical, systems and analytics expertise with the ability to work in an industry leading Manufacturing company to deliver a broad business impact.

Diversity & Inclusion
We always invite all perspectives, work together as a truly global team, and respect our unique strengths to create a diverse and inclusive culture where ideas and voices are heard

Work/Life Balance
Our team puts a high value on work-life balance. It isn\xe2\x80\x99t about how many hours you spend at home or at work; it\xe2\x80\x99s about the flow you establish that brings energy to both parts of your life. We believe striking the right balance between your personal and professional life is critical to life-long happiness and fulfillment. We offer flexibility in working hours and encourage you to find your own balance between your work and personal lives.

Mentorship & Career Growth
Our team is dedicated to supporting new members. We have a broad mix of experience levels and tenures, and we\xe2\x80\x99re building an environment that celebrates knowledge sharing and mentorship. Our senior members enjoy one-on-one mentoring and thorough, but kind, code reviews. We care about your career growth and strive to assign projects based on what will help each team member develop into a better-rounded engineer and enable them to take on more complex tasks in the future.

Key Job Functions

Work with Data Leads, database engineers and solution architects to analyze performance bottlenecks, make recommendations for scaling, automated performance regression testing and analysis, co-design performance into new feature development.

Design operations architecture and conduct performance engineering for large scale data lakes in production environment

Understand database internals, server and storage system design, application interactions with database queries and stored procedures

Collaborate with engineers, database engineers, solution architects, product management to design new functionality

Build and run automation and benchmark tests to improve quality, performance, and scalability

Run database benchmark workloads

Analyze new designs for performance and scaling

Research issues experienced by customers and find or invent solutions

Key Technologies: Postgres, Redshift, MySQL, Oracle

Postgres design and development, including logical and physical schema design

Postgres application performance tuning and optimization

DB query monitoring for tuning and optimization opportunities

DB partition/index management, ensure teams are using modern strategies

DB pruning/compression for storage optimization

Design and optimize data models on AWS Cloud using AWS data stores such as Redshift, RDS

BASIC QUALIFICATIONS

Bachelor or master\xe2\x80\x99s degree in information technology, Electrical Engineering or similar relevant fields.

Experience with Database Performance bottleneck analysis and system design for scaling

Experience analyzing performance bottlenecks with application code interfacing with databases, cache layers, data storage, servers, networking, database query protocols including developing stored procedures, SQL queries, and database applications

Experience with one or more of database internals, OS internals, storage system internals and performance scaling for these

Working knowledge of at least one at least one stored procedure language (SQL, pgSQL), at least one scripting language (Shell scripting, Python, PERL)

Proven experience with large, complex database projects in environments producing high-volume data

PREFERRED QUALIFICATIONS

Proven experience with Postgres physical and logical table design, performance tuning and optimization

Very good knowledge of data warehouse architecture approaches and trends, and high interest to apply and further develop that knowledge, including understanding of Dimensional Modelling

Experience in preparing data warehouse design artifacts based on given requirements

Experience implementing automated performance regression test suites for databases

Experience analyzing performance bottlenecks with application code interfacing with databases, cache layers, data storage, servers, networking, database query protocols including developing stored procedures, SQL queries, and database applications

Working knowledge of operating system internals and/or relational database internals (locking, consistency, serialization, system recovery)

Having working Experience in ETL tool (preferably Pyspark) is added advantage

Experience working directly with internal or external customers, resolving issues and providing architecture leadership

Information about our benefits you can find here:

GlobalFoundries