Job Description

Hive and Spark are our main batch big data analytics query engine at Uber. It accounts for the majority of our data compute resources, powers most of our major ingestions, ETLs, data science, and machine learning workloads. Hive and Spark at Uber is used by over 3K weekly active users, who run 5M+ hive and spark applications every week.

As part of the Batch Analytics team, you will design, implement, optimize, and manage large scale distributed computing infrastructure that will impact multiple business use cases at Uber scale. You will also have the opportunity to collaborate with the open source community for Hive/Spark and related domains.

What the Candidate Will Need / Bonus Points

---- What the Candidate Will Do ----

• Work with Uber engineering teams to improve Hive/Spark use-cases at Uber.
• Leverage knowledge of hive internals to dramatically help improve customer's Hive/Spark job performance.
• Design and implement distributed algorithms for large scale batch data processing.
• Work with multiple partner teams within and outside of Uber and build cross-functional solutions in a collaborative work environment.
• Work on Hive/Spark internals so as to continue improving Spark's robustness and performance for Uber's unique use cases.
• Work with the community to upstream Uber's contributions to open source and also keep our internal fork up to date

---- Basic Qualifications ----

• Bachelor's degree in Computer Science or related field.
• 4+ years of experience building large scale distributed software systems.
• Solid understanding of Java for backend / systems software development

---- What the Candidate Will Do ----

• BTech/ MTech/ MS / PhD in Computer Science or related field.
• Experience managing production systems with a strong availability SLA.
• Experience working with Apache Spark/Hive or similar analytics technologies.
• Experience working with large scale distributed systems, HDFS / Yarn.
• Experience working with SQL Compiler, SQL Plan / Runtime Optimization.

At Uber, we reimagine the way the world moves for the better. The idea was born on a snowy night in Paris in 2008, and ever since then, our DNA of reimagination and reinvention carries on. We've grown into a global platform moving people and things in ever-expanding ways, taking on big problems to help drivers, riders, delivery partners, and eaters make movement happen at the push of a button for everyone, everywhere.

We welcome people from all backgrounds who seek the opportunity to help build a future where everyone and everything can move independently. If you have the curiosity, passion, and collaborative spirit, work with us, and let's move the world forward, together.

Offices continue to be central to collaboration and Uber's cultural identity. Unless formally approved to work fully remotely, Uber expects employees to spend at least half of their work time in their assigned office. For certain roles, such as those based at green-light hubs, employees are expected to be in-office for 100% of their time. Please speak with your recruiter to better understand in-office expectations for this role.

Uber is committed to a safe workplace. We have implemented COVID-19 safety protocols that meet or exceed local public health guidelines. Workplace safety remains our number one priority. As a result, and depending on the workplace location, Uber either requires* or recommends employees be vaccinated to access any of our facilities; this is subject to change solely at the Company's discretion.

• Accommodations may be available based on religious and/or medical conditions, or as required by applicable law. To request an accommodation, please reach out to

.