At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide.
When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.
Staff Apache Spark Engineer at BairesDev
We are seeking a Staff Apache Spark Engineer to work on distributed data processing systems and real-time analytics. You'll contribute to Apache Spark and related ecosystem projects (Kafka, Hive, Iceberg), focusing on performance optimization and scalable architecture.
What You'll Do:
Contribute actively to Apache Spark and related open source projects as a core contributor.
Design and optimize distributed data processing engines for batch and real-time analytical workloads.
Develop streaming analytics capabilities using Spark Structured Streaming and integration with Apache Kafka.
Enhance Spark SQL catalyst optimizer and distributed query execution systems.
Drive performance tuning initiatives for complex analytical operations.
Collaborate with engineering teams on technical solutions and system integration.
What we are looking for:
10+ years of experience in software development.
Strong expertise in distributed computing and large-scale data processing systems.
Deep understanding of Apache Spark architecture, including RDDs, DataFrames, and streaming.
Proficiency in Scala, Java, and Python (primary Spark development languages).
Proven experience in performance tuning of distributed systems at scale.
Core contributions to Apache open source projects (Spark, Kafka, Hive, or similar).
Advanced level of English.
How we make your work (and your life) easier:
Excellent compensation in USD or your local currency if preferred.
Paid parental leave, vacation, & national holidays.
Innovative and multicultural work environment.
Collaborate and learn from the global Top 1% of talent in each area.
Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.
Join a global team where your unique talents can truly thrive and make a significant impact!
Apply now!
MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.