Job Description

:
Job Title: Senior Big Data Engineer
Experience Range: 5 to 10 years
Hiring Location: Pune
Notice Period: 0-30 Days
:
We are seeking a Big Data Engineer with 5+ years of experience to play a key role in building, managing, and optimizing our big data pipelines. This role involves working with cutting-edge technologies to enhance product capabilities while collaborating with cross-functional teams.
Key Responsibilities:

• Work closely with Technical Leaders to design and implement robust Big Data solutions.
• Participate in design discussions and brainstorming sessions to evaluate tools and frameworks for Big Data processing.
• Develop and maintain data processing pipelines using distributed frameworks like Apache Spark and Hadoop.
• Implement ETL processes and optimize data workflows using Apache Airflow, dbt, and related tools.
• Ensure data quality, security, and performance in large-scale data processing environments.
• Collaborate with multi-region software and support teams to ensure seamless data integration.
• Stay up to date with the latest advancements in Big Data technologies and contribute to continuous improvements.

Must-Have Skills:

• 4+ years of experience in Data Engineering.
• Strong understanding of Big Data ecosystems, including Spark and Hadoop.
• Proficiency in ETL processes and data pipeline orchestration using Apache Airflow, dbt, or similar tools.
• Strong programming skills in Python, Java, or Scala, along with SQL expertise.
• Experience with version control tools (Git) and build tools like Gradle, Maven, or SBT.
• Experience in cloud-based data platforms (AWS, GCP, or Azure).
• Strong understanding of object-oriented programming, data structures, algorithms, and performance optimization.
• Excellent problem-solving, communication, and collaboration skills.

Good-to-Have Skills:

• Experience with data warehouse platforms (Snowflake, Redshift, BigQuery).
• Familiarity with streaming data processing frameworks (Kafka, Flink).
• Knowledge of containerization and orchestration tools (Docker, Kubernetes).
• Exposure to DevOps practices and CI/CD pipelines.

Qualifications:

• Bachelors/Masters degree in Computer Science, Information Technology, or a related field.
• 5-7 years of professional experience in Big Data Engineering.

Skills:
java,Microservices,Python,Big Data
About Company:
UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the worlds best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients organizations. With over 30,000 employees in 30 countries, UST builds for boundless impactxe2x80x94touching billions of lives in the process.