Python / Spark Data Engineer
Job Description
JOB POSITION: PYTHON/SPARK DATA ENGINEER LOCATION: MUMBAI JOB DESCRIPTION: DUTIES AND RESPONSIBILITIES \' We are looking for a seasoned Python/Spark Data Engineer. \' The candidate will work with the Solution architects, Data Modeler and other data engineer to develop Spark-based data Processing Pipeline to integrate on premise transactional data, Telemetry data and various external data. \' The candidate should have extensive experience in designing, implementing and deploying scalable high-performance data services in the cloud or on-premises \' In addition, the engineer should also be able to translate functional and non-functional (technical) requirements into the design of data services. REQUIREMENTS & QUALIFICATIONS: \' Strong Experience in developing Python or Scala-based Spark Data processing pipeline for large data set of data integration. \' Proficiency with relational database and SQL \' 1-2 years of SPARK streaming experience with scala, Python and Java in real time production experience. \' Total 6-8 Years of IT experience. \' Good communications skills that can deal with diverse types of people from Data Science, Product management and QA group KEY TECHNICAL SKILLS: Apache Spark, Python, Apache Kafka, Hive & Impala, Scala, Python and Java
foundit
MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.
Related Jobs
-
-
Data Engineer I
Hyderabad/ Secunderabad (Andhra Pradesh), Gurgaon (Haryana), Chennai (Tamil Nadu), Bengaluru/ Bangal -
Job Detail
-
Job IdJD3041538
-
IndustryNot mentioned
-
Total Positions1
-
Job Type:Full Time
-
Salary:Not mentioned
-
Employment StatusPermanent
-
Job LocationMumbai, Maharashtra, India
-
EducationNot mentioned
-
ExperienceYear