Job Description

Apache Spark is an open-source, distributed processing system used for big data workloads. It utilizes in-memory caching, and optimized query execution for fast analytic queries against data of any size.

About Process : Apache Spark is a data processing framework that can quickly perform processing tasks on very large data sets, Distribute data processing tasks across multiple computers, either on its own or in tandem with other distributed computing tools. These two qualities are key to the worlds of big data and machine learning, which require the marshalling of massive computing power to crunch through large data stores. Spark also takes some of the programming burdens of these tasks off the shoulders of developers with an easy-to-use API that abstracts away much of the grunt work of distributed computing and big data processing. Experience : Minimum of 4+ years of software development experience (with a concentration in data centric initiatives), with demonstrated expertise in standard development best practice methodologies Minimum 4+ years of experience in Hadoop using Spark, Scala, Hive , Kafka Requirement : Strong knowledge of Database concepts Expert on SQL skills for data manipulation (DML) Expertise in Object Oriented Programming Langu- Java Ability to impliment POC with latest tech stalk Experience using CI/CD Process, version control ,bug tracking tools. Need exposure to Real Time data processing. Experience in handling very large data volume in low latency and batch mode. Result oriented with strong analytical and problem-solving skills. Experience with automation of job execution,validation and compares of the data files on Hadoop Env at the field level. Experience in leading a small team and be a team player. Strong communication skills with proven ability to present complex ideas and document in a clear and concise way. Quick learner: self-starter, detailed and in-depth Education : B.SC IT/ BS/MS degree in Computer Science Shift timings : 10.30 am-7.30pm, night shifts if required Location : CHENNAI /BANGALORE/HYDERABAD/PUNE