Job Description

Experience:- 5 to 7 Years

NP:- Immediate

Job Location:- Pune /Hyderabad

:-

• Software design, Scala & Spark development, automated testing of new and existing components in an Agile, DevOps and dynamic environment
• Promoting development standards, code reviews, mentoring, knowledge sharing
• Production support & troubleshooting.
• Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring
• Liaison with Client to ensure that requirements are correctly interpreted and implemented.
• Participation in regular planning and status meetings. Input to the development process - through the involvement in Sprint reviews and retrospectives. Input into system architecture and design.
• Peer code reviews.

• Scala development and design using Scala 2.10+ or Java development and design using Java 1.8+.
• Experience with most of the following technologies (Apache Hadoop, Scala, Apache Spark, PySpark, Spark streaming, YARN, Kafka, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services).
• Sound knowledge on working Unix/Linux Platform
• Hands-on experience building data pipelines using Hadoop components - Hive, Spark, Spark SQL,PySpark.
• Experience with industry standard version control tools (Git, GitHub), automated deployment tools (Ansible & Jenkins) and requirement management in JIRA.
• Understanding of big data modelling techniques using relational and non-relational techniques
• Experience on Debugging the Code issues and then publishing the highlighted differences to the development team/Architects;

• Experience with time-series/analytics dB\'s such as Elastic search.
• Experience with scheduling tools such as Airflow, Control-M.
• Understanding or experience of Cloud design patterns
• Exposure to DevOps & Agile Project methodology such as Scrum and Kanban.
• Experience with developing Hive QL, UDF\'s for analyzing semi structured/structured datasets.
• Hands on experience on Data migration and data processing on the Google Cloud stack, specifically: BigQuery ,Cloud DataFlow , Cloud DataProc ,Cloud Storage , Cloud DataPrep , Cloud PubSub , Cloud Composer, Cloud BigTable

• Need profiles who can join immediately to 15 days (as in who has already resigned and 15-20 days left - not someone who can negotiate to 15 days but has not resigned yet)
• Please share with L1 slots for assessment.
• Check with the candidate how much experience he holds in Spark and Scala DEVELOPMENT experience.
• Candidate must hold experience in any 1 programming language for coding.

NR Consulting