Job Description

Dear Candidates, HP looking for people with expertise in Big data for short duration Projects(3-6 months) Work location : Chennai : Technical Skillset : Linux/HDFS Familiar with Putty/MobaXTerm or similar tools Connect SSH to remote with Private Key and password Copy Files between edge node and HDFS Paths Upload files using WebHDFS, winscp (SSH) to HDFS servers Execute OOZIE Jobs and Trouble shoot using Yarn Logs Familiar with Hue to execute query/schedule oozie jobs Hive Table Creation/delete. Storage Formats - different Types & UseCases Partitioning & Bucketing Hive SQL - queries for Complex scenarios, performance tuning Spark - SCALA/PYSPARK Spark memory/processor settings/options Import from FlatFiles and Trouble shoot issues - compressed files, delimited DataFrames options - Persist, Cache - usage scenarios Hive Tables - update/delete/incremental data process implementation Use VSCode/IntelliJ or similar Tools, compile jar files Python/R Install libraries Load Flat Files and Troubleshot delimiter issues Execute SQL/MDX Queries and Export to Flat Files Execute/Automate Curl and Shell commands Data Modeling Different levels of Normalization Analyze and decide on structure of data for both Reporting and Data-Lake Requirements Qualification : BE/B.Tech/MCA (or equivalent) 8+ years of relevant Technical Experience Please mail resumes at [HIDDEN TEXT] or whatsapp cvs to 7829710372

foundit