Outstanding analytical and problem-solving skills
Experience with Git, JIRA, Confluence
Experience in working on Linux OS.
Expert in Python, with knowledge of PySpark
Writing distributed data processing code with PySpark
Optimizing Spark jobs using DataFrames API and RDDs
Working with Spark SQL for querying large datasets (structured sql/mysql database)
Implementing UDFs (User Defined Functions) for custom transformations
Job Requirement
Ability to write robust code in Python o Outstanding analytical and problem-solving skills o Experience with Git, JIRA, Confluence o Experience in working on Linux OS. o Expert in Python, with knowledge of PySpark o Writing distributed data processing code with PySpark o Optimizing Spark jobs using DataFrames API and RDDs o Working with Spark SQL for querying large datasets (structured sql/mysql database) o Implementing UDFs (User Defined Functions) for custom transformations
Beware of fraud agents! do not pay money to get a job
MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.