Senior Pyspark Developer

Year    TN, IN, India

Job Description

Project description



We need a Senior Pyspark Developer to work for a leading investment bank client in Trade Surveillance Team.


Responsibilities




Develop software applications based on business requirements


Maintain software applications and make enhancements according to project specifications


Participate in requirement analysis, design, development, testing, and implementation activities


Propose new techniques and technologies for software development.


Perform unit testing and user acceptance testing to evaluate application functionality


Ensure to complete the assigned development tasks within the deadlines


Work in compliance with coding standards and best practices


Provide assistance to Junior Developers when needed.


Perform code reviews and recommend improvements.


Review business requirements and recommend changes to develop reliable applications.


Develop coding documentation and other technical specifications for assigned projects.


Act as primary contact for development queries and concerns.


Analyze and resolve development issues accurately.


Skills




Must have


8+ years of experience in data intensive Pyspark development.


Experience as a core Python developer.


6 month+ exp. in Gen/Agentic AI


Experience developing Classes, OOPS, exception handling, parallel processing .


Strong knowledge of DB connectivity, data loading , transformation, calculation.


Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregations.


Lambda Functions, Decorators.


Vector operations on Pandas dataframes /series.


Application of applymap, apply, map functions.


Concurrency and error handling data pipeline batch of size [1-10 gb].


Ability to understand business requirements and translate them into technical requirements.


Ability to design architecture of data pipeline for concurrent data processing.


Familiar with creating/designing RESTful services and APIs.


Familiar with application unit tests.


Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services.


Debugging application.


Nice to have


Knowledge of web backend technology


Django, Python, PostgreSQL.


Apache Airflow


Atlassian Jira


Understanding of Financial Markets Asset Classes (FX, FI, Equities, Rates, Commodities & Credit), various trade types (OTC, exchange traded, Spot, Forward, Swap, Options) and related systems is a plus


Surveillance domain knowledge, regulations (MAR, MIFID, CAT, Dodd Frank) and related Systems knowledge is certainly a plus


Other




Languages


English: C2 Proficient


Seniority


Senior



Chennai, India


Req. VR-120571


Python


BCM Industry


29/01/2026


Req. VR-120571

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD5168547
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    TN, IN, India
  • Education
    Not mentioned
  • Experience
    Year