Lead Data Engineer who can drive the back bone of data platform. Key job responsibilities:
Drive the backbone of our data platform by building robust pipelines that turn complex data into actionable insights using AWS, Databricks platform
Be a data detective by ensuring our data is clean, accurate, and trustworthy
Write clean, efficient code that handles massive amounts of structured and unstructured data
Qualifications
Must be proficient in the major languages such as Scala and Kafka (any variant). Write elegant and maintainable code, and you need to be comfortable with picking up new technologies.
Proficient in working with distributed systems and have experience with different distributed processing frameworks that can handle data in batch and near real-time e.g. Spark etc.
Experience on working with various AWS services and Databricks to build end-to-end data solutions that bring different systems together
Stable work environmentOpportunity to work with a fast growing saas based organisation Tot Exp - 7+ Years Key skills - Python, Pyspark, databricks, kafka, AWS Candidates must be part of a core Data Engineering team within their current organization A cloud based fast growing SAAS organisation. Opportunity to work with fast growing cloud based saas organisation Hybrid work mode