Bangalore south - Uttarahalli or Bangalore North - Kalyan Nagar
What you'll do
Work as a lead engineer on customer projects, involving Confluent, Databricks, Clickhouse, Aerospike and a host of other data platform and infrastructure technologies
Put on a product hat, to help evolve a data platform suitable for marketing data in a complex landscape with multi-national conglomerates. Challenges intersecting data quality, lineage, real-time analytics and more
Work on building data pipelines, using Kafka, Flink, Spark and other technologies
Mentor junior engineers on the DBRX path
Participate in POCs, pre-sales and consulting assignments at large.
What you must bring
High degree of competence in Python (OR) Java/Scala stack, SQL and ETL/ELT(minimum). Deeper conceptual experience outside the notebook.
Solid concepts and understanding of Databricks stack, along with Spark, Delta Lake, Apache Iceberg and the broad spectrum of big data storage and processing technologies
Deep understanding of building enterprise grade data lakehouses (medallion architecture), but a POV on pata quality, lineage and catalogue
Stretch: Exposure to Docker, Kubernetes and infrastructure on the cloud. Be able to deploy and operate a stack to a reasonable extent
Stretch: ML Engineering and Ops.
* Stretch: Exposure to the Apache Kafka / Confluent, Flink and stream processing ecosystem
Beware of fraud agents! do not pay money to get a job
MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.