Job Description

Talentica Software, started by industry veterans and ex- IITB grads, is a product engineering company that helps tech-native enterprises and startups turn their ideas into market-leading products. We deliver innovative, high-quality products at an accelerated pace by combining the product mindset of our human experts with the power of AI. Over the last 22 years, the company has worked with over 200+ startups, with most clients based in the US, ensuring many successful exits.



In 2022, Great Place to Work recognized Talentica Software as India's Great Mid-Size Workplace



What we're looking for?



We are looking for a highly skilled and experienced Data Engineer that will focus on leading the development, and implementation of our Data Warehouse/Lakehouse solution, ensuring it serves as the foundation for scalable, high-performance analytics.



With a deep technical expertise in data architecture, cloud-based data solutions, and modern analytics platforms, the data engineer will play a pivotal role in shaping our data infrastructure strategy and execution.

What you'll do? - Lakehouse Design & Implementation:

Lead the end-to-end development and deployment of a scalable and secure Lakehouse architecture.

Define best practices for data ingestion, storage, transformation, and processing using modern cloud technologies.

Architect data pipelines using ETL/ELT frameworks to support structured, semi structured, and unstructured data.

Optimize data modeling strategies to meet the analytical and performance needs of stakeholders.

Evaluate and select appropriate cloud technologies, frameworks, and architectures.

Data Pipeline Development & Optimization:

Develop and maintain efficient, automated data pipelines that integrate data from multiple sources (Oracle, BigQuery, MongoDB, Google Analytics, etc.).

Implement distributed data processing frameworks using tools like Apache Spark and Dataflow.

Ensure optimal query performance tuning and cost-effective cloud resource utilization.

Governance, Security, and Compliance:

Establish and enforce data governance policies, ensuring adherence to compliance regulations such as GDPR and CCPA.

Implement robust data access control and security measures across multi-tenant environments.

Define data lineage, cataloging, and metadata management to enable data democratization.

Continuous Improvement & Innovation:

Stay abreast of developments in cloud data platforms, AI integrations, and analytics technologies to drive innovation.

Evaluate and recommend emerging data technologies to enhance efficiency and scalability.

Lead Proof of Concepts (POCs) to validate new approaches and technologies.

To be successful in this role, you should have

Qualification:

BE/BTech in Computer Science, Data Engineering, or a related field from a top institute (like IIT, NIT, BITS, etc.).

Experience:

8-12 yrs of experience in data engineering, with a proven track record of implementing large-scale data solutions.

Skills

Extensive experience with cloud platforms (AWS, GCP, or Azure), specifically in data warehouse/lakehouse implementations.

Expertise in modern data architectures with tools like Databricks, Snowflake, or BigQuery.

Strong background in SQL, Python, and distributed computing frameworks (Spark, Dataflow, etc.).

Experience building high-volume, reliable data pipelines for real-time and batch processing.

In-depth knowledge of data modeling principles (e.g., Star Schema, Snowflake Schema).

Experience in enabling AI tools to consume data from the Lakehouse, including implementing semantic layers.

Strong understanding of data governance, security, and compliance frameworks.

Must-Haves

Must have experience with ETL/ELT frameworks

Data Processing Tools:

Apache Spark, Databricks, Airflow, Dataflow, dbt.

Programming & Scripting:

Python, SQL, Scala (advantage).

Database Systems:

Oracle, BigQuery, MongoDB.

CI/CD & Infrastructure as Code:

Git, Jenkins.

Security & Compliance:

Role-based access control (RBAC), encryption, data masking.

Understanding BI tools' data needs (Tableau, Power BI, Looker).

Excellent problem-solving abilities and strategic thinking mindset.

Strong leadership and collaboration skills to guide and influence technical teams.

Effective communication skills to present technical concepts to non-technical stakeholders.

Ability to work independently and manage multiple priorities in a fast-paced environment.

Nice to have

Good to have experience on cloud AWS/ Azure/GCP

What you'll find here?

A culture of innovation:

We only take up projects that challenge us to innovate. Our customers come to us for our technology expertise.

Endless learning opportunities:

Continuous learning is baked into our DNA. You'll always have the chance to learn new things and stay on top of the latest trends.

Talented peers:

Lead and Work alongside engineers from IITs, NITs, BITS, and other premier institutions.

Work-life balance:

We value work-life balance and offer flexible schedules, including remote work options, so you can thrive both professionally and personally.

A great culture:

Our employees love working here! 82% recommend Talentica to their friends, according to Glassdoor.. Join us, and you'll see why!

Recognition & rewards:

We don't just work hard, we celebrate success. Your contributions won't go unnoticed. We'll make sure you're recognized for the amazing work you do.

Ready to Make an Impact?

Fill out the lead form below, and we'll get in touch!