Job Description

Overview:
TekWissen Group is a workforce management provider operating throughout India and several other countries worldwide. The client below is a leading technology company offering a range of IT solutions to businesses and organizations, enabling them to transform their digital futures
Position: Senior Consultant, Data Engineering
Location: Hyderabad
Duration: 24 Months
Job Type: Contract
Work Type: Hybrid
:
Database Expertise:

• Strong hands-on experience with Greenplum, Teradata, MongoDB, and Oracle for data modelling, querying, and performance optimization.

Streaming & Real-Time Data:

• Proficient in Apache Kafka for building and managing real-time data streaming pipelines.

Data Integration & ETL Tools:

• Informatica: Experience with HTTP Transformation for REST APIs, XML Transformation, and OAuth-based authentication.
• StreamSets: Skilled in using components like HTTP Client Processor with OAuth2 authentication for API integration.

Big Data & Lakehouse Technologies:

• Strong development experience with PySpark for distributed data processing.
• Familiarity with Apache Iceberg for managing large-scale, transactional datasets in Lakehouse architectures.

Scripting & Automation:

• Advanced scripting skills in Python and Unix/Linux shell for automation, data manipulation, and workflow management.
• Proven ability to debug and promote fixes under high-priority scenarios.

Data Replication:

• Basic working knowledge/Understanding of Oracle Goldengate and CDC frameworks for data replication across heterogeneous systems.

Workflow Orchestration:

• Experience with Control-M and Apache Airflow for scheduling, monitoring, and managing complex/custom data workflows.

Cloud & DevOps:

• Familiarity with CI/CD tools and AWS ECS for containerized deployments and continuous integration.

Soft Skills:

• Strong problem-solving and debugging capabilities.
• Flexible and dependable in supporting teams during critical issue resolution and extended hours when needed.

Mandatory Skills:

• Database Expertise: Primary (Greenplum & Teradata)
• Data Integration & ETL Tools: Primary
• Streaming & Real-Time Data: Primary
• Scripting & Automation: Primary
• Workflow Orchestration: Secondary
• Cloud & DevOps: Secondary
• Big Data & Lakehouse Technologies: Secondary
• Data Replication: good to have
• Soft Skills: good to have

Experience:

• Total Exp: 15 years
• Rel Exp: 15+ years

TekWissen Group is an equal opportunity employer supporting workforce diversity.

Skills Required