Job Description

:

Title: Cloud Architect (Senior Consultant / Project Manager)

Experience: 5+ years

Location: Gurgaon/Bangalore

Job Summary:

EXL is seeking a skilled and experienced AWS Architect to join our team. The architect will play a crucial role in designing, implementing and maintaining data and technology solutions that align with our client\xe2\x80\x99s business goals and objectives. This role requires a deep understanding of AWS data services, good understanding of AWS Infra & Ops services, and the ability to translate business requirements into scalable and efficient solutions.

Job Responsibilities: * Data Architecture and Cloud Strategy

• Develop and maintain a comprehensive data architecture and cloud strategy that aligns with the organization\'s goals and needs.
• Design, implement and manage cloud-based data infrastructure on AWS, ensuring scalability, reliability, and cost-efficiency.
• Utilize AWS services (S3, Glue, EMR, Redshift, Lambda, Kinesis, etc.) to build and optimize data pipelines and storage solutions.
• Champion the use of data warehouse architecture and optimize its performance for analytical and operational workloads.

• Data Engineering
• Guide data engineering teams to develop, maintain, and optimize ETL processes for data ingestion, transformation, and loading.
• Work with the data engineers to set up data integration and unification using Talend or any other ETL tool.
• Collaborate with data scientists and analysts to ensure data availability and quality, enabling effective analytics and reporting.

• Data Ingestion
• Architect and implement data integration solutions for API ingestion, enabling data from diverse sources to be captured, transformed, and ingested into our data warehouse.
• Manage data integration pipelines to support real-time and batch data processing.

• Workflow Orchestration
• Design, configure, and maintain workflow orchestration using Talend Management Console or Apache Airflow to automate ETL processes and data pipeline executions.
• Monitor and optimize job scheduling, error handling, and performance of data workflows.

• Security and Compliance
• Implement data security protocols, access controls, and encryption to safeguard sensitive data.
• Ensure compliance with data privacy regulations and industry standards.

• Collaboration and Documentation
• Collaborate with cross-functional teams to understand data requirements and provide data solutions to meet their needs.
• Maintain comprehensive documentation for data engineering and data architecture processes and solutions.

• Infra & Operations
• Guide the team in setting up cloud Infra and automations.
• Guide the operations team in setting up automated monitoring & alerts mechanism.

• Bachelor\'s or higher degree in a relevant field.
• 5+ years of proven experience in data engineering, cloud architecture, and AWS services.
• Extensive knowledge of data warehouse/data lake technologies, Redshift, Lambda, S3, Talend, Glue, Apache Airflow, Git.
• Strong expertise in programming languages like SQL, Python, and working experience in processing frameworks like PySpark etc.
• Strong expertise in real-time data processing.
• Excellent problem-solving and analytical skills.
• Strong communication and teamwork abilities.

EXL Service