Job Description

Company Overview

Company Overview

Incedo is a US-based consulting, data science and technology services firm with over 2,500 people helping clients from our six offices across US and India. We help our clients achieve competitive advantage through end-to-end digital transformation. Our uniqueness lies in bringing together strong engineering, data science, and design capabilities coupled with deep domain understanding. We combine services and products to maximize business impact for our clients in telecom, financial services, product engineering and life science & healthcare industries.
br
Working at Incedo will provide you an opportunity to work with industry leading client organizations, deep technology and domain experts, and global teams. Incedo University, our learning platform, provides ample learning opportunities starting with a structured onboarding program and carrying throughout various stages of your career. A variety of fun activities are also an integral part of our friendly work environment. Our flexible career paths allow you to grow into a program manager, a technical architect or a domain expert based on your skills and interests.

Role Description

Role Description: AWS Data Engineer and AWS Data Architect
The ideal candidate is a hands-on technology efficient frameworks for development and testing using (AWS Dynamo DB, EKS, Kafka, Kinesis/Spark/Streaming/Python) to enable seamless data ingestion to process on to the Hadoop platform. They must be at ease working in an agile environment with little supervision. The person should be a self-motivated person with a passion for problem solving and continuous learning.
Role and responsibilities

• Should be able to create Project Technical Documentation
• Designing Solution architecture, and work on Data Ingestion, Preparation and Transformation. Debugging the production failures and identifying the solution.
• Developing efficient frameworks for development and testing using (AWS Dynamo DB, EKS, Kafka, Kinesis/Spark/Streaming/Python) to enable seamless data ingestion to process on to the Hadoop platform.
• Enabling Data Governance and Data Discovery on Cloud Platform
• Building data processing framework using Spark, Glue, pyspark, Kinesis
• Exposure of Data Security Framework on AWS Cloud
• Exposure of Data Pipeline Automation using DevOps tools (CI/CD) or CDK/CloudFormation
• Exposure of Job Monitoring framework on AWS Cloud CloudWatch/ELK
• Exposure of handling structured, Un Structured, Semi Structure and Streaming data.

Technical skills requirements
The candidate must demonstrate proficiency in,

• Solid hands-on data Solutioning experience in Big-Data Technologies (AWS preferred)
• Hands on experience in: AWS Dynamo DB/RDS, EKS, Kafka, Kinesis, Glue, EMR, RedShift
• Hands-on experience of programming language like Python with Spark.
• Hands-on experience on Data Ingestion framework/tools i.e Apache Airflow, Sqoop, Glue, Informatica
• Hands on working experience of data processing at scale with event driven systems, message queues (Kafka/ Flink/Spark Streaming)
• Hands on working Experience with AWS Athena
• Data Warehouse exposure on AWS Redshift spectrum
• Operationalization of ML models on AWS Data pipeline
• Feature Engineering/Data Processing to be used for Model development
• Experience gathering and processing raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.)
• Experience building data pipelines for structured/unstructured, real-time/batch, events/synchronous/ asynchronous data

Nice-to-have skills

• Knowledge on AWS serverless architecture
• Exposure to various ETL and Business Intelligence tools
• Experience in data warehouse design and best practices
• Scripting: Unix or Shell scripting

Qualifications

• A bachelor\'s degree in computer science, computer engineering, or a related discipline is required to work as a technical lead
• AWS Certified Solution Architect - Associate
• AWS Certified Solution Architect - Professional
• Certification on AWS would be a big plus!
• Individuals in this field can further display their leadership skills by completing the Project Management Professional certification offered by the Project Management Institute.

Company Value

Company Value

We are an Equal Opportunity Employer. We value diversity at Incedo. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Incedo