Job Description

Position Sr. Data Engineer Analyst Position 1 Department Digital Technology Department Enterprise Architecture, Data & Integration Reporting to Data Architect & Delivery Lead Reporting to 3 Location Gurgaon Location Gurgaon Job summary: As a Sr. Data Engineering Analyst, you will be part of Enterprise Architecture team focusing on driving innovation, improving delivery effectiveness and enhancing the overall availability and accessibility of data and information to business. You will be responsible for building hybrid solutions on-prem and cloud lakehouse architecture with seamless integrations across multiple customer facing digital assets, back-end systems and external sources. You bring deep technical expertise in designing and delivering end to end high performance, scalable, secure & flexible data platforms, EDW, ETL, MDM, Data Quality, micro services, data Integration solutions using cutting edge/emerging technologies including cloud native and agnostic platforms. You will work with the direction from Data Engineering / BI Lead and Enterprise Architects to co-create solutions with the rest of the digital technology, MIS and AI/ML delivery teams . Key responsibilities: Engineer and lead delivery to support enterprise MIS, Analytics, AI and intelligent business processing from data perspective in alignment with EA guidelines, patterns and standards. Undertake detailed analysis of the information management requirements across all systems, platforms & applications to guide the development of info. management standards Lead the low level design of the information architecture, across multiple data types working closely with various business partners/consumers, MIS team, AI/ML team and other departments to design, deliver and govern future proof data assets and solutions Define, design, develop and maintain organization data models that meet immediate and future needs Ensure data is treated as an asset across the MLI ecosystem through establishing right governance & curation, data quality and master data management processes and tooling. Perform code reviews to ensure best practices and standards are followed in data projects. Propose and build cost effective data solutions on AWS cloud. Other responsibilities: Provide technical expertise in solving/troubleshooting performance & other non-functional requirements Provide ongoing guidance to project teams on impacted information flows & ensure alignment to overall information architecture Collaborate with ecosystem partners to identify synergies across information flow & management & information architecture Experiment, explore and demonstrate application of new technologies by means of conducting quick prototypes to solve business problems. Focus on continuous service improvement and thought leadership, drive strategic initiatives to help business and partners to achieve their goals Key competencies/skills required Deep understanding of the data and information architecture discipline, processes, concepts and best practices Proven architecture modelling skills, strong analytics and reporting experience Strong Data Design, management and maintenance experience Strong experience on Spark, Sql, EMR. Hands on expertise in building and implementing data pipelines using pyspark. Extensive experience in areas of cloud native lake technologies e.g. AWS Native Lake Solution Understanding of BFSI domain, Open Architecture and application integration discipline, concepts and best practices Define cost control mechanisms by suggesting architectural changes & optimizing resource utilization Desired qualifications and experience: B.E / MCA from a reputed institute 4 - 6 years of experience with hands on big data technologies like spark, EMR, exposure to CDC tools, experience in implementation of data warehousing and data lake solutions on-premises and on-cloud (preferable AWS Native Lake Platform and services, Glue, EMR, DMS etc.) 5+ years of hands-on experience on - Relational Database, NoSQL, Hadoop, SPARK, EMR, and real-time data streaming tools (Kafka, kinesis) etc. Should have architected and delivered at least 3+ EDW, Data Lake projects 4+ experience of designing and modernizing existing data stores/EDW on cloud platform Experience in Insurance and BFSI domain is a plus Experience in presenting data architecture for specific business needs to peers and senior management Should be working or should have worked with reputed organizations or startups Position Sr. Data Engineer Analyst Position 1 Department Digital Technology Department Enterprise Architecture, Data & Integration Reporting to Data Architect & Delivery Lead Reporting to 3 Location Gurgaon Location Gurgaon Job summary: As a Sr. Data Engineering Analyst, you will be part of Enterprise Architecture team focusing on driving innovation, improving delivery effectiveness and enhancing the overall availability and accessibility of data and information to business. You will be responsible for building hybrid solutions on-prem and cloud lakehouse architecture with seamless integrations across multiple customer facing digital assets, back-end systems and external sources. You bring deep technical expertise in designing and delivering end to end high performance, scalable, secure & flexible data platforms, EDW, ETL, MDM, Data Quality, micro services, data Integration solutions using cutting edge/emerging technologies including cloud native and agnostic platforms. You will work with the direction from Data Engineering / BI Lead and Enterprise Architects to co-create solutions with the rest of the digital technology, MIS and AI/ML delivery teams . Key responsibilities: Engineer and lead delivery to support enterprise MIS, Analytics, AI and intelligent business processing from data perspective in alignment with EA guidelines, patterns and standards. Undertake detailed analysis of the information management requirements across all systems, platforms & applications to guide the development of info. management standards Lead the low level design of the information architecture, across multiple data types working closely with various business partners/consumers, MIS team, AI/ML team and other departments to design, deliver and govern future proof data assets and solutions Define, design, develop and maintain organization data models that meet immediate and future needs Ensure data is treated as an asset across the MLI ecosystem through establishing right governance & curation, data quality and master data management processes and tooling. Perform code reviews to ensure best practices and standards are followed in data projects. Propose and build cost effective data solutions on AWS cloud. Other responsibilities: Provide technical expertise in solving/troubleshooting performance & other non-functional requirements Provide ongoing guidance to project teams on impacted information flows & ensure alignment to overall information architecture Collaborate with ecosystem partners to identify synergies across information flow & management & information architecture Experiment, explore and demonstrate application of new technologies by means of conducting quick prototypes to solve business problems. Focus on continuous service improvement and thought leadership, drive strategic initiatives to help business and partners to achieve their goals Key competencies/skills required Deep understanding of the data and information architecture discipline, processes, concepts and best practices Proven architecture modelling skills, strong analytics and reporting experience Strong Data Design, management and maintenance experience Strong experience on Spark, Sql, EMR. Hands on expertise in building and implementing data pipelines using pyspark. Extensive experience in areas of cloud native lake technologies e.g. AWS Native Lake Solution Understanding of BFSI domain, Open Architecture and application integration discipline, concepts and best practices Define cost control mechanisms by suggesting architectural changes & optimizing resource utilization Desired qualifications and experience: B.E / MCA from a reputed institute 4 - 6 years of experience with hands on big data technologies like spark, EMR, exposure to CDC tools, experience in implementation of data warehousing and data lake solutions on-premises and on-cloud (preferable AWS Native Lake Platform and services, Glue, EMR, DMS etc.) 5+ years of hands-on experience on - Relational Database, NoSQL, Hadoop, SPARK, EMR, and real-time data streaming tools (Kafka, kinesis) etc. Should have architected and delivered at least 3+ EDW, Data Lake projects 4+ experience of designing and modernizing existing data stores/EDW on cloud platform Experience in Insurance and BFSI domain is a plus Experience in presenting data architecture for specific business needs to peers and senior management Should be working or should have worked with reputed organizations or startups

foundit