Job Description

Job Title: Data Engineer
Organization Name: NEC Corporation of India Ltd.
Reporting Relationship:
Required Skills

• Data Architecture
• Data Modelling and Design
• Data Storage and Operation
• SQL query development/building
• ETL using native SQL query

KEY RESPONSIBILITIES:

• Responsible for the Architecting systems architecture, design, and development of a large, scaled-out, real-time, high performing Data Lake / Data Warehouse systems (including Big data and Cloud)
• Requirements analyses and finalize in discussion with the customer
• Design, modelling based on the customer ecosystem based on the set the guidelines
• Convert the work package into modules and work closely to deliver the task
• Manage the team for the technical deliveries
• Creation of complex Queries to retrieving data from database using joins, Sub Queries, Correlated Sub-queries, and Hierarchical queries for data retrieval operations and converting into Views and materialized views based on business requirement.
• Creation of database objects like tables, indexes, views, Sequences, Synonyms, and constraints.
• Experience with application programs such as stored Procedures, Functions, Packages, cursors, collections, and triggers and materialized views using SQL and PL/SQL with exception handling.
• Develop Packages (SQL loader, Data pump, and Import/Export utilities) each to import data to Oracle base tables from external files like CSV, Excel, JSON and XML.
• Develop Shell Scripts for invoking SQL scripts and scheduled in using jobs.
• Performing Unit Testing and Performance Tuning for each program developed.
• Preparing below mentioned documents for each project;
• Prepare Requirement specification document
• Prepare Technical Design Document
• Coding and scripts documentations
• Supporting team for integration with apache Spark and other open source framework for data processing
• Well versed in the Data domains (Data Warehousing, Data Governance, MDM, Data Quality, Data Catalogue, Analytics, BI, Operational Data Store, Metadata, Unstructured Data, ETL, ESB)
• Responsible for installation and configuration of Databases, back up, restoring databases, setting up High Availability, Disaster recovery, performance tuning etc.
• Perform Relational Database Modeling and Database Design on different operating systems
• Responsible for PostgreSQL/MS SQL Database administration.
• Design and deploy high availability load balancing and DR in On-Premise as well in Cloud environment
• Design backup policy/template and configure overall database backup and recovery
• Database Performance tuning and optimization which includes Operating System-level parameters also.
• Responsible for Database migration from one platform to another
• Responsible for providing CDC solutions
• Responsible for Database middleware related work and coordinating with application and development team
• Responsible to deploy and manage No-SQL databases like Hadoop HDFS, Hive etc.
• Responsible for working on cloud infrastructures such as Azure and AWS
• Responsible for developing SQL administration or data ingestion script using shell/PowerShell, PL SQL T-SQL, and PL/SQL
• Design and Development of database migration strategy

Prerequisites
Bachelor's degree in computer science or a related field experience.

• Data Storage and Operation
• SQL query development/building
• ETL using native SQL query

Base Location: Noida
Specialization Description
Software Development Engineering (High Tech) focus on developing multiple types/categories of software including end-user applications and operating systems/utility software, that provides a platform for running end user applications for sale to external customers. The work includes:

• Conducting requirements gathering and analysis to understand the domain of the software problem and/or functionality, the interfaces between hardware and software, and the overall software characteristics
• Using programming, scripting, and/or database languages to write the software code
• Supporting software testing, deployment, maintenance, and evolution activities by correcting programming errors, responding to scope changes, and coding software enhancements
• Applying knowledge of software development best practices, including coding standards, code reviews, source control management, build processes, testing, and operations

Level Description
An experienced support level position that requires a basic knowledge of a given job area and tools, typically seen through work experience as well as vocational or technical training. Works under moderate supervision. Problems are typically of a routine nature, but may at times require interpretation or deviation from standard procedures. Communicates information that requires some explanation or interpretation to achieve business results for a given area of a department or function.