Senior Data Engineer
Year Bengaluru, Karnataka, India
Job Description
b'
Description Position Description/ Requirements The Data Engineer will be a part of an international team that designs, develops and delivers Data Pipelines and Data Analytics Solutions for Koch Industries. Koch Industries is a privately held global organization with over 120,000 employees around the world, with subsidiaries involved in manufacturing, trading, and investments. Koch Global Solution India (KGSI) is being developed in India to extend its IT operations, as well as act as a hub for innovation in the IT function. As KSGI rapidly scales up its operations in India, it\xe2\x80\x99s employees will get opportunities to carve out a career path for themselves within the organization. This role will have the opportunity to join on the ground floor and will play a critical part in helping build out the Koch Global Solution (KGS) over the next several years. Working closely with global colleagues would provide significant international exposure to the employees. The Enterprise data and analytics team at Georgia Pacific is focused on creating an enterprise capability around Data Engineering Solutions for operational and commercial data as well as helping businesses develop, deploy, manage monitor Data Pipelines and Analytics solutions of manufacturing, operations, supply chain and other key areas. A Day In The Life Could Include: (job responsibilities)
- Partner/collaborate with Business stakeholders and build high-quality end-to-end data solutions.
- Build a data architecture for ingestion, processing, and surfacing of data for large-scale applications in the cloud (AWS/ Azure)
- Create and maintain optimal data pipeline architecture.
- Follow best practices of Agile and DevOps focusing on the delivering of high-quality products and providing the ongoing support to meet the customers\' needs
- Implement processes for Continuous integration, Test automation and Deployment (CI/CD Pipelines)
- Provide quality documentation of your design (process and workflows) and implementation including experiment tracking / logs.
- Provide on-call support on an as-needed basis
- Handle support cases to ensure issues are recorded, tracked, resolved, and follow-ups finished in a timely manner.
Bachelor\xe2\x80\x99s degree in Engineering (preferably Analytics, MIS or Computer Science). Master\xe2\x80\x99s degrees preferred.- 6+ years of IT experience.
- In depth knowledge of Data Engineering concepts and platforms - SQL based systems, Hadoop, Spark, Distributed computing, In-memory computing, real time processing, pub-sub, orchestration, etc.
- Expertise of building data pipelines using (Pyspark based) and Databricks utilising techniques in Azure or AWS.
- 4-5 years of experience in DevOps and CI/CD using tools like Git, Terraform, Jenkins, Ansible.
- 5+ year of experience in Data modeling, SQL, Data Warehouse skills are a MUST.
- A passion and fearlessness for learning new technologies and methods in the areas of Administration
- Ability to thrive in a team environment and juggle multiple priorities.
- Excellent written and verbal communication skills.
- In depth knowledge of entire suite of services in AWS/Azure Cloud Platform.
- Strong coding experience using Pyspark.
- Experience of designing and implementing ETL process using SSIS.
- Cloud Data Anaytics/Engineering certification.
Other Considerations: (physical demands/ unusual working conditions)
- Some work may involve hours outside of normal KGS works hours.
Beware of fraud agents! do not pay money to get a job
MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.
Related Jobs
Job Detail
-
Job IdJD3038574
-
IndustryNot mentioned
-
Total Positions1
-
Job Type:Full Time
-
Salary:Not mentioned
-
Employment StatusPermanent
-
Job LocationBengaluru, Karnataka, India
-
EducationNot mentioned
-
ExperienceYear