We are seeking an experienced DevOps Engineer to deliver insights from massive-scale data in real time. Specifically, we're searching for someone who has fresh ideas and a unique viewpoint, and who enjoys collaborating with a cross-functional team to develop real-world solutions and positive user experiences for every interaction.
Objectives of this role
Work with DevOps to run the production environment by monitoring availability and taking a holistic view of system health
Build software and systems to manage our Data Platform infrastructure
Improve reliability, quality, and time-to-market of our Global Data Platform
Measure and optimize system performance and innovate for continual improvement
Provide operational support and engineering for a distributed Platform at scale
Responsibilities
Define, publish and defend service-level objectives (SLO's)
Partner with data engineers to improve services through rigorous testing and release procedures
Participate in system design, Platform management and capacity planning
Create sustainable systems and services through automation and automated run-books
Proactive approach to identifying problems and seeking areas for improvement
Mentor the team in infrastructure best practices
Qualifications:
Bachelor's degree in Computer Science or an IT related field, or equivalent practical experience with a proven track record.
The following hands-on working knowledge and experience is
required
:
Kubernetes , EC2 , RDS,ELK Stack
Cloud Platforms (AWS, Azure, GCP) preferably AWS
Building & operating clusters
Related technologies such as Containers, Helm, Kustomize, Argocd
Ability to program (structured and OOP) using at least one high-level language such as Python, Java, Go, etc.
Agile Methodologies (Scrum, TDD, BDD, etc.)
Continuous Integration and Continuous Delivery Tools (gitops)
Terraform
Unix/Linux environments
Experience with several of the following tools/technologies is
desirable
:
Big Data platforms (eg. Apache Hadoop and Apache Spark)
Streaming Technologies (Kafka, Kinesis, etc.)
ElasticSearch
Service Mesh
Orchestration technologies, e.g., Argo
Knowledge of the following is