Job Description

Join us as a Data Engineer

You'll be a recognised specialist driving the design, implementation, and optimisation of Elasticsearch clusters to deliver high-performance, scalable, and reliable search and analytics solutions that support our business needs If you're ready for a new challenge and want to make a far-reaching impact through your expertise in Elasticsearch and AWS, this could be the opportunity you're looking for

What you'll do

------------------


As a Data Engineer, you'll simplify our search infrastructure by developing and managing Elasticsearch clusters on AWS. You'll apply your knowledge to deliver robust, scalable, and secure search and analytics platforms, collaborating across teams to ensure seamless integration and high availability. You'll also drive customer value by understanding complex business needs related to search, analytics, and observability, and by applying best practices in cluster design, performance tuning, and disaster recovery.


As well as designing and managing large-scale Elasticsearch clusters on AWS, including cluster setup, node configuration, and architecture definition, you'll be responsible for integrating Elasticsearch with AWS services such as EC2, EKS, and S3 to develop resilient search and observability solutions. You'll also be optimising cluster performance, scalability, and fault tolerance by applying best practices in indexing, querying, and resource management.


Furthermore, your responsibilities will include:

Analysing and resolving performance bottlenecks including slow queries and memory issues Leading upgrade and patch management to ensure security and minimal downtime Defining and implementing disaster recovery strategies including backup and restore procedures Establishing monitoring and alerting solutions to proactively identify and resolve issues Collaborating closely with DevOps, infrastructure, and data teams to ensure smooth and scalable operations Mentoring and supporting team members on Elasticsearch best practices

The skills you'll need

--------------------------


To thrive in this role, you'll need a strong understanding of Elasticsearch cluster management and AWS services integration, alongside a solid foundation in data engineering principles. You'll have proven experience designing, implementing, and optimising Elasticsearch clusters, preferably in AWS environments and you'll have knowledge of Elasticsearch indexing, querying, resource management, and performance tuning.


Additionally, you'll need:

Experience with AWS services such as EC2, EKS, S3, and lambda and how they integrate with Elasticsearch The ability to analyse and troubleshoot cluster issues including query performance and memory management Experience leading upgrade, patching, and disaster recovery processes Familiarity with monitoring tools and alerting frameworks for Elasticsearch clusters Strong communication skills with the ability to proactively engage and manage a wide range of stakeholders * An understanding of modern infrastructure as code development and automation practices