DevOps Engineer - Big Data Infrastructure

I’m interested


Leeds, UK

Seniority level


Workplace policy


Job description

Our data engineering teams together with data scientists are working on advanced systems capable of collecting and processing huge amounts of data, finding patterns, reasoning and acting faster than humans by using machine learning algorithms that can incrementally get smarter each time new data enters the system. We are a group of people passionate about the science 'behind the bet', always outcome-oriented and focused on solving real-world problems based on data and advanced analytics.


Your role in the team  

We are building a world-class Big Data platform that will give us the power to process streams of data and enable machine learning and advanced analytics capabilities. Everything cloud-based for scalability and speed to market.


As a DevOps Engineer for Big Data Infrastructure, you’ll be building infrastructure, tools and processes that will enable other teams and end-users to provide business value. You will take care of deployment automation, containerisation, distributed component integration, security, log aggregation, monitoring and troubleshooting of Big Data platform developed from scratch in-house. You will be working mainly with AWS cloud.



Skills needed:



  • Current hands-on experience of Amazon Web Services (AWS) and Kubernetes
  • Understanding of Infrastructure as a Code paradigm and hands-on experience with Terraform
  • Experience with Docker or other virtualisation technology
  • Experience CI/CD (preferably with Gitlab or Jenkins)



Nice to haves:


  • Experience with networking fundamentals, firewalls, load balancers, and across AWS account communication
  • Good understanding of cloud computing paradigm (distributed logging, service discovery, stateless applications, scaling, HA)
  • Experience with any scripting language (Bash, Python, etc.)
  • Experience in building pipelines for automating of applications scaffolding, testing, building, auto-scaling and integration


What we offer


We’ll Balance flexibility and performance together, giving you the tools you need to give us your best. And, we’ll offer you the chance to Belong, as part of a strong, winning team that spans the world.


We have welcomed our teams back to the office and have a balanced approach to office and home working.  Our employees have the opportunity to work from home up to 80% of the time with 20% of office time built in to ensure we get some face-to-face collaborative team time - and the chance for a coffee and a catch up!


We’ll welcome you on-board with an  individual training budget to allow you to develop your skills. You'll enjoy 33 days holiday including bank holidays (not to mention an extra day for your birthday),a rewarding bonus scheme, healthcare, an attractive pension package and benefits scheme.


Plus, our season ticket loan and handy Metro Card loan will save you money getting to work and getting around town. And if you see the journey to work as part of your fitness regime, you’ll just love our Cycle to Work scheme.