Data Engineer

Number of employees

3800

London, UK, United Kingdom

Posted on: 2024-03-23

Category: energy

Apply now

Please let Octopus Energy know you found this job on Work in Green. This will help us grow!

Employment type:

Full time

Experience required:

Intermediate

Salary

Salary not provided

About the company:

We're on a mission to make a big green dent in the universe by building a truly sustainable energy system globally.

That means making power greener, smarter, and more affordable for everyone.

We put customers at the heart of everything we do: with always-fair prices, transparency and outrageous customer service.

We drive system change: with transformative tech to make renewable energy the norm and end global reliance on fossil fuels.

Octopus Energy Group is made up of 10 businesses spanning 6 countries across 3 continents, including: Octopus Energy Retail, Kraken Technologies, Octopus Energy Generation, Kraken Flex, Octopus Electric Vehicles, and the Octopus Centre for Net Zero. More on OEG @ octopusenergy.group

Kraken is the technology tentacle of the Octopus Energy Group. 

About our Data Platform Team

At Kraken we've developed a data platform that that is used by Octopus Energy and our other clients retail energy businesses around the world. The platform empowers users with self-service data analytics and automates our data processing workflows, from simple ETL jobs to ML training and prediction.

The data platform team works across the whole customer domain on anything from natural language understanding of our customer communications to processing billions of smart meter readings every day to support clients in creating customised and market leading smart energy tariffs.

As the volume, scope and geographical range of our data offerings rapidly expand, we're looking for an experienced data engineer to join the team to help us build and maintain our platform, pipelines and data sources.

We're passionate about building great technology to change the way customers use, and think about, energy for the good of the planet. This is a fantastic opportunity to work with us on data problems that genuinely move us closer to Net Zero, and support the energy transition.

We would prefer someone who can work in our London office but will consider remote candidates (warning: the bar is much higher). You do need to be able to work in the UK without a VISA though.

Above all, we’re looking for someone who thrives on providing alternative opinions, challenging those around them and being challenged.

If this sounds like you then we'd love to hear from you.

Studies have shown that some groups of people, like women, are less likely to apply to a role unless they meet 100% of the job requirements. Whoever you are, if you like one of our jobs, we encourage you to apply as you might just be the candidate we hire. Across Octopus, we're looking for genuinely decent people who are honest and empathetic. Our people are our strongest asset and the unique skills and perspectives people bring to the team are the driving force of our success. As an equal opportunity employer, we do not discriminate on the basis of any protected attribute. Our commitment is to provide equal opportunities, an inclusive work environment, and fairness for everyone.

What you'll do...

  • Build new data sources and data pipelines that deliver key data and insights to the business
  • Work closely with the data science and analytics teams to maintain and develop our central data models in dbt
  • Build and maintain testing and documentation frameworks for our data sources
  • Work with the business to scope and deliver new data engineering projects and requirements
  • Maintain and build on our existing data infrastructure and tools
  • Support the internationalisation of our data infrastructure as we continue to grow globally
  • What you'll have...

  • First and foremost, we want our data engineers to be great software engineers with a passion for writing high quality code. It would be helpful to have experience/expertise in the following (in rough priority order): 
  • Python
  • SQL
  • Spark
  • Experience modelling data for analytics - ideally experience using dbt as a modelling tool
  • Experience in assuring data quality
  • Experience deploying data services in a cloud environment (ideally AWS)
  • The projects will be varied and we’re looking for someone who can work autonomously and proactively to scope problems and solve and deliver pragmatic solutions
  • Our Data Platform Stack...

  • Databricks our datalake approach
  • Spark for data processing
  • Python as our main programming language
  • Kubernetes for data services and task orchestration
  • dbt for data modelling
  • Airflow purely for job scheduling and tracking
  • Circle CI for continuous deployment
  • Parquet and Delta file formats on S3 for data lake storage
  • SparkSQL for analytics
  • Streamlit for data applications
  • Why else you'll love it here

  • Wondering what the salary for this role is? Just ask us! On a call with one of our recruiters it's something we always cover as we genuinely want to match your experience with the correct salary. The reason why we don't advertise is because we honestly have a degree of flexibility and would never want salary to be a reason why someone doesn't apply to Octopus - what's more important to us is finding the right octofit!
  • Octopus Energy is a unique culture. An organisation where people learn, decide, and build quicker. Where people work with autonomy, alongside a wide range of amazing co-owners, on projects that break new ground. We want your hard work to be rewarded with perks you actually care about! We won best company to work for in 2022, on Glassdoor we we're voted 50 best places to work in 2022 and our Group CEO, Greg has recorded a podcast about our culture and how we empower our people 
  • Visit our perks hub - Octopus Employee Benefits
  • Similar climate jobs

    These are some of our top picks for great climate jobs on Work in Green.

    View all jobs
    Natron Energy logo
    United States
    Number of employees

    100

    Full time
    Energy
    Arcadia logo
    United States
    Breathe Battery Technologies logo
    United Kingdom
    Antora Energy logo
    United States
    Number of employees

    30

    Full time
    Energy

    467 Energy jobs at Octopus Energy

    Octopus Energy is hiring Aufmaßtechniker*in Wärmepumpenplanung (m/w/d),Responsable d'entrepôt - lancement de la filiale solaire,Area Manager - Low Carbon Heating - Bristol, and more.

    View all jobs at Octopus Energy