Data Engineer

Data Engineer (Streaming, Kafka, Databricks) Location: Bristol (3 days on‑site) Salary: £62,000 – £70,000 + 20% bonus, pension, 37-38 days holiday inluding bank holidays, Perkbox The Opportunity: This is a career‑defining Data Engineer role for someone who wants real ownership, real scale, and a clear path to senior‑level responsibility. We’re building and scaling a modern, real‑time data platform that processes over 1 billion records per month , and we’re looking for a Data Engineer who either: Is ready to step into a senior‑level role , or Is already operating at that level and wants more technical ownership rather than titles and hierarchy If you enjoy solving hard problems, designing systems that scale, and want a clear progression roadmap, this role is built for you. What You’ll Be Doing: Building high‑throughput streaming data pipelines Processing ~ 500 messages per second from real‑time data sources Working with Kafka on AWS , integrating Lambda and ECS Developing data pipelines using Databricks / PySpark Delivering time‑series data into ClickHouse Partnering closely with data scientists to support analytics and modelling Taking increasing ownership of design decisions as the platform evolves This is a hands‑on engineering role with scope to influence architecture as the data platform expands over the next 6–12 months.

Technology Stack: Core Python (production) Kafka (streaming data) Databricks or PySpark SQL (MySQL used internally) Cloud: AWS (experience with GCP or Azure also welcome) Nice to have: ClickHouse or time‑series databases MLflow IoT or high‑volume data environments Who This Role Is For This role is ideal if you: Are a strong Data Engineer looking to step up Want exposure to senior‑level responsibility without needing the title today Enjoy building systems rather than maintaining legacy platforms Want ownership, visibility, and influence in a growing team Are comfortable working in a high‑scale, real‑time environment Formal leadership or line management experience is not required , but there’s a clear pathway into increased technical and platform ownership. Progression Roadmap This role is designed to grow with you. In the first 6 months Own core streaming pipelines Become the go‑to engineer for key parts of the platform Contribute to architectural decisions Beyond 6–12 months Increased ownership of Databricks and streaming strategy Influence platform standards and best practices Natural progression into a senior‑level engineering role as the team scales Location & Working Pattern Bristol‑based 3 days per week on‑site (non‑negotiable) Flexible working on remaining days Salary & Benefits £62,000 – £70,000 base salary (depending on experience) 20% annual bonus Learning and development support Opportunity to work on genuinely large‑scale, real‑time systems If you need more information please contact me ,Kumbirai Mafini, [email protected]