Senior Azure Data Engineer
Black Piano
Job Description
Role Overview The engineer will be working within an established Microsoft Fabric data platform, supporting the delivery of a large number of data transformation workflows. The platform is already built - the focus is on high-quality, fast execution of flow-specific development within an existing architecture. This role suits mid-level engineers who are hands-on, productive, and able to work independently as part of a wider team.
Core Technical Requirements (Must-Have) PySpark – essential Microsoft Fabric and/or Databricks (hands-on, production use) Notebook-based development (Fabric / Synapse / Databricks) Strong data pipeline development experience (ETL / ELT) Experience working within Medallion architecture (Bronze / Silver / Gold) Understanding of good coding practices (readability, structure, maintainability) Azure ecosystem experience preferred Experience working CRM systems Experience & Profile 2–5 years’ experience (mid-level) Able to work independently on defined user stories Comfortable working as part of a collaborative delivery team Not looking for architects or junior profiles Energy/utilities / MHHS experience – nice to have Scope of Work Deliver PySpark-based development against defined requirements Work within an existing Fabric-based architecture Amend and extend existing pipelines (not building from scratch) Support optimisation, fixes, and enhancements Contribute to data transformation logic for multiple data flows Support export of data to downstream systems Ways of Working Highly collaborative and interactive role Regular engagement with internal stakeholders (technical and business) Strong communication skills required Working full-time in UK hours