Senior Data Engineer (Contract)
NES Fircroft
Job Description
Your roleOur major Oil & Energy Client is looking for a Senior Data Engineer who will be accountable for designing, building, optimizing, and supporting scalable, reliable, and governed data solutions that enable operational excellence, analytics, and decision-making across LNG trading and operations. This a senior individual contributor with strong hands-on expertise across data engineering, data integration, and data platform delivery, combined with the ability to partner effectively with business and IT stakeholders in our Client's LNG business.Data Engineering & Platform DeliveryDesign, build, and implement robust data pipelines, lakehouse patterns, and integration solutions capable of handling high volume, velocity, and variety of dataDeliver optimized and performance-driven data solutions using cloud-native and modern data engineering practicesDevelop POCs, prototypes, and production-grade solutions, including complex SQL queries and large-scale data processing. Apply performance optimization techniques using PySpark, SQL, and distributed data processing frameworks.Data Integration & Interface ManagementDesign, build, and maintain data interfaces between the Client's LNG applications, enterprise platforms, legacy systems, and external partnersManage complex cloud-to-legacy and event-driven integration scenarios using scalable pipelines and streaming technologiesSupport day-to-day operational stability of data flows, including incident analysis, troubleshooting, and resolution in line with the Client's support processes.Data Lineage, Quality & ControlsDefine, document, and maintain end-to-end data lineage across upstream source systems and downstream consumersImplement data quality controls, validation rules, and exception handling aligned with the Client’s governance, risk, privacy, and security frameworksContribute to enterprise data initiatives such as data catalogues, master data management, and metadata management.Collaboration & Stakeholder EngagementAct as a data engineering subject-matter expert, working closely with business stakeholders, product owners, architects, and delivery teamsSupport backlog refinement, solution estimation, technical design, and release planning within Agile delivery frameworksPromote data engineering best practices, standards, and reusability across teams.Operational Excellence & Continuous ImprovementDrive improvements in reliability, observability, scalability, and performance of data pipelinesIdentify opportunities for simplification, standardization, and modernization within the data and integration landscapeContribute to functional excellence through the definition and maintenance of standards, methods, tooling, and patterns.
You are what we are looking for if you:Have 8–10+ years of relevant experience in Data Engineering and Data Integration rolesHave proven experience delivering enterprise-grade data platforms and pipelines in cloud environmentsAre an expert in Azure, Azure Data Factory (ADF), data pipelines, Azure Data Lake Storage (ADLS), Databricks, PySpark, Python, and Kafka, with working knowledge of databases including Cosmos DB and MongoDBAre proficient in data modellingHave experience implementing performance optimization techniques using PySpark and SQLHave experience working with source control technologies (e.g., GitHub, Azure DevOps) and with build and release pipelinesHave hands-on experience delivering digital solutions such as enterprise data platforms, and rolling out and setting up Master Data Management, Data Catalogue, and analytics solutions to support business decision-makingHave experience working in Agile teams, applying best patterns and practices with an eye for quality and standardsHave experience with Microsoft Power Platform, specifically Power AutomateAre a Databricks Certified Associate / Professional Data Engineer (preferred)Have experience with LNG business stakeholders and data products (preferred)