The Role of a Data Engineer
We are seeking an experienced Data Engineer to join our team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining data pipelines and workflows using Apache Airflow for efficient data ingestion, transformation, and loading into the CMDB.
Key Responsibilities:
- Design and develop data pipelines and workflows using Apache Airflow
- Develop and optimize PL/SQL queries and stored procedures for data manipulation and retrieval within the CMDB environment
- Utilize NoSQL databases for handling and processing large volumes of configuration data
- Integrate data from various sources into the CMDB using MuleSoft and other integration platforms
- Conduct data reconciliation activities to ensure data accuracy and consistency across multiple systems and sources
- Develop and implement inventory data models based on the Common Information Model (CIM) to accurately represent IT assets and their relationships
- Design and implement Extract, Transform, and Load (ETL) processes to populate and update the CMDB with accurate and up-to-date information
Requirements:
- Proven experience in data engineering and data modeling
- Strong understanding of Service Asset and Configuration Management (SACM) principles and best practices using Systems such as Microfocus Asset Manager, Peregrine Asset Center or similar
- In-depth knowledge of the Common Information Model (CIM) from DMTF.org
- Proficiency in Apache Airflow for workflow orchestration and automation
- Experience working with NoSQL databases (e.g., MongoDB)
- Hands-on experience with MuleSoft or other integration platforms
- Strong data reconciliation and data quality management skills
- Expertise in inventory data modeling and implementation
- Solid understanding of Extract, Transform, and Load (ETL) processes using different Tooling
- Basic Anchor Modelling Skills
- Fuency in English is mandatory, basic knowledge of German is a must