Team Leader - Software

Responsibilities

• Design, develop, and optimise data pipelines using Snowflake services
• Work extensively with Snowflake Internal and External Stages for secure data loading and unloading
• Develop and manage data ingestion processes using: COPY INTO commands, File formats, Snowpipe if applicable, Data loading from internal stages
• Develop complex SQL queries, stored procedures, tasks, streams, and performance tuning
• Ensure data quality, integrity, and security across systems
• Collaborate with cross functional teams including analysts, BI developers, and stakeholders
• Use Python for data transformation, automation, and scripting tasks
• Implement and manage CI/CD pipelines using GitLab CI/CD for automated deployment of data solutions
• Maintain version control and manage code repositories using GitLab
• Work with orchestration tools
• Monitor, troubleshoot, and optimise data pipeline performance issues