Data Engineer - DataBricks, AWS
CGI
Job Description
Position Description:
We are seeking a highly skilled Data Engineer with 5+ years of experience in building scalable, high-performance data solutions. The ideal candidate will have strong expertise in Python, SQL, Databricks, and AWS, with hands-on experience designing modern data pipelines and Lakehouse architecture.This role requires a strong foundation in data engineering principles, cloud-native development, performance optimization, and business-aligned data solution design.
Your future duties and responsibilities:
• Design, develop, and maintain scalable data pipelines using Python and Databricks (Spark/Delta Lake)
• Build and optimize complex SQL queries for large datasets
• Develop ETL/ELT workflows to ingest, transform, and process structured and unstructured data
• Implement data quality validation, monitoring, and error-handling frameworks
• Design and maintain data models to support analytics and reporting needs
• Work with AWS services such as S3, Glue, Lambda, Redshift, EMR, or similar
• Optimize performance and cost efficiency of data processing workloads
• Collaborate with Data Analysts, Data Scientists, and business stakeholders to translate requirements into scalable data solutions
• Ensure data governance, security, and compliance standards are met
• Participate in Agile/Scrum ceremonies and contribute to technical discussions
Required qualifications to be successful in this role:
Must-Have Skills:
• 7+ Years of experience in Data Engineering or Software Development
• Strong hands-on experience in Python for data processing
• Strong expertise in SQL (query optimization, indexing, performance tuning)
• Experience with Databricks (Spark, Delta Lake)
• Experience working with AWS cloud services
• Experience building scalable ETL/ELT pipelines
• Solid understanding of data modeling concepts (dimensional modeling preferred)
• Experience working in Agile environments
* Strong Python programming
* Expertise in Apache Airflow, DAG Coding, Kafka
* Experience with REST API integrations
Good-to-Have Skills:
• Experience with orchestration tools (Airflow, Step Functions, etc.)
• Experience implementing CI/CD for data pipelines
• Exposure to data governance and metadata management practices
• Experience working in distributed or multi-time zone teams
• Domain knowledge in Healthcare, Finance, or Retail is a plus
#LI-AS26
CGI is an equal opportunity employer. In addition, CGI is committed to providing accommodation for people with disabilities in accordance with provincial legislation. Please let us know if you require reasonable accommodation due to a disability during any aspect of the recruitment process and we will work with you to address your needs.
Skills: