AWS Data engineer
Anicalls (Pty) Ltd
Job Description
Candidate should have: Clear, concise communication abilities - writing, verbal, presentation - to all levels of technical and non-technical audiences with the ability to collaborate Strong experience in CICD technologies including Python, SQL, Airflow, and Git in a cloud setting
Understanding of ELK stack is a plus for logging and reporting purposes Experience with pyspark is preferred and building API’s Hands-on Experience in AWS data related services
Strong Python and object-oriented development skills Strong UNIX skills Redshift/Netezza DBA expertise and understanding
Advanced competencies in data modeling, modern data architecture, data masking, and manipulation of structured and unstructured data sources using state-of-art cloud computing technologies (AWS) Candidate should be able to: •Migrate from one data warehouse to AWS Redshift along with ETL components
•Collaborate with data engineers, software engineers, business leaders, and cross-functional stakeholders to implement data engineering •solutions based on business priorities and technology initiatives to ensure High Availability at enterprise scale. •creating rigorous system at enterprise scale in a dynamic work setting
•Create automated data flows for production settings with enterprise-level best practices, transparency, and scalability.