Key Responsibilities:
- Design, develop, and optimize data pipelines for ingestion, cleaning, transformation, and storage of structured and unstructured data.
- Ensure the integrity and accessibility of data across various platforms and sources.
- Implement automated software testing frameworks to validate system performance, functionality, and security.
- Conduct regression testing, negative testing, and functional testing to maintain software reliability.
- Collaborate with development teams to integrate testing solutions into the software development lifecycle.
- Troubleshoot, debug, and refine processes to enhance efficiency and performance.
Qualifications:
- Proven experience in data engineering with expertise in pipeline architecture and data management.
- Strong knowledge of software testing frameworks and automation tools.
- Hands-on experience in regression and negative testing methodologies.
- Proficiency in programming languages like Python, SQL, or Java for data processing and testing automation.
- Familiarity with cloud-based data storage solutions (AWS, Azure, GCP) is a plus.
- Excellent problem-solving skills and attention to detail.