Data Engineer
Talentgigs
Job Description
JOB Description : Role: Senior Data Engineer Location: Chennai / Bengaluru Work Mode : Hybrid Notice Period: Immediate to 15 days Years of Exp: 6+ Years About the Role :We are looking for a highly skilled Senior Data Enginee r with ML to design, build, and operate reliable, scalable, and cost-efficient data pipelines. This role focuses on production-grade data systems using Pytho n and modern orchestration tools, with strong collaboration across Data Science and analytics teams You will play a key role in enabling high-quality, well-governed, and discoverable data across the organization . Key Responsibilitie Data Pipeline Engineering Design, build, and maintain robust, scalable data pipelines usin g Python Develop and manage orchestration workflows usin g Apache Airfl ow / Google Cloud Composer.
Ensure high availability, fault tolerance, and performance of data workflows wsImplement monitoring, alerting, and observability best practices. Production Operations & Reliability Own scheduling, monitoring, and incident management for data pipelines Ensure SLAs and data freshness requirements are met Implement proactive quality checks and validation frameworks Optimize pipelines for performance and cost-efficiency in cloud environments Data Governance & Collaboration Define and enforc e data contrac ts across producers and consume Contribute to and maintain a data catalog Partner closely with Data Science and Analytics teams for schema alignment, data discovery, and pipeline optimization Support reproducibility and transparency of datasets used in modeling Cloud & Architecture Work withi n Google Cloud Platform (GC P) environments Design cost-aware architectures and storage strategies Improve CI/CD, version control, and deployment workflows for data systems .Required Skills & Experience Strong proficiency i n Pytho n with ML Deployment (must) Hands-on experience wit h Apache Airfl ow and/o r Google Cloud Composer Experience building and maintaining production data pipelines Strong understanding of Workflow orchestration (Airflow) Monitoring & alerting Data quality frameworks Scheduling & dependency management Experience with cloud platforms (preferabl y G CP) Solid understanding of data modeling and pipeline design principle Experience implementing or working wit h data contract Exposure t o data catalogs and metadata management. Strong operational mindset with focus on reliability and maintainability