Data Engineer

Job Title: Data Engineer Location: Bengaluru Work Mode: Hybrid / Work from Office Travel Requirement: Initial 4 weeks onboarding and collaboration from Hyderabad office Experience: 4+ Years Employment Type: Full-Time About the Role We are looking for a skilled Data Engineer with strong expertise in AWS, Python, PySpark, and SQL to design, develop, and optimize scalable data pipelines and data processing solutions. The ideal candidate will have experience working with large datasets, cloud-based data platforms, and modern data engineering practices. Key Responsibilities Design, develop, and maintain scalable ETL/ELT pipelines.

Build and optimize data processing workflows using PySpark. Develop robust data solutions using Python and SQL. Work with AWS services to build cloud-native data platforms.

Integrate data from multiple sources and ensure data quality and reliability. Optimize data storage, processing, and query performance. Collaborate with Data Scientists, Analysts, and Business Teams to understand data requirements.

Implement data governance, security, and best practices. Troubleshoot and resolve data pipeline and performance issues. Participate in code reviews and contribute to continuous improvement initiatives.

Required Skills Strong experience in Python development. Hands-on experience with PySpark and distributed data processing. Advanced SQL skills for data extraction, transformation, and analysis.

Experience with AWS cloud services such as S3, Glue, EMR, Lambda, Redshift, Athena, or similar. Strong understanding of ETL/ELT frameworks and data warehousing concepts. Experience working with large-scale structured and unstructured datasets.

Knowledge of data modeling and performance tuning. Preferred Qualifications Bachelor's degree in Computer Science, Information Technology, or related field. Experience with data orchestration tools such as Airflow.

Exposure to CI/CD and DevOps practices. Experience in Agile development environments. AWS certifications are an added advantage.

Candidate Profile 4+ years of Data Engineering experience Strong expertise in AWS, Python, PySpark, and SQL Experience building scalable data pipelines and cloud-based data solutions Strong problem-solving and analytical skills Willingness to work from Hyderabad office for the initial 4 weeks