Website
http://www.intraedge.com
Data Engineer
Exp: 6+ for Senior
Location: Pune (Hybrid)
Working hours overlap with EST: 6 am - 2 pm.
Job Description and Roles and Responsibility:-
The work you will tackle:
● Engineer solutions around complex data sets that present unique challenges with performance & scale; this impacts millions of Brightside-supported families.
● Create, augment & maintain data domains and business-critical workflows that power business intelligence, analytics, and AI.
● Build solutions that enable our organization to make data-driven decisions & empower new, actionable insights.
● Work with stakeholders and cross-functional teams to distill requirements, create data models, craft data transformations, and create data products supporting various business units.
● Work with both unstructured and structured data, real-time and batch.
● Perform root cause analysis, troubleshoot & fix data quality, integrity & accuracy issues.
● Develop new & creative ways to solve problems with the use of data.
What we’re looking for in your background:
● 6+ years of experience in software engineering or data engineering; fluent in Python & SQL
● 6+ years of experience in data wrangling, transformations & modeling in Spark
● 4+ years of experience in creating domain models using design patterns such as:
○ Fact/Dim, Star Schema, Data Vault 2.0
● 3+ years of experience using Databricks & dbt
○ Or comparable ETL tools, such as AWS Glue, Apache Airflow, and Hadoop (Spark, Hive, Pig, etc.).
● Experience using AWS, PySpark, Spark SQL, Jupyter Notebooks, or similar tooling
●
Thanks & Regards,
Divya Dixit
Recruitment Lead