Data Engineer

Overview About Business Unit: The Automotive Practice at Epsilon is a rapidly growing team, driving growth for major players in the automotive industry - from Original Equipment Manufacturers (OEMs) to dealerships across North America. Part of a 1,600-member multinational team, the practice provides the automotive world's largest service reminder platform, alongside agency services and digital media solutions. A leader in the automotive space, the team supports over 50% of auto dealerships in North America and maintains relationships with over 280 million customers.

Home to innovation and ground breaking technology, our Auto team leads the game in developing outstanding software and solutions for hyper-personalized digital marketing. We are looking for a highly skilled Databricks Data Engineer to design, build, and maintain our end-to-end Databricks data platform. The candidate will be responsible to Develop and builds, maintains, and optimizes data pipelines (ETL/ELT) using PySpark, SQL, and Delta Lake within cloud environments (Azure, AWS, or GCP) .

They work under mentorship to automate data workflows, perform troubleshooting, and ensure data quality, often contributing to Medallion Architecture (Bronze/Silver/Gold) layers. Click here to view how Epsilon transforms marketing with 1 View, 1 Vision and 1 Voice. Responsibilities Develop and maintain data ingestion and transformation pipelines using Databricks Notebooks and PySpark.

Implement ETL/ELT workflows using Delta Lake, Autoloader, and Delta Live Tables (DLT). Write complex SQL queries for data manipulation and optimize Spark jobs for performance. Work with senior engineers to troubleshoot data issues and apply data engineering best practices.

Document data mappings, workflows, and unit tests for pipelines. Use Git for code management and collaboration. Explore ML and AI workloads using Cursor or any AI tool ML (nice to have).

Qualifications Proficiency in Python ( PySpark ) and SQL is essential. Familiarity with Databricks, Azure, AWS, or GCP . SQL and database integration Strong listening and communication skills; ability to capture requirements from non-technical partners and translate them into technical specifications Ability to create clear, actionable QC reports that communicate data issues to both technical and business audiences Highly self-motivated and directed with ability to work independently Databricks Certification (e.g., Databricks Data Engineer Associate) Technical Requirements 2-4 years implementing Databricks projects and hands on Experience Python programming knowledge ADO, Git Preferred Qualifications Develop and enforce coding standards, reusable frameworks, and version-control best practices.

Maintain architecture diagrams, technical specifications, and operational documentation. Collaborate with Data Architects and Analysts to ensure strong design governance. Education Candidates must possess a bachelor's degree, preferably in Information Technology (IT), Computer Science (CS) Engineering, or related field, and at least 2-4 years of relevant work experience Additional Information Epsilon is a global data, technology and services company that powers the marketing and advertising ecosystem.

For decades, we've provided marketers from the world's leading brands the data, technology and services they need to engage consumers with 1 View, 1 Vision and 1 Voice. 1 View of their universe of potential buyers. 1 Vision for engaging each individual. And 1 Voice to harmonize engagement across paid, owned and earned channels. Epsilon's comprehensive portfolio of capabilities across our suite of digital media, messaging and loyalty solutions bridge the divide between marketing and advertising technology.

We process 400+ billion consumer actions each day using advanced AI and hold many patents of proprietary technology, including real-time modeling languages and consumer privacy advancements. Thanks to the work of every employee, Epsilon has been consistently recognized as industry-leading by Forrester, Adweek and the MRC. Epsilon is a global company with more than 9,000 employees around the world.

Our pillars aren't just words. They're how we show up every day. People centricity: We focus on employee well-being in an environment where colleagues truly care about each other.

Collaboration: We work together, support one another, and collectively achieve goals. Growth: There are endless opportunities for growth through learning, development and career advancement. Innovation: We drive progress through cutting-edge solutions and forward-thinking approaches.

Flexibility: We've created a balance between work and personal life, and we encourage adaptability to solve problems creatively. Our values guide us to create value for our clients, our people and consumers. Act with integrity Work together to win together Innovate with purpose Respect all voices Empower with accountability These pillars and values are our foundation-shaping our culture, guiding our decisions, and uniting us in common purpose.

Epsilon is an Equal Opportunity Employer. Epsilon is committed to promoting diversity, inclusion, and equal employment opportunities by using reasonable efforts to attract, recruit, engage and retain qualified individuals of all ethnicities and backgrounds, including, but not limited to, women, people of color, LGBTQ individuals, people with disabilities and any other underrepresented groups, traits or characteristics.