Databricks SME
Turnbridge Technical Solutions
Job Description
Job DescriptionJob DescriptionDatabricks Subject Matter Expert (Lead / Principal)Location: Dallas, TX (Hybrid)Employment Type: Contract-to-HireAbout TURNBRIDGETURNBRIDGE delivers precision-driven technical solutions and talent strategies that help organizations modernize, scale, and innovate. We focus on quality over volume—bringing deep technical expertise, transparency, and speed to every engagement.Role OverviewTURNBRIDGE is seeking a Databricks Subject Matter Expert at the Lead / Principal level to serve as the firm’s top technical authority on the Databricks Lakehouse Platform. In this highly visible role, you will lead complex data transformation initiatives—from strategy and architecture through hands-on implementation and production deployment.You will partner closely with senior stakeholders to define data platform strategies, design scalable Databricks solutions, and mentor delivery teams.
This role blends deep technical leadership with client advisory, pre-sales support, and practice development.Note: This role is based in Dallas, TX and follows a hybrid work model.Key ResponsibilitiesSolution Architecture & DesignLead end-to-end design of Databricks Lakehouse architectures, including Delta Lake, Unity Catalog, and medallion (bronze/silver/gold) data modelsDefine reference architectures, best practices, and reusable accelerators to support delivery consistency and scaleEvaluate and recommend deployment patterns across Azure Databricks, AWS Databricks, and GCP, aligning solutions with infrastructure, security, and governance requirementsData Engineering & Pipeline DevelopmentArchitect and oversee large-scale ETL/ELT pipelines using Apache Spark, Delta Live Tables, and Databricks WorkflowsDesign both real-time and batch ingestion frameworks for structured, semi-structured, and unstructured dataEstablish standards for data quality, lineage, and observability leveraging Unity Catalog, Delta Lake features, and complementary toolingMachine Learning & MLOpsGuide teams on building end-to-end ML workflows using MLflow, Feature Store, and Databricks Model ServingAdvise on MLOps patterns including model versioning, monitoring, A/B testing, and automated retrainingCollaborate with data science teams to productionize models and integrate ML outputs into downstream applicationsClient Advisory & Engagement LeadershipAct as a trusted advisor to senior stakeholders on data platform strategy and Databricks adoptionLead discovery sessions, architecture reviews, and technical assessments to define solution roadmapsSupport pre-sales efforts through solution design, effort estimation, proposal development, and technical demonstrationsThought Leadership & Practice DevelopmentContribute to internal intellectual property, including frameworks, accelerators, white papers, and training materialsMentor and upskill consultants across the data practice, fostering a strong Databricks community of excellenceRepresent TURNBRIDGE at industry events, partner summits, and webinars as a Databricks thought leaderRequired Qualifications10+ years of experience in data engineering, analytics, or platform architecture5+ years of hands-on experience with Databricks in enterprise production environmentsExpert-level proficiency in Apache Spark (PySpark and/or Scala), Delta Lake, and SQLProven experience designing multi-cloud Lakehouse architectures (Azure, AWS, or GCP)Strong hands-on experience with Unity Catalog for governance, access control, and lineageDemonstrated success leading client-facing technical engagements and communicating with executive audiencesBackground in consulting or professional services, managing multiple concurrent engagementsBachelor’s degree in Computer Science, Engineering, Data Science, or equivalent practical experiencePreferred QualificationsDatabricks certifications (Data Engineer Professional and/or Machine Learning Professional)Experience with Delta Live Tables, Databricks Workflows, and Photon optimizationFamiliarity with dbt, Infrastructure as Code (Terraform or Pulumi), and CI/CD pipelines for data platformsHands-on experience with MLflow, Feature Store, and Model Serving in productionPrior experience working within a Databricks partner ecosystemAdvanced degree (M.S. or Ph.D.) in a technical or quantitative disciplineCore SkillsApache SparkDatabricks Lakehouse ArchitectureData Quality & GovernanceCI/CD for Data PlatformsWorkflow Orchestration