Databricks Administrator - AWS

Job Title: Senior Databricks Administrator - AWS Role OverviewWe are looking for a Senior Databricks Administrator with strong expertise in Databricks on AWS, focused on security, governance, and cost optimization. This role will own platform administration, IAM-based data access controls, Unity Catalog governance, and infrastructure automation. The ideal candidate should demonstrate deep AWS IAM knowledge, production support maturity, and strong stakeholder management skills.Key ResponsibilitiesAdminister and manage Databricks workspaces (AWS E2 architecture)Design secure S3 access using IAM roles, trust policies, and instance profilesImplement fine-grained access control (FGAC) using Unity Catalog (catalogs, schemas, tables, system catalog)Manage data governance policies, storage credentials, and external locationsDefine and enforce cluster policies for security and cost controlMonitor cluster utilization, implement autoscaling, and drive cost optimization (DBUs, Spot instances)Provision and manage Databricks infrastructure using Terraform or Asset Bundles (IaC)Troubleshoot production incidents related to IAM, storage, and clustersBuild and maintain dashboards within Databricks for monitoring and insightsCollaborate with security, infrastructure, and business teamsRequired Skills5+ years of Databricks administration on AWSStrong hands-on experience with AWS IAM (roles, trust relationships, external ID, STS, instance profiles)Good understanding of AWS networking basics (VPC, Route53)Strong experience with Unity Catalog and governance models (including system catalog)Experience with cluster policy management and cost optimization strategiesStrong scripting skills in Python or BashExperience with Infrastructure as Code (Terraform / Databricks Asset Bundles)Experience building dashboards in Databricks (SQL / Lakehouse monitoring)Proven experience supporting production environments and stakeholder communicationPreferredExperience with multi-workspace governance and centralized metastoreExposure to chargeback/showback modelsAWS Certification (Solutions Architect / Security)