Databricks Admin at Foster City CA - Join a Market Leader

Ownership of Databricks as a strategic and operational resource - Complete ownership of the product for the data solutions

Expertise in migrating to and enabling Unity Catalog (UC) within Databricks environments.

Management of Databricks at the Workspace and Account levels with a centralized approach.

Experience with setting up UC across multiple workspaces, including separate environments for Production and Non-Production.

Capability to handle deduplication of workspaces efficiently.

Proficient in implementing access control mechanisms to secure data and workflows.

Ability to assist during the migration to Unity Catalog, ensuring a smooth transition.

Knowledge and experience in managing licensing, resource utilization, scaling, and storage specifically for Databricks on AWS.

Experience in spinning up new Databricks workspaces and migrating data from AWS S3 buckets.

Ability to create and manage new server clusters on AWS efficiently.
Good Experience in Apache Spark and Delta Lake Technology (DLT), as well as Hive Metastore management.

Skills in query optimization, managing notebooks, and effectively utilizing Databricks for data operations.

Understanding of role-based access control (RBAC) and attribute-based access control (ABAC), along with overall data governance.

Expertise in metadata modeling to support effective data management and analysis.

Knowledge in handling sensitive information, including skills in data segregation, encryption, and anonymization to ensure privacy and compliance.

Basic knowledge of AWS services, including VPC, Private Subnet, NACL, and VPC Endpoints