Databricks Admin

1. Security Administration: o Design, implement, and manage security policies and controls within the Databricks environment. o Monitor and audit user access and activities to ensure compliance with security policies. o Develop and maintain data encryption strategies. o Manage roles, permissions, and access controls to ensure data security and compliance. 2. Automation and Optimization: o Develop and implement automation scripts to streamline data workflows and administrative tasks. o Optimize Databricks performance by tuning queries, managing storage, and implementing best practices. o Utilize Databricks features such as tasks, streams, and stored procedures to automate data processes. o Leverage CICD best practices to automate productionalization of data pipelines 3. Collaboration and Support: o Work closely with data engineers, analysts, and other stakeholders to understand their needs and provide solutions. o Provide technical support and troubleshooting for Databricks-related issues. o Conduct training sessions and create documentation for internal teams on Snowflake best practices and security protocols. 4. Monitoring and Reporting: o Set up and maintain monitoring tools to track the performance and security of the Databricks environment. o Generate and analyze reports on system performance, security incidents, and usage metrics. o Implement alerts and notifications for critical security and performance events. 5. Continuous Improvement: o Stay up-to-date with the latest Databricks features, security trends, and industry best practices. o Proactively identify opportunities for improvement in security, performance, and automation. o Participate in continuous learning and professional development activities. Bachelor's degree in Computer Science, Information Technology, or a related field; or equivalent work experience. Proven experience as a Databricks administrator, with a strong focus on security and automation. In-depth knowledge of Databricks architecture, security features, and best practices. Proficiency in SQL and scripting languages (e.g., Python, JavaScript) for automation tasks. Experience with Azure cloud platforms and their security practices. Familiarity with data governance, compliance standards, and regulatory requirements (e.g., GDPR). Databricks certification(s) such as Associate or Professional Data Engineer Experience with data integration tools and ETL processes using Azure Data Factory. Strong problem-solving skills and the ability to work independently and as part of a team. Previous experience in a similar role within a fast-paced, dynamic environment