Databricks Administration

Databricks Administration

• Primary skills:Technology->Data Engineering->Databricks Minimum Qualifications: • Bachelor’s degree or equivalent in Engineering, Computer Science, MCA, MSc, or related discipline. • 3–5 years of experience in platform administration/support with hands-on Databricks Administration. • Working experience with cloud platforms and core cloud concepts (networking, IAM, storage, compute). • Experience managing access controls, policies, and operational governance in a shared environment. • Strong troubleshooting skills with the ability to analyze logs/metrics and resolve platform issues effectively. Preferred Qualifications: • Experience operating Databricks on major cloud platforms with an understanding of cloud-native security and governance. • Exposure to automation for administrative tasks and environment standardization to improve reliability and speed. • Proven ability to drive performance tuning and cost optimization for compute workloads in cloud environments. • Experience supporting multiple teams, prioritizing requests, and communicating clearly with technical and non-technical stakeholders. • Familiarity with monitoring/alerting practices and building operational dashboards for platform visibility. Good to have skills: Terraform, CI/CD, Python scripting, Monitoring & Alerting (Grafana/Prometheus/CloudWatch), Identity & Access Management (IAM) Key Responsibilities: • Administer and maintain Databricks workspaces, clusters, and compute policies to ensure high availability and performance. • Configure and manage user access, roles, permissions, and workspace governance aligned to security best practices. • Monitor platform health, job reliability, cluster utilization, and troubleshoot failures across notebooks, jobs, and connectivity. • Implement cost optimization practices such as cluster sizing, auto-scaling, scheduling, and usage reporting. • Support integrations with cloud services and storage, ensuring stable connectivity and secure data access patterns. • Create and maintain operational documentation, runbooks, and standard procedures for recurring administration tasks. • Partner with engineering and data teams to onboard workloads, enforce standards, and improve platform usability. • Assist with incident response, root-cause analysis, and continuous improvements to reduce operational risk.