Verified today
Data Platform Administrator
About the role
Seeking a proactive Data Platform Administrator to manage, monitor, and optimize cloud data platform environment. Responsibilities include managing Databricks workspaces, clusters, pools, and jobs; monitoring performance, usage, and costs; configuring RBAC and audit logging; developing CI/CD pipelines; automating cluster lifecycle; supporting data scientists, engineers, and analysts; troubleshooting failures and bottlenecks; integrating Databricks with Azure Data Lake, Power BI, Dataverse; collaborating with data engineering and analytics teams. Qualifications: proven experience administering big data platforms in production; strong understanding of Apache Spark and distributed computing; experience with Azure (preferred), AWS or GCP; familiarity with Unity Catalog, Delta Lake, Lakehouse architecture; proficiency in Python, SQL, shell scripting; experience with CI/CD tools and IaC (Terraform); excellent problem‑solving and communication skills.
What you’ll do
- Manage workspaces, clusters, pools, jobs in Databricks
- Monitor performance, usage, costs; optimize clusters
- Configure RBAC, audit logging; ensure compliance
- Develop CI/CD pipelines for notebooks, jobs, libraries
- Automate cluster lifecycle, job scheduling
- Support data scientists, engineers, analysts
- Troubleshoot job failures, bottlenecks, integration issues
- Integrate Databricks with Azure Data Lake, Power BI, Dataverse
- Collaborate with data engineering and analytics teams
What you’ll bring
- Proven experience administering big data platforms in production
- Strong understanding of Apache Spark and distributed computing
- Experience with Azure (preferred), AWS or GCP
- Familiarity with Unity Catalog, Delta Lake, Lakehouse architecture
- Proficiency in Python, SQL, shell scripting
- Experience with CI/CD tools and IaC (Terraform)
- Excellent problem‑solving and communication skills
Skills
Benefits
- Healthcare coverage
- Retirement plan
- Paid volunteering days