Data Platform Administrator

About the role

We are seeking a skilled and proactive Data Platform Administrator to manage, monitor, and optimize our cloud data platform environment. The ideal candidate will have hands‑on experience with cloud‑based data platforms, strong knowledge of Spark, big data or related technologies, and a passion for enabling data teams to work efficiently and securely.

What you’ll do

• Handle and maintain workspaces, clusters, pools, and jobs in Databricks or other big data systems.
• Monitor performance, usage, and costs; optimize cluster configurations.
• Configure role-based access control (RBAC), and audit logging.
• Ensure compliance with data governance and security standards.
• Develop CI/CD pipelines for notebooks, jobs, and libraries using tools like Gitlab, GitHub Actions, Azure DevOps, or Jenkins.
• Automate cluster lifecycle management and job scheduling.
• Provide support to the users of the platform i.e., data scientists, engineers, and analysts.
• Troubleshoot job failures, performance bottlenecks, and integration issues.
• Integrate Databricks with other enterprise systems (e.g., Azure Data Lake, Power BI, Dataverse).
• Collaborate with data eng

What you’ll bring

• Proven experience administering big data platforms in a production environment.
• Strong understanding of Apache Spark and distributed computing.
• Experience with cloud platforms (Azure preferred, AWS or GCP acceptable).
• Familiarity with Unity Catalog, Delta Lake, and Lakehouse architecture.
• Proficiency in Python, SQL, and shell scripting.
• Experience with CI/CD tools and infrastructure-as-code (Terraform is a plus).
• Excellent problem‑solving and communication skills.

Skills

Benefits

Healthcare, retirement planning, paid volunteering days and wellbeing initiatives.