Back to jobs
LS
Hiring companyLondon Stock Exchange Group (LSEG)

Verified today

Data Platform Administrator

Bangalore, India Full-time On-site

About the role

Seeking a proactive Data Platform Administrator to manage, monitor, and optimize cloud data platform environment. Responsibilities include managing Databricks workspaces, clusters, pools, and jobs; monitoring performance, usage, and costs; configuring RBAC and audit logging; developing CI/CD pipelines; automating cluster lifecycle; supporting data scientists, engineers, and analysts; troubleshooting failures and bottlenecks; integrating Databricks with Azure Data Lake, Power BI, Dataverse; collaborating with data engineering and analytics teams. Qualifications: proven experience administering big data platforms in production; strong understanding of Apache Spark and distributed computing; experience with Azure (preferred), AWS or GCP; familiarity with Unity Catalog, Delta Lake, Lakehouse architecture; proficiency in Python, SQL, shell scripting; experience with CI/CD tools and IaC (Terraform); excellent problem‑solving and communication skills.

What you’ll do

  • Manage workspaces, clusters, pools, jobs in Databricks
  • Monitor performance, usage, costs; optimize clusters
  • Configure RBAC, audit logging; ensure compliance
  • Develop CI/CD pipelines for notebooks, jobs, libraries
  • Automate cluster lifecycle, job scheduling
  • Support data scientists, engineers, analysts
  • Troubleshoot job failures, bottlenecks, integration issues
  • Integrate Databricks with Azure Data Lake, Power BI, Dataverse
  • Collaborate with data engineering and analytics teams

What you’ll bring

  • Proven experience administering big data platforms in production
  • Strong understanding of Apache Spark and distributed computing
  • Experience with Azure (preferred), AWS or GCP
  • Familiarity with Unity Catalog, Delta Lake, Lakehouse architecture
  • Proficiency in Python, SQL, shell scripting
  • Experience with CI/CD tools and IaC (Terraform)
  • Excellent problem‑solving and communication skills

Skills

DatabricksApache SparkAzureAWSGCPUnity CatalogDelta LakeLakehousePythonSQLShell ScriptingCI/CDTerraformGitlabGitHub ActionsAzure DevOpsJenkinsData GovernanceRBACAudit Logging

Benefits

  • Healthcare coverage
  • Retirement plan
  • Paid volunteering days