Staff Data Engineer, Product Engagement, Data Platform Team

About the role

Product Engagement Data Engineering (PEDE) team builds the multi-tenant engagement data platform that powers analytics, experimentation and ML across Warner Bros. Discovery streaming products. As a Staff Data Engineer you will set technical direction, own end‑to‑end architecture of Spark/Scala pipelines on Databricks, and mentor engineers while ensuring petabyte‑scale reliability. Hyderabad, hybrid (Remote‑Hybrid), relocation assistance available.

What you’ll do

• Own end‑to‑end architecture of multi‑tenant engagement data platform
• Set technical direction and standards for Spark applications and data modeling
• Design and deliver streaming and batch pipelines on Databricks/AWS
• Drive data quality, observability, monitoring and lineage frameworks
• Resolve distributed‑systems failures and optimize performance at petabyte scale
• Align engineering with analytics, data science and platform stakeholders
• Mentor senior and mid‑level engineers through reviews and pairing
• Evaluate emerging tools, manage technical debt and shape roadmap

What you’ll bring

• 10+ years data engineering experience
• Expert-level Scala and/or Python
• Deep expertise with Apache Spark (structured streaming & batch)
• Advanced Delta Lake and medallion architecture
• Hands‑on Databricks and AWS S3
• Advanced SQL for large‑scale transformations
• CI/CD with GitHub Actions and sbt
• Architectural ownership and engineering mentorship

Skills