Principal Data Engineer

About the role

Innovation Hub at Kmart Australia powers retail brands through data-driven solutions. The Principal Data Engineer leads the design and implementation of scalable data pipelines, cloud data warehouses, and ML lifecycle platforms, ensuring data quality and governance across multi‑cloud environments. Based in Bangalore, on-site work model, collaborating globally with engineering and analytics teams.

What you’ll do

• Architect end‑to‑end data solutions and lakehouse models
• Lead development of real‑time streaming pipelines
• Ensure data governance, compliance, and quality standards
• Orchestrate workflows and automate deployments via Airflow and Terraform
• Collaborate with ML teams to integrate feature stores and model serving
• Mentor engineering team and drive best practices
• Optimize cloud cost and performance across multi‑cloud platforms
• Drive innovation in AI/ML platform integration

What you’ll bring

• 10-15 years data engineering experience
• Multi‑cloud expertise (AWS, GCP, Azure)
• Design and optimize cloud data warehouses (Snowflake, BigQuery, Databricks)
• Develop data pipelines in Python, Java, Scala
• Implement streaming solutions with Kafka and Flink
• Apply data quality frameworks (dbt, Great Expectations)
• Build CI/CD and orchestration with Docker, Kubernetes, Airflow
• Manage ML lifecycle tools (MLflow, Kubeflow)

Skills