PG
Hiring companyPhoton Group
Verified today
Senior Data Engineer, Python, Spark, Data Federation, Lakehouse
India Full-time On-site
About the role
Data Engineering team at Photon Group builds a unified, high‑performance data layer for analytics and AI teams. The Senior Data Engineer designs federated query layers, creates scalable Python‑Spark pipelines, and implements lakehouse architectures across cloud platforms. Based in India, on‑site work model.
What you’ll do
- Design and implement federated query layers
- Develop scalable ETL/ELT pipelines using PySpark
- Manage and optimize lakehouse table formats
- Tune Spark jobs and SQL queries for performance
- Implement data governance and security controls
- Collaborate with analytics and AI teams
What you’ll bring
- 5+ years Python & Spark
- Experience with Starburst/Trino/Dremio
- Lakehouse platforms (Delta Lake, Iceberg)
- AWS/Azure/GCP cloud services
- Expert SQL for analytics
- Data modeling (Star/Snowflake, Medallion)
Benefits
- Medical, vision, dental benefits
- 401k retirement plan
- Variable pay/incentives
- Paid time off
- Paid holidays
Education
Bachelor's Degree