Verified today
Data Platform Engineer
About the role
As a Data Platform Engineer in Pune, you will be a key contributor in building and maintaining the new Operational Data Store, developing infrastructure that captures, stores, and publishes master data across the enterprise. Day-to-day work includes building batch and real-time pipelines with Dataflow and Kafka, orchestrating Airflow DAGs, deploying GCP resources via Terraform, creating APIs and microservices with FastAPI and Golang, and modeling data with dbt in BigQuery. This is a full-time hybrid role.
What you’ll do
- Build and maintain batch and real-time data pipelines using Dataflow and Kafka
- Develop and monitor complex Airflow (Cloud Composer) DAGs to ensure timely data delivery
- Use Terraform to deploy and manage GCP resources for environmental consistency
- Create internal APIs and microservices using FastAPI and Golang
- Use dbt to transform raw data into clean, tested models within BigQuery
- Manage Docker containers and CI/CD pipelines (GitLab/Jenkins) for seamless deployments
- Transition from legacy point-to-point integrations to a decoupled event-driven architecture
What you’ll bring
- Master's or Bachelor's Degree in Computer Science, Data Engineering, Software Engineering, or a related technical field
- Strong academic foundation in Distributed Systems, DBMS, Algorithm Design, and Real-time Computing
- Advanced Python proficiency
- Intermediate Golang proficiency
- SQL proficiency
- Experience with Dataflow and Kafka
- Experience with Airflow (Cloud Composer)
- Experience with Terraform and GCP resources
Nice to have
- Google Cloud Professional Data Engineer certification
- Experience with Jira, Confluence, and ServiceNow
- Frontend experience with React.js
Skills
Education
Master’s or Bachelor’s Degree in Computer Science, Data Engineering, Software Engineering, or a related technical field (e.g., Electromechanical Engineering with a focus on Automation)