Verified today
Data Engineer, Python and Azure Databricks
About the role
Data & Analytics team at Capco builds modern data platforms for banking, financial and energy clients. The Data Engineer designs, develops and maintains scalable Python and Azure Databricks pipelines, collaborates with data scientists and architects, and ensures data quality and governance. Bengaluru, Chennai, Gurugram, Hyderabad, Mumbai, Pune, India, hybrid onsite model, relocation assistance available.
What you’ll do
- Design and develop scalable data pipelines
- Build and optimize ETL/ELT workflows
- Develop data solutions using Spark in Databricks
- Integrate data from multiple sources
- Ensure data quality, security and governance
- Collaborate with data scientists, analysts and architects
- Implement performance tuning for large-scale processing
- Monitor and troubleshoot production pipelines
What you’ll bring
- 4+ years data engineering
- Python programming
- Azure Databricks
- Apache Spark (PySpark)
- SQL and Delta Lake
- Azure Data Factory
- Azure Data Lake Storage
- Git and CI/CD
Nice to have
- 4+ years data engineering
- Python programming
- Azure Databricks
- Apache Spark (PySpark)
- SQL and Delta Lake
- Azure Data Factory
- Azure Data Lake Storage
- Git and CI/CD
Skills
Education
Bachelor's or Master's in Computer Science, Engineering, or IT