E
Hiring companyEY
Active listing
Senior Data Engineer, AI and Data, Databricks
Trivandrum, KL, IN Full-time On-site
About the role
EY GDS AI and Data team builds enterprise‑scale data platforms and analytics solutions. The Senior Data Engineer designs, develops, and deploys Databricks pipelines, optimizes ETL/ELT processes, and ensures secure, high‑performance data flows. Based in Trivandrum, India, on‑site role with occasional hybrid flexibility.
What you’ll do
- Develop and deploy Databricks in a cloud environment
- Design, develop, and maintain ETL/ELT pipelines using PySpark and Python
- Optimize SQL queries and Spark jobs for performance and scalability
- Implement data ingestion workflows from SQL Server, APIs, and cloud storage
- Collaborate with cross‑functional teams to manage project timelines and deliverables
- Lead and mentor team members, ensuring best practices in DevOps and CI/CD
What you’ll bring
- 3-5 years experience in data ingestion, processing, and migration
- Hands‑on experience with Databricks and PySpark
- Proficiency in Python and SQL
- Experience with Azure services (ADF, ADLS) and Delta Lake
- Strong analytical and problem‑solving skills
- Agile delivery methodology experience
- Excellent communication and client management skills
- Bachelor’s degree in Computer Science or equivalent
Skills
DatabricksPySparkPythonSQLAzure Data FactoryDelta LakeCI/CDAgile
Education
Computer Science