Principal Data Engineer

About the role

AI & Data Engineering – Data Engineering team at Brillio builds scalable data pipelines and platforms on AWS to enable analytics and AI initiatives. The Principal Data Engineer leads design and implementation of end‑to‑end data solutions, optimizing data ingestion, processing, and storage using services like Athena, Spark‑Scala, EMR, Redshift, and DynamoDB. Bangalore, Karnataka, India, hybrid work model, collaborating with cross‑functional data scientists and engineers.

What you’ll do

• Design and architect data pipelines on AWS
• Develop Spark‑Scala jobs for data processing
• Implement data ingestion using SQS and Kinesis
• Manage data storage solutions in Redshift and DynamoDB
• Automate infrastructure with CloudFormation and OpenSearch
• Optimize performance and cost of data workflows
• Collaborate with data scientists to support AI/ML models
• Ensure data security and compliance with CloudWatch and Macie

Skills