AWS Data Engineer

About the role

Data Engineering team at TATA CONSULTANCY SERVICES focuses on building scalable data pipelines and lake solutions on AWS. The AWS Data Engineer designs and implements data ingestion, transformation, and monitoring workflows using Python, Terraform, and AWS services, while integrating SCADA data via MQTT and OPC-UA. Pune location, on-site work model, relocation assistance available.

What you’ll do

• Design and implement end‑to‑end data pipelines on AWS
• Develop automation scripts in Python for data transformation
• Build and maintain cloud infrastructure with Terraform
• Integrate SCADA data streams via MQTT/Greengrass/OPC‑UA
• Create and manage Grafana dashboards using SQL queries
• Monitor, troubleshoot, and optimize data lake performance
• Collaborate with cross‑functional teams to ensure data quality and availability

What you’ll bring

• 7+ years experience with AWS and Python
• Terraform infrastructure as code
• Java development for SCADA integration
• Designing Data Lake architecture and modeling
• MQTT, Greengrass, OPC-UA protocol expertise
• Windows Server administration and PowerShell scripting
• Creating Grafana dashboards using SQL
• AWS Glue and CloudWatch monitoring

Skills