Kafka Admin

About the role

IT Infrastructure Services team at TCS manages critical data pipelines and streaming platforms. The Kafka Admin designs, develops, and manages Kafka-based pipelines, monitors and optimizes clusters, and troubleshoots issues. Works with Hadoop, Spark, Storm and builds Python Kafka producers/consumers. Chennai office, on-site.

What you’ll do

• Design and implement Kafka data pipelines
• Configure and tune Kafka clusters for performance
• Develop automation scripts for Kafka operations
• Collaborate with big data teams using Hadoop, Spark, and Storm
• Ensure security and compliance of Kafka infrastructure

What you’ll bring

• Designing, developing, and managing Kafka-based data pipelines
• Monitoring and optimizing Kafka clusters
• Troubleshooting Kafka related issues
• Maintaining availability, performance and security of Kafka infrastructure
• Developing automation for Kafka infrastructure
• Creating and managing Kafka topics, producers, and consumers
• Python-based Kafka integration with other systems