Kafka Admin

About the role

Responsibilities We are seeking an experienced Kafka Administrator to manage and maintain enterprise-level Apache Kafka clusters. The ideal candidate will be responsible for installation, configuration, monitoring, performance tuning, and ensuring high availability of Kafka infrastructure in distributed environments. Key Responsibilities Kafka Cluster Administration Install, configure, and maintain Apache Kafka clusters Manage Kafka brokers, topics, partitions, and replication Perform cluster upgrades, scaling, and capacity planning Monitoring & Performance Tuning Monitor Kafka cluster health using tools like: Prometheus, Grafana, Confluent Control Center Optimize broker performance, throughput, and latency Tune configurations for producers and consumers Data Streaming & Integration Manage real-time data pipelines using Kafka Handle integration with: Spark, Hadoop, Flink Databases & APIs Support streaming use cases and event-driven architecture Security & Governance Implement authentication and authorization (SSL, SASL, Kerberos) Configure ACLs (Access Control Lists) Ensure secure data transmission and compliance Replication & High Availability Ensure fault tolerance and data replication across brokers Configure multi-cluster setups (MirrorMaker, Cluster Linking) Handle disaster recovery strategies Troubleshooting & Support Diagnose and fix issues like: Broker failures Consumer lag Performance bottlenecks Analyze logs and perform root cause analysis Automation & DevOps Automate deployments using Ansible, Terraform, or scripts Manage CI/CD pipelines for Kafka environments Version control using Git Zookeeper / KRaft Management Manage Zookeeper clusters (if applicable) Configure Kafka in KRaft mode (Zookeeper-less architecture)

What you’ll do

• Manage installation, configuration, and maintenance of Apache Kafka clusters
• Administer brokers, topics, partitions, replication, and perform upgrades and scaling
• Monitor cluster health and tune performance for throughput and latency
• Implement security with SSL, SASL, Kerberos and configure ACLs
• Design and manage real‑time data pipelines and integration with big‑data tools
• Automate deployments and infrastructure as code using Ansible/Terraform
• Maintain CI/CD pipelines and version control for Kafka environments
• Handle disaster recovery, fault tolerance, and troubleshooting of Kafka issues

What you’ll bring

• 2-5 years Kafka administration experience
• Hands‑on with Confluent Kafka
• Experience with monitoring tools such as Prometheus, Grafana, Confluent Control Center
• Integration experience with Spark, Hadoop, Flink
• Automation using Ansible or Terraform
• CI/CD pipeline management for Kafka environments
• Version control using Git
• Knowledge of Zookeeper and KRaft mode