Apache Kafka Administrator

Kafka Admin

2–5 years of experience working with Apache Kafka administration/support Strong understanding of distributed systems and messaging architectures Hands-on experience with Kafka ecosystem tools (Zookeeper/KRaft, Kafka Connect, Kafka Streams) Experience with monitoring tools such as Prometheus, Grafana, or ELK stack Knowledge of Linux/Unix systems administration Familiarity with cloud platforms like AWS, Azure, or GCP Experience with containerization and orchestration tools (Docker, Kubernetes) is a plus Understanding of data pipelines, ETL processes, and streaming concepts Strong troubleshooting and analytical skills Good scripting knowledge (Bash, Python, or similar) Bachelor’s degree in Computer Science, Information Technology, or a related field Install, configure, and manage Apache Kafka clusters in production and non-production environments Monitor Kafka cluster health, performance, and capacity using tools such as Prometheus, Grafana, or similar Perform cluster tuning and optimization to ensure high throughput and low latency Manage Kafka topics, partitions, brokers, replication, and retention policies Implement and maintain data security, including authentication (SASL), authorization (ACLs), and encryption (SSL/TLS) Troubleshoot and resolve Kafka-related issues, including broker failures, consumer lag, and data inconsistencies Automate routine tasks using scripting (Shell, Python, etc.) and configuration management tools Work closely with development teams to design scalable and fault-tolerant data streaming solutions Perform upgrades, patching, and maintenance with minimal downtime Ensure backup and disaster recovery mechanisms for Kafka clusters Maintain documentation for configurations, processes, and troubleshooting guides