Kafka Administrator

Kafka Administrator

Location:

New York NY (Hybrid 3 days onsite)

Job Summary

We are seeking an experienced Kafka Administrator to manage operate and optimize Apache Kafka environments. The ideal candidate will be responsible for ensuring high availability security scalability and performance of Kafka clusters while collaborating closely with development and infrastructure teams to support real-time data streaming solutions.

Key Responsibilities Kafka Cluster Management

• Install configure and maintain Apache Kafka clusters.
• Ensure high availability fault tolerance and disaster recovery strategies.
• Manage Kafka brokers topics partitions and replication.

Performance Optimization

• Monitor Kafka performance and resource utilization.
• Identify bottlenecks and tune configurations for optimal throughput and low latency.
• Perform capacity and load optimization activities.

Security Management

• Implement and manage Kafka security features including authentication authorization and encryption.
• Enforce access controls and compliance with organizational security standards.

Monitoring & Alerting

• Set up and maintain monitoring tools and alerting mechanisms.
• Proactively detect troubleshoot and resolve issues before they impact business operations.

Troubleshooting & Support

• Diagnose and resolve Kafka-related issues including performance degradation connectivity problems and data inconsistencies.
• Provide operational support for production Kafka environments.

Integration & Collaboration

• Work closely with development data and infrastructure teams to integrate Kafka with applications and data pipelines.
• Support real-time data ingestion and streaming use cases.

Automation

• Automate routine Kafka administration tasks using scripts and tools.
• Improve operational efficiency and reduce manual intervention.

Documentation

• Create and maintain comprehensive documentation for Kafka configurations operational procedures and best practices.

Capacity Planning

• Analyze current and future resource requirements.
• Plan and execute Kafka cluster scaling strategies to meet growing data demands.

Required Skills & Experience

• Strong hands‑on experience administering Apache Kafka in production environments.
• Expertise in Kafka architecture brokers topics partitions and replication.
• Experience with performance tuning monitoring and troubleshooting Kafka clusters.
• Knowledge of Kafka security configurations and best practices.
• Scripting experience for automation (Shell Python or similar).
• Strong collaboration and documentation skills.

Key Skills

• Hadoop
• Microsoft Windows Server
• Windows
• Apache
• Linux
• SAN
• Shell Scripting
• System Administration
• Administrative Experience
• Scripting
• Oracle
• Troubleshooting

Employment Type: Full Time

Experience: years

Vacancy: 1

#J-18808-Ljbffr