Senior Kafka Engineer Hyderabad, India
Senior Kafka Engineer Description
EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.
We are looking for a Senior Kafka Engineer to join our team and be responsible for installing, monitoring, troubleshooting, and maintaining Kafka platform, ensuring optimal performance, security, and developing new features/automation/integration.
#LI-DNI
Responsibilities
- Install and provision new Kafka clusters and supporting components
- Regularly monitor the health and performance of the Kafka platform and data pipelines
- Identify and fix issues related to the platform, including data pipelines, network problems, cloud or containerization resources failures, or software bugs
- Perform regular performance tuning of Kafka platform components
- Monitor and optimize the cost and performance of Kafka clusters
- Upgrade the Kafka platform to newer versions, including planning, testing, and implementation
- Manage the security of the Kafka platform, including access control lists, encryption, and regular security reviews
- Perform regular backups and disaster recovery procedures
- Manage the capacity of the Kafka platform, including projecting future growth and scaling needs
- Document procedures, configurations, and issue resolutions, and share knowledge with the team
Requirements
- Proven experience in the implementation and maintenance of Confluent Platform
- Minimum 5 Years of experience in Kafka Administration
- Experience in Helm / Kubernetes
- Proficiency with deploying Kafka in Kubernetes
- Experience in Python Or Shell Scripting
- Excellent knowledge of Cloud : AWS /GCP (compute, networking, storage, IAM)
- B2+ English level
We offer
- Opportunity to work on technical challenges that may impact across geographies
- Vast opportunities for self-development: online university, knowledge sharing opportunities globally, learning opportunities through external certifications
- Opportunity to share your ideas on international platforms
- Sponsored Tech Talks & Hackathons
- Unlimited access to LinkedIn learning solutions
- Possibility to relocate to any EPAM office for short and long-term projects
- Focused individual development
- Benefit package:
- Health benefits
- Retirement benefits
- Paid time off
- Flexible benefits
- Forums to explore beyond work passion (CSR, photography, painting, sports, etc.)