Are you a passionate Kafka Administrator eager to automate? Join our dynamic team to work on exciting products that are transforming real estate technology!
Confluent Kafka expert with strong infrastructure expertise and the ability to provide guidance on best practices for confluent kafka platform management and operations. This role requires a proactive and highly skilled Kafka Cloud Administrator who can ensure the smooth operation, performance, and security of Kafka-based architectures in a cloud environment. Must have in-depth experience with Kafka Connectors, Kafka Streams, and KSQLs, along with experience of managing high-volume traffic. Good to have knowledge on MongoDB and Kafka integration with cloud technologies like Azure, AWS, Microservices, web Methods etc.
Key Responsibilities:
Extensive experience with Kafka Connectors, Kafka Streams, Custom Kafka Connect Transforms, and KSQL, including managing high-volume traffic. Confluent Kafka – Develop and execute/manage Consumer and Producer onboarding process. Optimize the performance of Kafka producers, consumers, and clusters, tuning configurations for memory, throughput, and latency. Collaborate with client engineering and DevOps teams to develop the required technical environments to implement the new architecture. Create and monitor key performance metrics to measure cluster utilization, performance, and health. Manage and maintain Confluent Kafka clusters, including topic creation, redundancy cluster setup, monitoring tools, and alerts. Troubleshoot and resolve platform-level issues, ensuring system health and high availability. Automate repetitive administrative tasks for efficiency. Provide technical guidance and best practices to develop teams for Kafka implementation. Monitor and optimize Kafka performance for efficient data processing and seamless integration. Maintain comprehensive documentation of Kafka cluster configurations, processes, and troubleshooting procedures.Qualifications:
5+ years of hands-on experience in Kafka Administration, managing critical 24/7 applications, and working with Confluent Kafka Cloud. 5+ years of experience in designing and building high-performance, high-availability, scalability, and distributed applications. Strong understanding of Kafka architecture and internals, including Kafka Connect, Schema Registry, KSQL, REST Proxy, Zookeeper, and Kafka Control Center. Hands-on experience in setting up and administering Kafka platforms from scratch, including backup & mirroring of Kafka Cluster brokers, broker sizing, topic sizing, hardware sizing, performance monitoring, security (ACLs), and access management. Familiarity with Kafka API (development experience is a plus). Deep knowledge of security best practices, performance tuning, and disaster recovery strategies. Advanced degree in Computer Science, Engineering, or a related field, or equivalent industry experience. Excellent communication and interpersonal skills to collaborate across teams. Certifications: Relevant certifications in Kafka (Confluent Certified Administrator) and cloud platforms certification (AWS Certified Solutions Architect, Azure Administrator, etc.) is a plus. An advanced degree in Computer Science or similar field or equivalent industry experience. Must have excellent communications and interpersonal skills. Preferred Skills: Experience with other messaging systems. Familiarity with cloud platforms (AWS, Azure, GCP) and containerization technologies. Strong knowledge of security best practices and user access management Experience with MongoDB Atlas or cloud-based MongoDB solutions is a plus.