Using Apache Kafka for real time messaging

user_3813463 0
Viewed 582

We are having an online examination system already developed in Spring MVC along with live webcam image capturing and uploading for offline proctoring, now clients are demanding for online or live proctoring solution where an online proctor will see the live images of an online candidate and based on that (if any malpractice he/she feels) can send warning messages to the online candidate.

To send warning messages from online proctor to candidate we are thinking to use Apache kafka, so message from online proctoring server (Spring Boot) will go to kakfa server and each exam server (Spring MVC) will consume the message. We are clear till this point but after receiving the message at exam server how to show that message to a particular candidate without refreshing or doing REST call from browser to exam server? or is there any other elegant way to do this?

enter image description here

apache-kafka spring-boot spring-mvc java
2 Answers
user_10523340

As you've clearly identified in your diagram, exposing Kafka to the Internet directly is not the way to go, and instead you need an intermediary to distribute the message data. This is typically a message broker or ideally an realtime messaging service designed specifically for Internet delivery of data. See a simplified diagram below.

Kafka and a broker

To keep your stack simple, secure and scalable, I strongly recommend you consider an intermediary internet-facing message broker in the middle between your clients and Kafka.

This entire topic is covered in huge depth in "How to stream Kafka messages to Internet-facing clients over WebSockets"

user_1396070
Related