I am currently designing a fast data aggregation module which receives events and publish them to Kafka cluster. Then we have an integration of Kafka and Spark Streaming. Spark Streaming reads stream from Kafka and executes some computation. When the computation is done, we need to send the result to another application. This application could be a web service or a Kafka cluster.
I am wondering how we can do this? From what I've read, Spark Stream pushes the data to downstream like Databases and file systems.
How would you go with design such an application? Should I replace Spark Stream with Storm to be able to publish the results to another application?