Apparently Spark Structure Streaming does not support UNION operation between stream and batch data, based on this.
I wonder why is that? Is it a difficult thing to implement? I need to execute some processing (including UNION operation) between a stream and a table in a real-time setting. Do you have any Suggestion? I already have spark in my cluster.