I am new with Spark and it's librabries!
I have a case where I need to send a dataset to store() of custom receiver, then streaming data from this custom receiver.
I am getting a dataset in this way inside custom receiver class:
Dataset<Row> jdbcDF = spark.read()
.format("jdbc")
.option("url", "jdbc:mysql:dbserver")
.option("dbtable", "schema.tablename")
.option("user", "username")
.option("password", "password")
.load();
Now I want to use this dataset as streaming data, so I have to store this dataset in store() of Receiver class:
store(jdbcDF);
Is it possible to streaming in this way?
p.s not using Structured Streaming Programming
Thank you in advance!