Flink SQL behavior

Viewed 46

I want to execute Flink SQL on batch data. (CSVs in S3)

However, I explicitly want Flink to execute my query in a streaming fashion because I think it will be faster than the batch mode.

For example, my query consists of filtering on two tables and joining the filtered result. I want Flink not to materialize the two tables in blocking batch fashion and then pipe the result through the join, but use a streaming hash join operator like in the datastream API.

How do I make this happen? I am using PyFlink.

1 Answers
Related