I was reading this article which says that we can't use full outer join while using SHJ. I understand this is not possible with BHJ but can't figure out why it should not work with SHJ.
I was reading this article which says that we can't use full outer join while using SHJ. I understand this is not possible with BHJ but can't figure out why it should not work with SHJ.
This should answer your question. Technically you can but seems like it was never done but resolved in Spark 3.0.1. But note that by default it would still go for Sort Merge Join for most full outer join. https://issues.apache.org/jira/browse/SPARK-32399