Junit spark: what is the equivalent of assertDataFrameEquals in java to compare 2 dataframes

assertDataFrameDataEquals is also available in java from spark-testing-base You need to import JavaDataFrameSuiteBase (in Scala it is just DataFrameSuiteBase)

import com.holdenkarau.spark.testing.JavaDataFrameSuiteBase;

The main thing in java you need to create an object for JavaDataFrameSuiteBase to access the methods. So you can use assertDataFrameDataEquals as below. This is using junit and spark-testing-base.

@Test
public void personsComputeTransformTest() {

// read personsInputDf(input) and call your function to be tested to get personsResultDf(result)

JavaDataFrameSuiteBase javaDataFrameSuiteBase = new JavaDataFrameSuiteBase();
javaDataFrameSuiteBase.assertDataFrameDataEquals(personsInputDf, personsResultDf);

}