Can't start spark-shell on windows 10 Spark 3.2.0 install

Viewed 734
3 Answers

My guess is that you have to put winutils.exe in the same folder as the $SPARK_HOME%\bin folder. I discovered that after starting from scratch and following this tutorial!

I managed to solve the problem with the following configuration:

  • Spark: spark-3.2.1-bin-hadoop2.7
  • Hadoop: winutils.exe and hadoop.dll (version 2.7.7 for both)
  • JDK: jdk-18.0.1

And I recommend that you put the environment variables in User, not System

Related