pyspark first setup on windows - error launching

Viewed 15

i wanted to know if i've set up my pyspark correctly by seeing the "Welcome to Spark - Using python version" on command prompt. However i get this error instead. Any idea if this is okay and if not, how do i resolve this. Thank you.

Microsoft Windows [Version 10.0.22000.856]
(c) Microsoft Corporation. All rights reserved.

C:\Spark\bin>pyspark
Python 3.10.7 (tags/v3.10.7:6cc6b13, Sep  5 2022, 14:08:36) [MSC v.1933 64 bit (AMD64)] on win32
Type "help", "copyright", "credits" or "license" for more information.
Traceback (most recent call last):
  File "C:\Spark\python\pyspark\shell.py", line 31, in <module>
    from pyspark import SparkConf
  File "C:\Spark\python\pyspark\__init__.py", line 51, in <module>
    from pyspark.context import SparkContext
  File "C:\Spark\python\pyspark\context.py", line 31, in <module>
    from pyspark import accumulators
  File "C:\Spark\python\pyspark\accumulators.py", line 97, in <module>
    from pyspark.serializers import read_int, PickleSerializer
  File "C:\Spark\python\pyspark\serializers.py", line 72, in <module>
    from pyspark import cloudpickle
  File "C:\Spark\python\pyspark\cloudpickle.py", line 145, in <module>
    _cell_set_template_code = _make_cell_set_template_code()
  File "C:\Spark\python\pyspark\cloudpickle.py", line 126, in _make_cell_set_template_code
    return types.CodeType(
TypeError: 'bytes' object cannot be interpreted as an integer
0 Answers
Related