apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Py4JJavaError: An error occurred while calling None.org.apache.spark.api.java.JavaSparkContext
user_118753190
•
13
1
30998
jupyter-notebook pyspark tensorflow apache-spark python
Spark - Read and Write back to same S3 location
user_29612280
•
2
1
2849
aws-glue pyspark apache-spark amazon-s3
Spark File Streaming get File Names
user_73738690
•
4
1
1889
spark-streaming apache-spark filestream scala
How to force Spark 2.4.3 to use fixed ports for executors or could I ignore the issue that Spark uses random executor ports?
user_122064960
•
2
0
585
apache-spark-standalone apache-spark
How to create dynamic data frame from S3 files in Glue Job in Scala?
user_122064710
•
4
1
5548
aws-glue apache-spark etl amazon-web-services scala
SPARK dataframe returning null when trying to apply schema to JSON data
user_122036750
•
4
2
2734
apache-spark dataframe schema json java
Is Spark read csv a lazy operation or eager?
user_31167860
•
4
1
1540
pyspark apache-spark-sql apache-spark
PySpark VectorAssembler 'Values to assemble cannot be null' error when there are no null values
user_112681120
•
2
0
1015
apache-spark-ml pyspark apache-spark python
Pyspark: How to filter 10000 random elements from spark dataframe
user_80037060
•
2
2
123
pyspark apache-spark
How split between Number pyspark or NLP
user_117097320
•
3
2
236
pyspark apache-spark dataframe nlp
Hot Questions