apache-spark

apache-spark

436 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
RowNumber with Reset
John Stud0
•
0
1
34
pyspark apache-spark apache-spark-sql
In PySpark, is there a way to pass credentials as variables into spark.read?
5e6e5ns10
•
0
2
16
google-bigquery databricks pyspark apache-spark
How can I define user-defined aggregate functions in PySpark?
user3445770
•
1
1
21
aggregate-functions user-defined-functions pyspark apache-spark python
Scala's Parallel Collections vs. Spark Futures vs. `SparkContext.parallelize()`
Daniel Tan0
•
0
1
19
apache-spark scala
Spark dies with NullPointerException UTF8String.getBaseObject() "input" is null
Garret Wilson0
•
0
1
23
java apache-spark
ERROR TransportClient:233 - Failed to send RPC 6991111753806943231 to /100.22.33.44:00000: java.nio.channels.ClosedChannelException
Zuzu0
•
0
0
14
hadoop-yarn java apache-spark
PySpark - Create a Dataframe from a dictionary with list of values for each key
Luigi1050
•
0
1
30
dictionary dataframe pyspark apache-spark python
Use PySpark at full capacity
Agudolive0
•
1
1
23
hadoop-yarn google-cloud-dataproc pyspark apache-spark python
Spark Scala Dataset cannot use agg function
Ajris0
•
2
1
22
apache-spark-dataset apache-spark apache-spark-sql scala
AttributeError: 'float' object has no attribute 'cast'
Alphonse Prakash 21MCA00620
•
1
1
53
attributeerror pyspark apache-spark apache-spark-sql python
Hot Questions