pyspark

4047 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
pyspark: Auto filling in implicit missing values
user_54923920
•
2
2
229
pyspark
com.amazonaws.AmazonClientException: Unable to execute HTTP request: No such host is known (spark-tunes.s3a.ap-south-1.amazonaws.com)
user_128571130
•
3
1
1345
pyspark dataframe amazon-s3 python
applying cache() and count() to Spark Dataframe in Databricks is very slow [pyspark]
user_106234440
•
3
2
3866
pyspark azure-databricks apache-spark python
py spark writing invalid date successfully but throwing exception when reading it
user_452800
•
3
1
241
pyspark
Is there a way to add a column of type dictionary to a spark dataframe in pyspark?
user_52951570
•
4
2
4689
pyspark apache-spark-sql python
How to set batch size in one micro-batch of spark structured streaming
user_74866210
•
3
1
3359
spark-structured-streaming pyspark apache-kafka apache-spark
PySpark equivalent of function "typedLit" from Scala API
user_72203860
•
7
3
3954
pyspark apache-spark-sql apache-spark scala arrays
Error:'java.lang.UnsupportedOperationException' for Pyspark pandas_udf documentation code
user_115838660
•
12
5
5225
pyspark apache-spark-sql apache-spark
Efficiently batching Spark dataframes to call an API
user_136489030
•
2
1
1111
spotipy pyspark apache-spark-sql apache-spark
Why does spark-submit ignore the package that I include as part of the configuration of my spark session?
user_96677210
•
4
3
1104
pyspark apache-spark-sql apache-spark
Hot Questions