apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
PySpark: Can only call getServletHandlers on a running MetricsSystem
user_132104220
•
2
0
227
pyspark apache-spark kubernetes python
Can you construct pyspark.pandas.DataFrame from pyspark.sql.dataframe.DataFrame?
user_16115430
•
1
1
255
pyspark azure-databricks databricks apache-spark dataframe
How to join two ARRAY<STRUCT> fields on a join key in Spark SQL 3.2
user_143994350
•
1
0
124
pyspark apache-spark-sql apache-spark arrays
How did spark RDD map to Cassandra table?
user_108248780
•
1
1
40
spark-cassandra-connector rdd apache-spark cassandra scala
In Spark Scala, how to check how many characters in a string in a dataframe column are uppercase?
user_89164080
•
1
1
273
databricks apache-spark-sql apache-spark scala
access objects in pyspark user-defined function from outer scope, avoid PicklingError: Could not serialize object
user_49187650
•
6
1
423
pyspark apache-spark user-defined-functions serialization python
Converting a date/time column from binary data type to the date/time data type using PySpark
user_71549140
•
1
1
132
pyspark apache-spark-sql apache-spark
How to set spark Kusto connector write polling interval?
user_16456450
•
1
1
76
azure-data-explorer apache-spark-sql apache-spark azure scala
How I can divide each column of a dataframe with respect to values in another dataframe's column?
user_168317230
•
1
1
103
pyspark apache-spark-sql apache-spark divide date
Create PySpark dataframe with timeseries column
user_69337310
•
1
1
131
pyspark apache-spark-sql apache-spark time-series date
Hot Questions