apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
extract substring before first occurrence and substring after last occurrence of a delimiter in Pyspark
user_101408210
•
2
1
417
pyspark apache-spark python
Last unique entries above current row in Spark
user_41769510
•
2
1
62
apache-spark window-functions scala
How to call aes_encrypt (and other Spark SQL functions) in a pyspark DataFrame context
user_98783230
•
2
1
360
pyspark databricks apache-spark-sql apache-spark python
Recursive view error while using spark 3.2.0 version
user_182016560
•
2
1
503
pyspark apache-spark adb sql python
pyspark structured streaming exiting with error socket.timeout: timed out
user_118851060
•
2
0
249
spark-structured-streaming pyspark apache-kafka apache-spark
Why is my hdfs capacity not remainng constant?
user_80896950
•
2
1
67
dataproc google-cloud-dataproc apache-spark-sql apache-spark hadoop
Why is Pandas-API-on-Spark's apply on groups a way slower than pyspark API?
user_70982620
•
2
0
522
spark-koalas pyspark apache-spark
PySpark - Timestamp behavior
user_24017820
•
2
2
314
pyspark databricks apache-spark
Error when running Pytest with DeltaTables
user_49040270
•
1
1
441
delta-lake pyspark apache-spark pytest unit-testing
How to agg a pyspark dataframe and show the intersection of the lists in a column?
user_181830250
•
1
1
147
pyspark apache-spark-sql apache-spark dataframe
Hot Questions