apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
java.net.SocketException:Connection reset exception when trying to load/write the data into redis from spark sql java application
user_151953100
•
2
0
164
spark-redis apache-spark-sql java
Evaluation parameters like Accuracy, Precision and recall in Pyspark 3.0+., Confusion Matrix in Pyspark
user_71474620
•
2
0
149
pyspark apache-spark-sql
Spark - Stategy for persisting derived dataframes when parent DF is already persisted
user_14858640
•
2
1
299
apache-spark-sql apache-spark dataframe scala
Stream-Static Join: How to refresh (unpersist/persist) static Dataframe periodically
user_120945660
•
5
1
2097
spark-streaming spark-structured-streaming apache-spark-sql apache-spark scala
How to quickly check if row exists in PySpark Dataframe?
user_137770190
•
3
2
3752
pyspark apache-spark-sql apache-spark exists python
Create a new column by replacing comma-separated column's values with a lookup based on another dataframe
user_151859020
•
3
2
249
pyspark apache-spark-sql apache-spark python
How to update a dataframe in PySpark with random values from another dataframe?
user_151826540
•
2
2
445
pyspark apache-spark-sql apache-spark dataframe
How to apply groupBy and aggregate functions to a specific window in a PySpark DataFrame?
user_143672790
•
2
1
240
pyspark apache-spark-sql apache-spark python
Compare the dataframe value with the list of values and get the list of values which is not present in dataframe
user_96239000
•
2
3
45
pyspark apache-spark-sql apache-spark python
How to transpose a dataframe in pyspark?
user_148729850
•
2
1
135
pyspark-dataframes pyspark apache-spark-sql apache-spark python
Hot Questions