apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Pass dataframe column name as parameter to the function using scala?
user_64324180
•
2
1
947
databricks apache-spark scala
Spark Structured Streaming - Realtime aggregation for the last X hour(s) data
user_59122690
•
2
0
375
real-time-data spark-structured-streaming apache-spark scala
REGEXP_REPLACE for spark.sql()
user_153601700
•
2
1
2316
regexp-replace apache-spark-sql apache-spark sql regex
User Defined Aggregate Function in PySpark SQL
user_49187650
•
4
2
1730
pyspark pandas apache-spark-sql apache-spark user-defined-functions
SparkContext stop() does not end the driver pod - Shutdown hook is not called
user_44335530
•
2
0
254
pyspark apache-spark
Spark off heap memory expanding with caching
user_78048760
•
2
1
703
pyspark apache-spark
VS Code Jupyter Extension: Run my notebooks on a Spark cluster?
user_149471980
•
2
0
411
jupyter-notebook apache-spark visual-studio-code python
Spark : Get max consecutive decrease in value
user_153121200
•
2
2
229
pyspark apache-spark-sql apache-spark dataframe scala
Produce multiple lists from a list of lists in pyspark
user_153487400
•
2
1
51
rdd pyspark apache-spark
spark continuous streaming keeps resetting kafka offset
user_151246500
•
2
0
759
spark-streaming pyspark apache-kafka apache-spark python
Hot Questions