apache-spark

apache-spark

436 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Error when importing udf from module -> SparkContext should only be created and accessed on the driver
Tytire Recubans0
•
0
0
31
runtime-error pyspark apache-spark python
ERROR MicroBatchExecution: When integrating Kafka with pySpark
Bernard Joshua0
•
0
1
27
apache-kafka pyspark apache-spark apache-spark-sql python
Extract a string from a another column using regexp_extract
DOT GAMING0
•
0
1
42
extract pyspark apache-spark apache-spark-sql regex
Is the runtime of get_json_object constant regardless of data size?
usernKaO0
•
0
0
15
pyspark apache-spark apache-spark-sql
How to pick yesterday date in spark sql for a date in Unix Date Format?
jayakar jayaraman0
•
0
1
24
format date unix apache-spark sql
How to use two AWS credentials in PySpark
Renan Nogueira0
•
0
1
29
pyspark apache-spark apache-spark-sql python
Data Source "kafka" fails with PySpark
Bernard Joshua0
•
0
1
28
spark-structured-streaming apache-kafka pyspark apache-spark
Unable to remove blank dict from an array in pyspark column
Rudrashis0
•
-1
1
77
azure-databricks databricks pyspark apache-spark python-3.x
Take columns and values from dataframe and process the values
Gigi0
•
0
0
26
java dataframe apache-spark
Spark cache/persist vs shuffle files
ffff0
•
1
3
29
apache-spark
Hot Questions