apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to connect RStudio Cloud to Spark?
user_183936810
•
2
1
152
sparklyr apache-spark r
PySpark applyinpands/grouped_map pandas_udf too many arguments
user_85644390
•
2
1
285
pyspark apache-spark python
PySpark External Table all fields are empty
user_119895100
•
2
1
193
jupyter-lab pyspark apache-spark-sql apache-spark
create a data frame from json coming from kafka using spark structured streaming in python
user_82379920
•
1
1
722
spark-structured-streaming apache-kafka apache-spark
Can we incrementally query a Hudi table based on a custom column (Spark SQL)
user_98644830
•
1
0
338
apache-hudi apache-spark
Caused by: java.lang.NullPointerException - pyspark data processing
user_181312390
•
1
0
341
pyspark apache-spark
Collect() call used for a UDF function that returns pretty fat column (out of 2 columns in total) to avoid crossJoin
user_58999970
•
6
0
140
pyspark apache-spark-sql apache-spark python
How to order nested list with pyspark
user_76918910
•
2
2
135
pyspark apache-spark
Getting duplicate records while querying Hudi table using Hive on Spark Engine in EMR 6.3.1
user_35314370
•
1
1
528
apache-hudi amazon-emr apache-spark hive
Passing column information to SparkSession within withColumn
user_50292950
•
1
1
27
pyspark apache-spark scala
Hot Questions