apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
az synapse spark job submit
user_27515730
•
1
1
88
azure-synapse apache-spark azure scala
External table from existing data with additional column
user_88432220
•
2
0
367
external-tables pyspark databricks apache-spark
How to overwrite pyspark DataFrame schema without data scan?
user_16614910
•
4
1
998
pyspark apache-spark-sql apache-spark
select rows to read pyspark dataframe based on a latest date value
user_172280080
•
1
1
298
pyspark apache-spark dataframe python
What is the maximum length limitation for VARCHAR type in Spark?
user_60930880
•
1
1
324
apache-spark-sql apache-spark scala java
Error occurred while calling None.org.apache.spark.api
user_185725890
•
2
0
1009
apache-spark
How to dynamically add column/values to Map Type in pyspark dataframe
user_38352340
•
1
1
715
pyspark apache-spark-sql apache-spark python
How to take random n sample for each distinct value in a column in spark?
user_109183840
•
1
0
195
pyspark apache-spark-sql apache-spark group-by
Is there an Apache Arrow equivalent of the Spark Pandas UDF
user_125659590
•
4
0
212
python-polars apache-arrow pandas apache-spark user-defined-functions
How to process a large delta table with UDF?
user_44932120
•
2
1
247
delta-lake pyspark databricks apache-spark user-defined-functions
Hot Questions