apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How does --master local[K] and --conf spark.executor.cores determine the number of threads?
user_164832880
•
1
0
27
apache-spark
How to query INFORMATION_SCHEMA view using spark bq connector?
user_40203020
•
1
3
591
apache-spark google-bigquery google-cloud-platform
Performance tuning of HQL script
user_161896830
•
1
0
40
hiveql apache-spark hive hql performance
How to get aws_attributes programatically in PySpark?
user_80346860
•
1
1
33
pyspark databricks apache-spark amazon-web-services
fMeasure() missing 1 required positional argument: 'label' - print_performance_metrics(predictions)
user_122402870
•
1
1
431
pyspark apache-spark
Why sort based aggregation is used instead of hash based when aggregation function over string is used
user_13158330
•
1
0
141
spark-streaming spark-structured-streaming apache-spark-sql apache-spark
Embarringly Parallel Structured Streaming: Eventhub and Databricks
user_117587020
•
2
0
456
azure-eventhub azure-databricks apache-spark azure
How to convert / explode dict column from pyspark DF to rows
user_110227310
•
1
2
445
pyspark apache-spark dictionary python json
error when spark sql read parquet table with text partition
user_106576480
•
1
0
87
hive-metastore hdp apache-spark-sql apache-spark hive
Drop spark dataframe duplicates keeping into account possible columns permutation
user_132789060
•
2
0
69
pyspark apache-spark dataframe python
Hot Questions