apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Slow join in pyspark, tried repartition
user_21007830
•
3
2
3816
pyspark apache-spark-sql apache-spark
What is the best practice to install IsolationForest in DataBrick platform for PySpark API?
user_104527000
•
2
2
632
pyspark azure-databricks databricks apache-spark python
Problems when writing parquet with timestamps prior to 1900 in AWS Glue 3.0
user_126381180
•
17
3
11409
aws-glue pyspark apache-spark amazon-web-services
What is the recommended cluster size for a Spark job with 35,000 partitions
user_14373460
•
4
0
187
google-cloud-dataproc apache-spark
How to use regex in Spark Scala to convert RDD to Dataframe after reading an unstructured text file?
user_66010110
•
1
2
374
apache-spark scala regex
hyperopt SparkTrials maxNumConcurrentTasks([]) does not exist
user_14481950
•
1
1
152
hyperopt pyspark apache-spark-sql apache-spark python
Access Hive table from HDinsight cluster
user_74221280
•
1
1
219
azure-hdinsight apache-spark hive hadoop python
How to use columns to create queries (e.g. WHERE clause)?
user_18751070
•
2
2
85
pyspark apache-spark-sql apache-spark
Spark driver/executor doesn't allow logging of Prometheus Jmx-exporter's fine logs that is should output as JMX-agent
user_17590630
•
1
0
136
google-spark-operator jmx-exporter prometheus apache-spark javaagents
In Spark scala dataframe how do i get week end date based on week number
user_32407900
•
3
3
572
apache-spark scala
Hot Questions