apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Writing to SQL Server datetime datatype from Scala/Spark
user_22878160
•
7
0
1993
databricks apache-spark scala sql-server
Parquet compression performance grouped vs flat data
user_37418590
•
2
1
206
bigdata parquet apache-spark compression
Spark Dataframe - Sampling records randomly for each day
user_82295340
•
3
1
338
apache-spark
Get field values from a structtype in pyspark dataframe
user_115038620
•
3
1
8999
pyspark apache-spark
could not find function "switch_lang"
user_49706100
•
5
1
2249
rlang sparklyr dplyr apache-spark r
using python class methods on RDD
user_115386430
•
2
1
748
rdd pyspark apache-spark class python
Spark convert array of structs to Vector for Euclidean distance
user_50801950
•
3
1
1229
apache-spark-mllib apache-spark-sql apache-spark user-defined-functions
Why I am not able to get elements of the List from out side of the loop using {Scala}
user_68032540
•
2
0
38
apache-spark scala
If you save a DataFrame to disk, will Spark load that data if you use that DataFrame lower in the script?
user_139690
•
2
1
154
pyspark apache-spark-sql apache-spark caching python
Unable to load 25GB dataset in PySpark local mode with 56GB RAM free
user_139690
•
3
2
586
pyspark apache-spark heap-memory python java
Hot Questions