apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to use a Scala class inside Pyspark
user_16897060
•
25
2
19140
pyspark apache-spark-sql apache-spark scala python
Pyspark : forward fill with last observation for a DataFrame
user_38297360
•
19
5
23760
pyspark apache-spark-sql apache-spark
Replacing whitespace in all column names in spark Dataframe
user_38462910
•
11
7
29240
apache-spark-sql apache-spark scala
How to filter based on array value in PySpark?
user_52569680
•
17
2
48777
pyspark apache-spark-sql apache-spark dataframe python
Spark SQL - How to write DataFrame to text file?
user_19077550
•
11
2
34601
apache-spark-sql java
Spark Is there any rule of thumb about the optimal number of partition of a RDD and its number of elements?
user_60451330
•
7
2
7821
apache-spark-sql apache-spark partitioning
SparkSQL function require type Decimal
user_60436150
•
4
1
16544
apache-spark-sql apache-spark scala types
Spark DataFrame not respecting schema and considering everything as String
user_19269310
•
7
1
9164
apache-spark-mllib apache-spark-sql apache-spark scala-collections scala
Converting a string to double in a dataframe
user_33871340
•
3
1
16808
apache-spark-sql apache-spark
Why does SparkSQL support implicit unwrapping of Options but not wrapping?
user_13795990
•
3
0
173
apache-spark-sql apache-spark scala
Hot Questions