apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to create Dataset (not DataFrame) without using case class but using StructType?
user_51926890
•
3
3
8173
apache-spark-sql apache-spark scala
spark dataframe groupping does not count nulls
user_25879040
•
4
3
8387
apache-spark-sql apache-spark group-by null sql
Spark 2.2.0 FileOutputCommitter
user_32791890
•
13
1
9517
amazon-emr apache-spark-sql apache-spark hadoop amazon-s3
Error when passing data from a Dataframe into an existing ML VectorIndexerModel
user_84287120
•
3
1
1981
apache-spark-ml pyspark apache-spark-sql apache-spark python
Pyspark dataframe: how to apply scipy.optimize function by group
user_82487120
•
4
1
4546
pyspark apache-spark-sql apache-spark dataframe group-by
Pyspark transform method that's equivalent to the Scala Dataset#transform method
user_11251590
•
7
2
6511
apache-spark-dataset pyspark apache-spark-sql apache-spark
Spark JDBC fetchsize option
user_72245970
•
10
2
15463
apache-spark-sql apache-spark jdbc
How to set spark.sql.pivotMaxValues in python?
user_86025740
•
5
0
3532
pyspark-sql pyspark apache-spark-sql apache-spark
Compare Value of Current and Previous Row in Spark
user_64356370
•
7
1
8654
apache-spark-sql apache-spark scala
AttributeError: 'StructField' object has no attribute '_get_object_id': with loading parquet file with custom schema
user_83267500
•
4
1
7781
pyspark-sql pyspark apache-spark-sql apache-spark
Hot Questions