apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to add leading zero padding with the specified number of digits in scala spark?
user_115243320
•
4
1
9391
apache-spark-sql scala
Query Hive table in spark 2.2.0
user_116737910
•
2
2
295
apache-spark-sql apache-spark hive hadoop
Spark inserting data into hive external table creating very small part files
user_117103540
•
2
1
1913
pyspark-sql hiveql pyspark apache-spark-sql apache-spark
Check particular identifier is present in the other data frame or not
user_43498440
•
3
2
71
apache-spark-sql apache-spark dataframe scala
How can I add an Index grouped by ID in Dataframe Spark
user_88326870
•
2
1
605
apache-spark-sql apache-spark dataframe scala
Create a single schema dataframe when reading multiple csv files under a directory
user_86142030
•
6
0
1053
apache-spark-sql csv io scala
Calling pyspark.sql.functions.from_json within udf
user_116817460
•
2
0
241
pyspark apache-spark-sql apache-spark user-defined-functions json
Should cache and checkpoint be used together on DataSets? If so, how does this work under the hood?
user_59836520
•
9
1
1616
apache-spark-dataset apache-spark-sql apache-spark
Unable to write dataframe of pyspark into mysql database
user_111626320
•
2
0
228
pyspark avro apache-spark-sql dataframe
Casting the Dataframe columns with validation in spark
user_83742860
•
3
1
758
apache-spark-sql apache-spark scala
Hot Questions