apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Skewed Window Function & Hive Source Partitions?
user_112865880
•
3
2
1299
pyspark apache-spark time-series hive scala
Spark Python Pyspark How to flatten a column with an array of dictionaries and embedded dictionaries (sparknlp annotator output)
user_40627510
•
4
1
3513
johnsnowlabs-spark-nlp pyspark apache-spark scala python
What's the time and space complexity of the PIVOT operation in Spark SQL?
user_35229370
•
3
0
227
apache-spark space-complexity time-complexity sql
Run spark-shell from sbt
user_15873290
•
4
1
1796
spark-shell apache-spark sbt scala
How to optimize searching RDD contents in another RDD
user_13588170
•
2
1
130
pyspark apache-spark
How to manage the 'wait' state in Nifi ExecuteSparkINteractive processor?
user_25603270
•
2
1
431
livy apache-nifi apache-spark
Calling pyspark.sql.functions.from_json within udf
user_116817460
•
2
0
241
pyspark apache-spark-sql apache-spark user-defined-functions json
Should cache and checkpoint be used together on DataSets? If so, how does this work under the hood?
user_59836520
•
9
1
1616
apache-spark-dataset apache-spark-sql apache-spark
Is it possible to change a column name in Spark SQL in Hive?
user_54467670
•
3
1
4206
apache-spark hive sql
Save schema of dataframe in S3 location
user_75464420
•
2
2
4580
pyspark databricks apache-spark amazon-s3
Hot Questions