apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to convert text log which contains partially json string to the structured in pyspark?
user_142804760
•
2
2
179
rdd pyspark apache-spark-sql apache-spark python-3.x
How spark (2.3 or new version) determine the number of tasks to read hive table files in gs bucket or hdfs?
user_10063440
•
6
1
432
google-cloud-dataproc apache-spark hive hadoop
cannot load parquet file (Parquet type not supported: INT32 (UINT_8);) with pyspark
user_85782200
•
5
1
4406
parquet pyspark apache-spark
Difference between explode and explode_outer
user_21298010
•
7
1
8704
apache-spark-sql apache-spark
How to dynamically chain when conditions in Pyspark?
user_143387160
•
2
3
1567
pyspark apache-spark dataframe python
Is there a way to iterate through a pyspark dataframe and identify sessions without an explicit session key?
user_114889000
•
3
1
256
pyspark databricks apache-spark python
Write pyspark dataframe into kms encrypted s3 bucket
user_144557590
•
2
0
488
pyspark apache-spark amazon-s3
How to merge rows using SQL only?
user_14759620
•
2
3
102
apache-spark-sql apache-spark sql
Scala Spark use Window function to find max value
user_4696820
•
6
2
4664
apache-spark-sql apache-spark scala
Remove empty strings from list in DataFrame column
user_19459810
•
3
2
1003
pyspark apache-spark-sql apache-spark
Hot Questions