apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to preserve partitioning through dataframe operations
user_91956970
•
4
1
1775
apache-spark dataframe
saving compressed json from spark
user_59052450
•
5
1
2881
apache-spark hadoop gzip scala json
Spark Dataset/Dataframe join NULL skew key
user_64849300
•
5
2
2501
skew apache-spark-sql apache-spark
How can I reference a column with a hyphen in its name in a pyspark column expression?
Jared_447570
•
2
1
1762
pyspark-sql pyspark apache-spark-sql apache-spark python
spark write: CSV data source does not support null data type
user_597040
•
3
1
7655
apache-spark-sql apache-spark scala
Passing typesafe config conf files to DataProcSparkOperator
user_98453660
•
3
1
1727
typesafe-config google-cloud-composer airflow google-cloud-dataproc apache-spark
Filtering and counting negative/positive values from a Spark dataframe using pyspark?
user_82781690
•
4
3
8799
pyspark apache-spark-sql apache-spark
replace null value in the column of a dataframe with the value in other dataframe wrt to id
user_94622570
•
2
1
1099
apache-spark scala
How to handle log in Spark Cluster Mode
user_20070340
•
2
0
2477
bigdata hadoop2 apache-spark-sql apache-spark log4j
Spark 2.3+ use of parquet.enable.dictionary?
user_25074060
•
8
2
4815
parquet apache-spark
Hot Questions