apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Write a spark DataFrame to a table
user_13040530
•
2
2
163
apache-spark-sql apache-spark hive
How to find the average of arrays (an array column) on 0th axis in a PySpark dataframe?
user_90315120
•
3
1
162
pyspark apache-spark-sql apache-spark python
Spark - How to colourise terminal output from spark-submit
user_8339600
•
2
1
158
apache-spark macos terminal
How to set Configuration of SparkContext correctly in Jupyter Notebook?
user_148680050
•
3
1
2875
jupyter-notebook pyspark apache-spark python
What does this mean ? WARNING:root:'PYARROW_IGNORE_TIMEZONE' environment variable was not set
user_148393740
•
6
1
2915
spark-koalas jupyter-notebook pyspark apache-spark python
object tools is not a member of package scala
user_50634390
•
4
1
859
fluentd apache-spark sbt scala java
Predicate pushdown on non partitioned parquet data
user_50191630
•
4
4
937
amazon-emr pyspark apache-spark amazon-s3
PySpark read DynamoDB formatted json
user_128055000
•
2
1
1386
amazon-dynamodb pyspark apache-spark amazon-web-services
: 'function' object has no attribute 'read' on jupyter
user_83946310
•
2
1
3503
jupyter pyspark apache-spark python
getPersistentRDDs returns Map of cached RDDs and DataFrames in Spark 2.2.0, but in Spark 2.4.7 - it returns Map of cached RDDs only
user_76184820
•
2
1
189
rdd apache-spark scala
Hot Questions