apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
kafkashaded.org.apache.kafka.common.errors.TimeoutException: Failed to update metadata after 60000 ms
user_80852760
•
2
0
148
confluent-kafka-python rdd pyspark apache-spark
What is the equivalent of pandas.cut() in PySpark?
user_111554190
•
3
1
1877
pyspark pandas apache-spark python
Exposing Spark Driver and Worker stdout stderr logs in Kubernetes to History Server
user_26857830
•
5
1
686
apache-spark kubernetes amazon-web-services
Spark Structured Streaming Dynamic Parsing of XML
user_27424090
•
2
0
172
spark-structured-streaming pyspark apache-spark python
Parquet compression degradation when upgrading spark
user_22042060
•
5
1
207
snappy parquet apache-spark-sql apache-spark
Spark- write 128 MB size parquet files
user_87614460
•
3
2
2912
apache-spark-sql apache-spark dataframe scala
Find "primary key" for any pyspark dataset
user_96772710
•
2
1
912
pyspark apache-spark python
Why does Spark perform an unnecessary shuffle during a joinWith on a pre-partitioned dataframe?
user_14373460
•
3
1
63
apache-spark-sql apache-spark
net.snowflake.client.jdbc.SnowflakeSQLException: JWT token is invalid
user_80852760
•
2
1
568
snowflake-cloud-data-platform pyspark databricks apache-spark python
java.lang.NoClassDefFoundError: org/apache/spark/streaming/dstream/InputDStream
user_148563820
•
2
0
308
spark-streaming apache-kafka apache-spark scala
Hot Questions