apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Kafka transaction support in Spark?
user_7597380
•
2
0
194
kafka-consumer-api apache-kafka apache-spark
Special characters in Dataproc partition columns
user_111403260
•
2
1
161
google-cloud-dataproc-metastore google-cloud-dataproc apache-spark hive
VACUUM/OPTIMIZE Effect on Autoloader Checkpoints
user_111375620
•
4
1
321
azure-databricks databricks apache-spark
Pyspark streaming append pivoted batch to sql server
user_154636970
•
3
1
268
pyspark apache-spark pivot sql
AttributeError: Can't get attribute 'new_block' on <module 'pandas.core.internals.blocks'>
user_82785150
•
41
6
59078
pyspark pandas apache-spark attributeerror python
Load to BigQuery Via Spark Job Fails with an Exception for Multiple sources found for parquet
user_15112940
•
2
1
482
google-cloud-dataproc apache-spark google-bigquery scala
How can I stop spark-submit jobs on yarn in airflow with SSHOperator
user_162857680
•
2
1
422
hadoop-yarn airflow apache-spark
Convert a DataFrame to RDD and Split the RDD into the same number of Columns as DataFrame Dynamically
user_165686400
•
2
1
78
rdd apache-spark dataframe scala
Reading from one Hadoop cluster and writing to another Hadoop custer
user_83531080
•
3
2
739
hdfs apache-spark hadoop
redshift libs for pyspark
user_35479930
•
2
1
214
amazon-redshift pyspark apache-spark
Hot Questions