apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Cache not enabled when querying BigQuery view using Spark BigQuery connector
user_149983800
•
2
1
635
google-cloud-dataproc pyspark apache-spark-sql apache-spark google-bigquery
Writing into partitioned Hive table takes longer as table grows
user_11385230
•
2
2
1016
hdfs parquet apache-spark hive hadoop
How to query when list of None is value in column in pyspark
user_138463480
•
2
1
341
pyspark apache-spark-sql apache-spark sql python
Spark Job only processes file in a single spark container
user_105304570
•
2
0
46
hadoop-partitioning hadoop2 google-cloud-dataproc apache-spark java
Spark Scala: functional difference in notation using $?
user_22059160
•
2
1
142
apache-spark-sql apache-spark scala
How to reverse OneHotEncoderEstimator transformation in Spark
user_12692810
•
4
0
143
apache-spark-mllib scikit-learn apache-spark scala
Pyspark write JSON column to Postgres using AWS Glue
user_99089520
•
3
1
631
aws-glue pyspark apache-spark postgresql python
How to create a connection with Oracle using Spark Scala without loading data?
user_149924140
•
3
1
363
apache-spark scala oracle sql
Databricks: OSError: [Errno 22] Invalid argument
user_89729150
•
3
0
305
pyspark databricks apache-spark python
How do I create a shared SparkSession fixture in scalatest that persists between test suites?
user_117617860
•
4
0
631
apache-spark scalatest fixtures scala
Hot Questions