apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
More than 1 column in record key in spark Hudi Job while making an upsert
user_31992850
•
2
2
2017
apache-hudi apache-spark-sql apache-spark
How to get Last 1 hour data, every 5 minutes, without grouping?
user_9597880
•
3
1
1872
delta-lake spark-streaming spark-structured-streaming apache-spark-sql
Spark number of tasks vs number of partitions
user_94452880
•
2
0
116
pyspark apache-spark-sql apache-spark
how to improve performance in pyspark joins
user_131267940
•
2
1
101
pyspark apache-spark-sql apache-spark python
Spark collect_set vs distinct
user_56272170
•
2
1
1247
apache-spark-sql apache-spark
Pyspark: java.lang.ClassNotFoundException: Failed to find data source: com.microsoft.sqlserver.jdbc.spark (SQL Data Pool)
user_141603270
•
2
2
6492
spark-streaming mssql-jdbc pyspark apache-spark-sql
Append a monotonically increasing id column that increases on column value match
user_141489850
•
2
2
327
apache-spark-sql apache-spark
Filter values not equal in pyspark
user_55141780
•
2
4
3197
pyspark apache-spark-sql apache-spark null sql
Spark unit test -- Mock Azure SQLJDBC connection
user_70545290
•
2
0
112
apache-spark-sql apache-spark mockito scala unit-testing
MicroBatchExecution: Query terminated with error UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$Windows.access0(Ljava/lang/String;I)Z
user_141174780
•
2
1
1342
spark-streaming-kafka spark-structured-streaming apache-spark-sql apache-spark java
Hot Questions