apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to use Spark DataFrame column value to update the elasticsearch
user_127657180
•
1
0
72
elasticsearch apache-spark-sql
PySpark: Read the csv data in pyspark frame. Why does it show special characters in frame? Any way to show in a tabular form except using pandas
user_93694830
•
2
2
151
pyspark apache-spark-sql python
databricks spark sql copy into not loading data
user_1123170
•
2
1
524
databricks apache-spark-sql
Using a pyspark sql function inside lambda causing pickle error
user_116973940
•
1
1
262
pyspark apache-spark-sql apache-spark
How do I load gziped json data into table, using Spark SQL's CREATE TABLE Query
user_2609980
•
3
1
250
apache-superset apache-spark-sql apache-spark
Why can coalesce lead to too few nodes for processing?
user_80896950
•
1
2
272
rdd pyspark apache-spark-sql apache-spark coalesce
Case when statement to conditionally populate columns in pyspark
user_116973940
•
1
0
65
pyspark apache-spark-sql apache-spark python
Why Spark DataSet loses all its schema and just returning byte[]?
user_65088190
•
3
1
153
apache-spark-dataset apache-spark-sql apache-spark scala
pyspark fillna is not working on column of ArrayType
user_22651900
•
2
1
676
pyspark apache-spark-sql apache-spark
Pyspark 3.1.2 problem "expected zero arguments for construction of ClassDict"
user_22651900
•
2
1
408
pyspark apache-spark-sql apache-spark user-defined-functions
Hot Questions