apache-spark

apache-spark

436 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Create N tables from a base table with table names derived from column values without a for loop
siva0
•
0
1
26
pyspark apache-spark
Graphframes static connected component
Innovation0
•
0
0
6
graphframes apache-spark
Sum up columns that are nested structs to get another column of the same structure in pyspark
Ameya Bhave0
•
1
0
18
struct pyspark apache-spark apache-spark-sql python
Spark SQL: How to assign the same ID for a group of rows
Zif Origin0
•
1
1
20
apache-spark apache-spark-sql
Scala Spark read parquet file from AWS S3 Issue in schema
PRAVIN MASKE0
•
0
0
11
parquet apache-spark scala
data distribution in spark dataframes while reading files from s3
PSD0
•
0
0
9
apache-spark apache-spark-sql scala
How can I sum multiple columns in pyspark and return the max?
armin0
•
1
3
36
pyspark apache-spark python
Cannot import commons-dbutils in sbt
Vaisakh0
•
0
0
8
apache-commons-dbutils apache-spark-3.0 apache-commons sbt apache-spark
Spark dataframe create explode with order
Meclier.0230
•
0
1
20
explode pyspark apache-spark apache-spark-sql arrays
split apache spark dataframe into multiple chunk dataframes for crossJoin acceleration
amine jisung0
•
0
1
31
pyspark apache-spark apache-spark-sql
Hot Questions