apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Spark Python/SQL - how to group with unique combinations
user_176037650
•
1
1
77
pyspark apache-spark sql python
pyspark repeat function pass parameter dynamically based on column data length
user_29478310
•
1
1
331
pyspark apache-spark-sql apache-spark python
How to get the Hadoop path with Java/Scala API in Code Repositories
user_75356890
•
2
1
111
foundry-code-repositories palantir-foundry apache-spark
Scala - Convert column having comma separated numbers (currently string) to Array of Double in Dataframe
user_127678130
•
1
2
488
apache-spark dataframe scala
How to speed up or avoid crossJoin on two spark dataframes?
user_112074470
•
1
0
92
pyspark apache-spark
Read data from s3 using local machine - pyspark
user_61960580
•
1
2
2127
pyspark apache-spark amazon-web-services hadoop amazon-s3
Convert List of strings to list of structs
user_123522390
•
1
1
276
apache-spark scala
where is the executor log when I run spark in local mode
user_17018400
•
1
0
45
pyspark apache-spark python
Google cloud dataproc cluster created with an environment.yaml with a jupyter resource but environment not available as a jupyter kernel
user_80896950
•
1
1
325
dataproc jupyter-notebook google-cloud-dataproc pyspark apache-spark
Spark on Win10 installation erroring out at None.org.apache.spark.api.java.JavaSparkContext
user_51231110
•
2
1
2191
pyspark apache-spark
Hot Questions