apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Apply wordninja.split() using pandas_udf
user_32465730
•
1
2
50
pandas-udf pyspark apache-spark user-defined-functions split
DataProc YARN UI - wrong number of Vcores
user_118951210
•
2
0
55
dataproc hadoop-yarn google-cloud-dataproc apache-spark hadoop
How to group and count values in RDD to return a small summary using pyspark?
user_144232200
•
2
2
56
rdd pyspark apache-spark filter python
How to filter RDD by attribute/key and then apply function using pyspark?
user_144232200
•
2
2
45
rdd pyspark apache-spark filter python
How to get distinct keys as a list from an RDD in pyspark?
user_144232200
•
3
1
42
rdd pyspark apache-spark dictionary python
List of struct's field names in Spark dataframe
user_136230150
•
2
1
109
pyspark apache-spark dataframe struct schema
Find the position of a value in an array and use the position to get a value from array in other column
user_196915440
•
2
1
36
pyspark apache-spark dataframe position arrays
Convert Array values into Column name for another Array value in PySpark
user_104272490
•
2
2
63
bigdata pyspark databricks apache-spark arrays
How to apply if else udf pandas to pyspark dataframe on a column?
user_192152980
•
2
2
76
pyspark pandas apache-spark dataframe python
withField in Spark SQL
user_27535010
•
2
1
87
pyspark apache-spark-sql apache-spark struct sql
Hot Questions