spark-dataframe

113 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to split comma separated string and get n values in Spark Scala dataframe?
user_16485450
•
7
2
4263
spark-dataframe apache-spark-sql apache-spark dataframe scala
PySpark: How to fillna values in dataframe for specific columns?
user_41683970
•
66
2
135709
spark-dataframe pyspark apache-spark
Read from sql database in parallel using spark without knowing upper bound
user_14941450
•
4
2
3122
spark-dataframe apache-spark-sql apache-spark mysql
What is the best way to perform row wise calculations in Spark ? Details below
user_49358860
•
3
0
111
spark-dataframe hadoop-yarn hdfs apache-spark scala
Using Python's reduce() to join multiple PySpark DataFrames
user_56216290
•
5
2
4477
pyspark-sql spark-dataframe pyspark python-3.x python
Is it possible to store a numpy array in a Spark Dataframe Column?
user_37493790
•
11
3
4925
spark-dataframe pyspark numpy
How to combine and collect elements of an RDD into a list in pyspark
user_82362040
•
3
1
15851
pyspark-sql spark-dataframe pyspark python
JDBC configure utf8mb4 in Properties
user_20758310
•
4
0
1111
spark-dataframe utf8mb4 jdbc scala mysql
need instance of RDD but returned class 'pyspark.rdd.PipelinedRDD'
user_59351230
•
8
1
13195
spark-dataframe rdd apache-spark python
How do I increase decimal precision in Spark?
user_45564630
•
8
1
22397
spark-dataframe bigdata apache-spark scala python
Hot Questions