apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Grouping records based on a pattern of row values using PySpark
user_92389280
•
2
1
547
pyspark-sql pyspark apache-spark-sql apache-spark python
Writing to DB2 database gets stuck inside foreachpartition() from my Java code on Spark Cluster with 20 worker nodes configured
user_131806930
•
2
0
235
pyspark apache-spark-sql apache-spark distributed-computing
Spark application with Hive Warehouse Connector saves array and map fields wrongly in Hive table
user_10514410
•
3
1
1235
apache-spark-sql apache-spark hive hadoop scala
How to create date from year, month and day in PySpark?
user_58082160
•
6
3
12325
pyspark apache-spark-sql apache-spark python
Why it takes more time to write into hive stage directory using insertInto function in Spark?
user_13022810
•
2
0
265
apache-spark-sql apache-spark hive hadoop
Does anyone know how I can work with big data in R?
user_115628300
•
3
2
275
tidytext bigdata apache-spark-sql r
Efficient way of appending Spark DataFrames in a loop using pyspark
user_131075960
•
2
3
4240
pyspark-sql pyspark-dataframes pyspark apache-spark-sql apache-spark
Create new column based on data in existing column
user_54914280
•
2
1
88
pandas-groupby pandas apache-spark-sql python-3.x
Drop table using Pyspark
user_105524690
•
3
1
7446
pyspark apache-spark-sql apache-spark hive scala
Pyarrow error: while running a pandas udf in pyspark
user_25284640
•
2
1
2365
pyspark pandas apache-spark-sql apache-spark python
Hot Questions