apache-spark

apache-spark

436 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Why is my Pyspark Text Classification Slow
V Varsha0
•
0
0
16
johnsnowlabs-spark-nlp apache-spark-mllib apache-spark-ml pyspark apache-spark
ImportError: cannot import name 'VarcharType' from 'pyspark.sql.types'
AutumnRain0
•
0
1
28
pyspark apache-spark sql python
system cannot find file specified error in pyspark
Christopher Johnson0
•
0
0
19
windows pyspark apache-spark python
How Spark share shuffle files?
userVuHt0
•
0
0
19
shuffle apache-spark
Spark orc files to BigQuery table worker failing with error Caused by: java.lang.ArrayIndexOutOfBoundsException: 2436
Yeshvant Bhavnasi0
•
0
0
19
orc google-bigquery apache-spark apache-spark-sql
Create rows for 0 values when aggregating all combinations of several columns
gillygangles0
•
1
2
32
aggregation combinations pyspark apache-spark apache-spark-sql
EMR Serverless Read From S3 Cross Account
Renan Nogueira0
•
0
0
24
amazon-emr amazon-vpc amazon-s3 apache-spark amazon-web-services
Pyspark - Dynamically create schema from json files
gip0
•
1
1
48
azure-databricks databricks pyspark apache-spark python
Pyspark split the file while writing with specific limit
Vikas T0
•
0
0
27
spark2.4.4 pyspark apache-spark python
Filter an Rdd[String] based on data indicator if it is present otherwise filter based on header and trailer indicator present of file
Deb0
•
0
1
21
rdd apache-spark apache-spark-sql scala
Hot Questions