apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Having trouble convering pyspark dataframe to scala dataframe and passing it to a scala function
user_186370380
•
1
0
99
pyspark apache-spark scala python java
Scala Spark Add a Column with percentage of a number over sum
user_171016100
•
1
1
112
apache-spark scala
Pyspark: TypeError: unionByName() got an unexpected keyword argument 'allowMissingColumns'
user_186352470
•
2
0
1454
pyspark apache-spark-sql apache-spark python-3.x python
How to store Protobuf messages in a consolidated Parquet file using Spark
user_56303350
•
1
1
902
apache-spark protocol-buffers
Bigquery as metastore for Dataproc
user_157370420
•
2
1
155
spark-bigquery-connector google-cloud-dataproc apache-spark google-bigquery
How to generate one hour length parquet files with Spark Structured Streaming (Python)?
user_154110760
•
1
0
109
spark-structured-streaming parquet pyspark apache-spark
Forward fill pyspark to scala
user_127116600
•
1
1
34
pyspark apache-spark scala
PySpark task exception handling
user_110334470
•
1
0
1235
amazon-dynamodb pyspark boto3 apache-spark
How to convert XSD schema to Pyspark schema
user_67335630
•
1
0
274
pyspark apache-spark xsd python
Spark - Replace first occurrence in a string
user_176991510
•
1
1
327
apache-spark-sql apache-spark scala
Hot Questions