pyspark

4047 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
AWS EMR: Pyspark: Rdd: mappartitions: Could not find valid SPARK_HOME while searching: Spark closures
user_73439220
•
7
2
520
amazon-emr python-requests pyspark apache-spark-sql apache-spark
How Jupyter Notebook communicates with Spark Cluster
user_171602550
•
1
0
72
jupyter-notebook pyspark apache-spark cluster-computing
How to prevent spark query against CSV glue catalog source from including headers?
user_171596750
•
1
0
69
aws-glue-data-catalog aws-glue-spark pyspark apache-spark
How to split an array structure to csv in PysPark
user_27511790
•
2
1
102
spark-csv pyspark dataframe arrays python
Pyspark group by collect list, to_json and pivot
user_121327750
•
2
2
507
pyspark
(py)spark dataframe repartition across many IDs
user_65353240
•
2
1
247
pyspark apache-spark partitioning python
What is the Exact Apache-Spark NA Treatment Difference Pandas vs MLLib for Covariance Computation?
user_41862460
•
4
1
91
apache-spark-mllib pyspark pandas apache-spark python
How do I JOIN two datasets in Palantir Foundry within a code workbook?
user_171300060
•
1
2
559
foundry-code-workbooks pyspark palantir-foundry join
Pyspark alternative to withColumn/UDF for un-pickle-able objects (BucketedRandomProjectionLSHModel)
user_43356000
•
1
0
221
apache-spark-ml pyspark pickle python
pyspark when otherwise statement returning incorrect output
user_93445850
•
1
2
72
pyspark apache-spark-sql apache-spark case
Hot Questions