pyspark

4047 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How can I find the country using latitude & longitude information using Pyspark & shapely
user_99239570
•
2
1
672
shapely pyspark geospatial python
Combine month and year columns to create date column
user_165252630
•
2
3
1042
pyspark apache-spark-sql apache-spark python
Py4JJavaError: An error occurred while calling o389.parquet when trying to write rdd dataframe as parquet files on local directory
user_174046290
•
2
2
3921
typeerror parquet pyspark apache-spark python
PySpark - Issue with CPU heavy cartesian join when using multiple join columns
user_58693160
•
2
1
115
aws-glue pyspark apache-spark
How to specify the fully qualified class name of parquet while reading a trained spark mllib model to the code - pyspark
user_174473250
•
1
0
124
parquet pyspark apache-spark
foreach() method with Spark Streaming errors
user_132789060
•
1
1
459
spark-streaming-kafka spark-structured-streaming google-cloud-dataproc pyspark google-bigquery
How to add a column to pyspark df, the data format should be a list, and come from grouped data from the raw table
user_174395620
•
1
2
48
pyspark apache-spark-sql dataframe python
How to resample (Downsample) the time series big data, from 10 Hz (miliseconds) wants to convert to 1 Hz (seconds) using pyspark
user_133398040
•
2
1
506
bigdata pyspark apache-spark time-series python
Why does my build with executor cores specified OOM?
user12474509_149459390
•
1
1
140
foundry-python-transform foundry-code-repositories pyspark palantir-foundry
How to select columns and cast column types in a pyspark dataframe?
user_174389090
•
1
1
247
pyspark dataframe
Hot Questions