pyspark

4047 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to run inference of a custom pytorch model (madule) on pyspark dataframe?
user_170013080
•
1
0
35
mlops pytorch pyspark apache-spark python
Why SparkSession class of pyspark is in pyspark.sql not pyspark?
user_180380140
•
1
1
33
pyspark apache-spark
What is the most efficient way to select distinct value from a spark dataframe?
user_46975010
•
1
2
145
pyspark apache-spark-sql apache-spark
Filter thresold Size data to read using Pyspark or Python
user_113855760
•
2
2
39
pyspark python-3.x file
How to direct DLT target table to a Unity Catalog Metastore
user_165879530
•
1
1
143
databricks-unity-catalog delta-live-tables pyspark databricks
Azure Databricks: Failed to extract data which is between two timestamps within those same dates using Pyspark
user_165013320
•
1
1
59
pyspark azure-databricks databricks apache-spark python
Relationalizing and denormalising a complex nested JSON structure in Spark / AWS Glue
user_9917100
•
1
0
42
aws-glue-spark aws-glue pyspark apache-spark
How do i save a single value output of a Spark.SQL output as a variable to use further in code
user_172994050
•
2
1
61
snowflake-cloud-data-platform pyspark python
How to solve OOM error in Azure Databricks due to using Pandas datasets?
user_188344020
•
1
1
121
pyspark pandas azure-databricks databricks python
Reading json file causing corrupt_record in pyspark
user_87387340
•
3
1
62
pyspark apache-spark
Hot Questions