apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
pyspark fillna is not working on column of ArrayType
user_22651900
•
2
1
676
pyspark apache-spark-sql apache-spark
Pyspark 3.1.2 problem "expected zero arguments for construction of ClassDict"
user_22651900
•
2
1
408
pyspark apache-spark-sql apache-spark user-defined-functions
How to GROUPBY a segment of variables considered as a sequence in Pyspark?
user_34415530
•
1
0
38
pyspark apache-spark-sql apache-spark group-by scala
Spark Dataframe : Group by custom Range
user_133737590
•
1
1
269
databricks apache-spark dataframe
How to count distinct based on a condition over a window aggregation in PySpark?
user_13327390
•
2
2
552
distinct-values pyspark apache-spark window-functions python
Continuous trigger does not work with Spark Structured Streaming with valid sinks
user_49529750
•
2
1
525
spark-streaming spark-structured-streaming apache-kafka apache-spark scala
How to assign class weights for a Logistic Regression Model in Apache Spark's MLlib (Python)
user_100376890
•
2
0
393
apache-spark-mllib apache-spark-ml pyspark apache-spark machine-learning
Apache Airflow Docker : How to install external airflow provider packages
user_150705590
•
2
1
1272
airflow docker-compose apache-spark docker python
Pyspark dataframe error in Synapase notebook
user_90903400
•
3
0
157
azure-synapse pyspark apache-spark-sql apache-spark
How to seperate CSV values with in a cell in pyspark dataframe to new columns and their values respectively
user_103608450
•
2
1
96
pyspark apache-spark python
Hot Questions