apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
remove rows when values from two columns are the same combination in pyspark
user_63793480
•
2
4
163
pyspark pandas apache-spark python
Make a not available column in PySpark dataframe full of zero
user_75859730
•
1
1
43
pyspark apache-spark fill dataframe python
How to count number of days for every month in a date range
user_100168460
•
3
2
119
pyspark apache-spark days datediff date
For upgrading to Spark 3.2.1, how to find which versions of other libraries are compatible with Spark 3.2.1
user_52002320
•
1
1
103
apache-spark jackson dependency-management maven dependencies
Updating a column with a function in spark scala
user_160433730
•
1
1
42
apache-spark user-defined-functions scala
gcloud CLI application logs to bucket
user_135080740
•
2
1
48
google-cloud-dataproc apache-spark google-cloud-platform log4j scala
Keep rows with one particular value in one column using some condition in another column in same dataframe
user_99859620
•
1
1
46
pyspark apache-spark-sql apache-spark multiple-columns filter
Py4JException: Constructor org.apache.spark.sql.SparkSession([class org.apache.spark.SparkContext, class java.util.HashMap]) does not exist
user_110380170
•
2
1
2260
jupyter-notebook pyspark apache-spark-sql apache-spark python
EMR, Spark: proper place for a local shared cache
user_19165360
•
2
1
117
amazon-emr hadoop-yarn apache-spark hadoop caching
TypeError: 'JavaPackage' object is not callable | using java 11 for spark 3.3.0, sparknlp 4.0.1 and sparknlp jar from spark-nlp-m1_2.12
user_73639350
•
2
1
84
johnsnowlabs-spark-nlp pyspark apache-spark nlp
Hot Questions