apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Mapping Kafka to Spark dataFrame with the Schema
user_142934860
•
2
0
170
spark-structured-streaming apache-kafka apache-spark-sql apache-spark
Pyspark session error: "requirement failed: key cannot be null"
user_173207970
•
1
0
205
pyspark apache-spark python-3.x
How are spark jobs submitted in cluster mode?
user_80896950
•
2
1
159
spark-submit dataproc google-cloud-dataproc pyspark apache-spark
Do env variables transfer from driver to workers?
user_80896950
•
2
0
266
dataproc google-cloud-dataproc pyspark apache-spark
Add new element to nested array of structs pyspark
user_89083890
•
2
1
594
pyspark apache-spark-sql apache-spark dataframe python
pyspark sql convert date format from mm/dd/yy hh:mm or yyyy-mm-dd hh:mm:ss into yyyy-mm-dd hh:mm format
user_178546520
•
1
1
339
pyspark apache-spark-sql apache-spark sql
How to pass env variables in dataproc submit command?
user_80896950
•
2
1
417
spark-submit dataproc google-cloud-dataproc pyspark apache-spark
Does spark.sql.functions.typedLit supports Map[String, Any]
user_22514670
•
1
1
419
spark-streaming apache-spark-sql apache-spark scala
How can extract date from struct type column in PySpark dataframe?
user_104527000
•
1
1
304
pyspark apache-spark-sql apache-spark
suggestion for tune up the code which contains explode and groupby
user_20423890
•
1
2
59
apache-spark-sql apache-spark explode scala performance
Hot Questions