apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Spark dataframe: Pivot and Group based on columns
user_11407250
•
4
2
2317
spark-dataframe apache-spark hadoop scala
How to find pyspark dataframe memory usage?
user_35169360
•
15
5
21258
pyspark apache-spark dataframe python
How to bin in PySpark?
user_4613890
•
35
3
32155
pyspark apache-spark
Read CSV with linebreaks in pyspark
user_18276900
•
6
2
3406
pyspark apache-spark csv python-3.x
What does "pre-built for Apache Hadoop 2.7 and later" mean?
user_11650080
•
7
1
1235
apache-spark
How to set spark.sql.pivotMaxValues in python?
user_86025740
•
5
0
3532
pyspark-sql pyspark apache-spark-sql apache-spark
Use schema to convert ConsumerRecord value to Dataframe in spark-kafka
Admin1
•
7
2
3076
apache-kafka apache-spark scala
How to continuously monitor a directory by using Spark Structured Streaming
user_77516040
•
10
2
8995
spark-structured-streaming apache-spark scala
Compare Value of Current and Previous Row in Spark
user_64356370
•
7
1
8654
apache-spark-sql apache-spark scala
AttributeError: 'StructField' object has no attribute '_get_object_id': with loading parquet file with custom schema
user_83267500
•
4
1
7781
pyspark-sql pyspark apache-spark-sql apache-spark
Hot Questions