apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
ipython is not recognized as an internal or external command (pyspark)
user_89241620
•
4
3
17955
pyspark apache-spark hadoop python
How can I replace multiple characters from all columns of a spark dataframe?
user_37017890
•
4
2
9043
spark-dataframe pandas apache-spark python
Caused by: java.lang.NullPointerException at org.apache.spark.sql.Dataset
user_89520230
•
5
2
18943
apache-spark-sql apache-spark dataframe scala
Why is Spark breaking my stage into 3 different stages with the same description and DAG?
user_87342640
•
3
0
170
apache-spark scala
How to get the output from console streaming sink in Zeppelin?
user_12981530
•
15
2
11888
apache-zeppelin spark-structured-streaming pyspark apache-spark
How to Generate Parquet File Using Pure Java (Including Date & Decimal Types) And Upload to S3 [Windows] (No HDFS)
user_14587380
•
6
1
18042
parquet avro apache-spark amazon-s3 java
Why is no map function for dataframe in pyspark while the spark equivalent has it?
user_16222560
•
7
1
1774
pyspark apache-spark
Converting rdd to dataframe: AttributeError: 'RDD' object has no attribute 'toDF'
user_10780840
•
6
2
17958
pyspark apache-spark
Is manually managing memory with .unpersist() a good idea?
user_70484210
•
7
1
732
spark-dataframe apache-spark garbage-collection scala
Slow features engineering in PySpark
user_73958560
•
7
0
867
apache-spark-ml feature-engineering pyspark apache-spark
Hot Questions