apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Is there a methodology and a well stablished library for Data Visualization in Big Data?
user_68433330
•
2
0
55
pyspark pandas apache-spark-sql python
Do I need to manually repartition a big csv file when I read it with spark.read
user_58771220
•
2
1
222
apache-spark-sql apache-spark
Convert string list to binary list in pyspark
user_38114010
•
4
3
1347
pyspark-dataframes pyspark apache-spark-sql apache-spark
Spark Get the udf name from column and execute it
user_121817820
•
3
1
313
apache-spark-sql apache-spark java
Apache Spark: How many partitions can a executor hold in spark.? How are the partitions distributed (mechanism) among the executors?
user_100151680
•
9
1
3311
apache-spark-sql apache-spark
Performance comparison with take(10) vs limit(10).collect()
user_115905820
•
5
3
1812
apache-spark-sql apache-spark dataframe scala
Spark (Scala) Parsing issue of a fields having timestamp format as ("dd-MMM-yy hh:mm:ss:SSSSSSSSS aa")
user_28782980
•
3
1
677
apache-spark-sql apache-spark excel datetime scala
How to handle an AnalysisException on Spark SQL?
user_101887930
•
18
3
16414
pyspark databricks apache-spark-sql apache-spark python
Hive table lock info using spark.sql in Spark 2.4.0 throws error
user_82365810
•
3
1
528
apache-spark-sql apache-spark hive
How to read multiple partitioned .gzip files into a Spark Dataframe?
user_94737290
•
3
1
1471
pyspark apache-spark-sql dataframe python-3.x python
Hot Questions