apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How can I run a spark-job from Airflow when both Spark and Airflow are installed in the same virtual environment?
user_84909940
•
2
1
781
airflow pyspark apache-spark virtualenv
Assign the scalar result of a SELECT statement to a variable or widget in Spark SQL (Databricks)
user_138216060
•
2
1
650
databricks apache-spark sql
Apache spark custom log unfiltered data (LazyLogging)
user_54469500
•
2
1
57
spark-structured-streaming apache-spark
Spark Scala : Got error javax.crypto.AEADBadTagException: Tag mismatch! from AES GCM binary file decryption
user_152745080
•
2
1
405
apache-spark cryptography encryption scala java
How to read data from ElasticSearch in pyspark (facing java.lang.ArrayIndexOutOfBoundsException)?
user_82468890
•
2
0
121
elasticsearch pyspark apache-spark
Insert or Update a delta table from a dataframe in Pyspark
user_152158590
•
6
2
11877
delta-lake pyspark apache-spark
Sum of pyspark columns to ignore NaN values
user_86639590
•
1
1
1230
pyspark apache-spark-sql apache-spark python
Spark, delta lake auto schema evolution for nested columns
user_88728850
•
2
1
781
delta-lake bigdata pyspark apache-spark
How to invalidate metadata for Impala using spark?
user_140298950
•
1
0
448
impala pyspark apache-spark metadata
Populate a pyspark dataframe with DATE sample data
user_10689930
•
1
1
1727
pyspark-dataframes pyspark apache-spark date
Hot Questions