About Me
// Hello, World !
Top Answers
-
How to write Parquet metadata with pyarrow?
6 votes
-
PySpark Pass Index Column to element_at()
5 votes
-
How to use SDKMAN! to install packages from within scripts
5 votes
-
Delta Lake (OSS) Table on EMR and S3 - Vacuum takes a long time with no jobs
5 votes
-
Implementing a directed graph in python
4 votes
Top Questions
-
Why does the repartition() method increase file size on disk?
28 votes2 answers
-
Partitioning a large skewed dataset in S3 with Spark's partitionBy method
22 votes3 answers
-
Using Spark Structured Streaming with Trigger.Once
12 votes2 answers
-
Spark repartitioning by column with dynamic number of partitions per column
11 votes2 answers
-
Including a Spark Package JAR file in a SBT generated fat JAR
10 votes1 answers