Top Answers

1. Create and cast a new column from existing column with % concatenation
   4 votes
2. Where to modify spark-defaults.conf if I installed pyspark via pip install pyspark
   3 votes
3. drop all df2.columns from another df (pyspark.sql.dataframe.DataFrame specific)
   3 votes
4. Does coalesce(1) bring all the data to the driver?
   3 votes
5. extract substring before first occurrence and substring after last occurrence of a delimiter in Pyspark
   3 votes