Direct write to BigQuery failing pyspark

Following is my code, i'm using Managed notebook. I've added mode('append')

df3.write \
  .format("bigquery") \
  .option("writeMethod", "direct") \
  .mode('append')\
  .save("project.testing.spark_test") ```