I am using a stand-alone spark (pyspark) 3.0 with delta 0.7.0 on an EC2 instance. Can someone direct me to a guide of how to migrate to Glue Catalog from Hive Metastore catalog (on derby).
If it makes sense, the goal is to have Spark jobs using the same catalog as Athena in an automated way. Meaning, when schema change / new partition / new table / alter table happens on the Delta Catalog level it should be propagated to the Glue Catalog
Thanks!