Is there something like Glue "Bookmark" feature in spark which keeps track at job level?

Viewed 285

I am looking to see if there is something like AWS Glue "bookmark" in spark. I know there is checkpoint in spark which works well on individual data source. In Glue we could use bookmark to keep track of all the files across different tables involved in the job using single bookmark.

0 Answers
Related