Getting data quality in Delta Live Table (bronze, gold, silver..)

user_17635156 0
Viewed 274

How to check if Delta Live Table is in bronze, gold or silver layer(zone) with python? I have notebook for creating Delta Live Table pipeline, and I need to know what is quality of data(silver, bronze, gold). How to get that information with python?

In SQL exist something like TBLPROPERTIES('BRONZE'), is there anything like that for python?

delta-live-tables azure-databricks databricks python
2 Answers

If you have a sql solution run it directly with

spark.sql('''SHOW TBLPROPERTIES table_name'')
user_153374580

You can do something like this:

@dlt.table(
  comment="Bronze live streaming table for Test data",
  name="bronze_test_table",
  table_properties={
    "quality": "bronze"
  }
)
user_50129410
Related