From Azure Databricks, I'm connecting to Snowflake and loading data into Snowflake table using Scala Databricks Notebook.
When invalid data is passed to a column, I get SnowflakeSQLException. In the exception details, I don't see much information to know which column has an issue.
The Exception message is more generic as below and it is hard to troubleshoot the issue.
Is there any better way to troubleshoot the issue in Databricks Notebook?
Exception Examples:
SnowflakeSQLException: Timestamp 'UNK' is not recognized
SnowflakeSQLException: Nullable value sent to a non-nullable column