Snowflake task failure notification

user_11252662 0
Viewed 1141

I have Snowflake tasks that runs every 30 minutes. Currently, when the task fails due to underlying data issue in the stored procedure that the Task calls, there is no way to notify the users on the failure.

SELECT *
FROM TABLE(INFORMATION_SCHEMA.TASK_HISTORY());

How can notifications be setup for a Snowflake Task failure? The design plan I have in mind is to build a python application that runs every 30mins and looks for any error on TASK_HISTORY table. Please advise if there are any better approaches to handle failure notifications

snowflake-cloud-data-platform
3 Answers

I think currently a python script would the best way to address this. You can use this SQL to query last runs, read into a data frame and filter out errors

select *
  from table(information_schema.task_history(scheduled_time_range_start=>dateadd(minutes, -30,current_timestamp())))
user_16288120

It is possible to create Notification Integration and send message when error occurs. As of May 2022 this feature is in preview, supported by accounts on Amazon Web Servives.

Enabling Error Notifications for Tasks

This topic provides instructions for configuring error notification support for tasks using cloud messaging. This feature triggers a notification describing the errors encountered when a task executes SQL code

Currently, error notifications rely on cloud messaging provided by the
Amazon Simple Notification Service service;
support for Google Cloud Pub/Sub queue and Microsoft Azure Event Grid is planned.

New Tasks

Create a new task using CREATE TASK. For descriptions of all available task parameters, see the SQL command topic:

CREATE TASK <name>
 [...]
 ERROR_INTEGRATION = <integration_name>
 AS <sql>

Existing tasks:

ALTER TASK <name> SET ERROR_INTEGRATION = <integration_name>;
user_50708790
user_169224270
Related