Kinesis Firehose Not Sending Data to S3 Bucket

Viewed 955

I have set up a Kinesis stream with a Firehose that is supposed to take data that is put into the stream, and store it in an S3 bucket.

Currently I can see my stream is getting data and my firehose is reading it, but then not sending anything to S3.

Kinesis firehose reading data:

Kinesis firehose reading data

I can then see here that it is not delivering it to S3:

Firehose not sending to S3

The IAM role for the firehouse has access to read from Kinesis and read/write to S3.

(screenshot of permissions)

I set up logs but am not receiving any errors from the hose it seems.

Below is the serverless file i used to deploy everything.

Here is a link to serverless file for the firehose:

Here is a link to serverless file for the firehose

Here is a link to the other resources + policies for the role:

Here is a link to the other resources + policies for the role

1 Answers

You may not be grating the right permissions. Refer to this doc Grant Kinesis Data Firehose Access to an Amazon S3 Destination to know the correct S3 and Kinesis Actions needed in the policy.

Or simply, go to your Kinesis Data Firehose page, open the IAM role link under Permissions, and attach the following policies to the role: AmazonS3FullAccess, AmazonKinesisFullAccess and AmazonKinesisAnalyticsFullAccess

Related