Configure Redshift Provisioned Cluster

This guide walks you through configuration steps if you are using Redshift Provisioned Cluster.

NOTE: Please do not follow these steps if you are using Redshift Serverless.

1. Open the Amazon Redshift console.
2. Click Create Cluster.
3. Select a node type and set the number of nodes.
4. (Optional) Choose a Key Type for encryption. If not needed, disable encryption.
5. Set admin credentials (must match the Kinesis Firehose user).
6. Click Associate IAM Role to attach the IAM role created earlier.
7. Select the IAM role you created.
8. Remove the default role and set your IAM role as the default.
9. Click the Use Defaults toggle to configure network settings.
10. In Network and Security, enable Publicly Accessible to allow Firehose to send data to Redshift.
11. Adjust any other settings as needed.
12. Review your configurations, then click Create Cluster.
13. Once redirected to the Cluster Dashboard, proceed to the next section.

• Steps to create a Firehose stream

  1. Open the Amazon Kinesis Firehose console.

  2. Click Create Firehose Stream.

  3. Under Source, select Direct PUT.

  4. Under Destination, select Amazon Redshift.

  5. Change the default stream name (this name is required in MetaRouter configuration).

  6. Select the Redshift Provisioned Cluster you created earlier.

     • If the cluster is still being created, check its status in the Redshift Dashboard before proceeding.

  7. Enter the Redshift database name.

  8. Configure authentication for Redshift.

  9. Enter a staging table name (data will be loaded here before being distributed to target tables).

  10. Select the S3 bucket you created earlier as the intermediary storage.

  11. Configure COPY command options as follows:

      JSON

      json 'auto ignorecase'
      

  12. Keep the buffer configuration at default (adjust as needed).

  13. Click Create Firehose Stream.

  14. Open the Configuration tab.

  15. Scroll down and click Edit for Service Access.

  16. Under IAM Role, select Choose Existing IAM Role and attach the IAM role you created earlier (same role used for Redshift).

  17. Click Save Changes.