Configure Redshift Serverless

This guide walks you through configuration steps if you are using Redshift Serverless.

• Configure Redshift Serverless

  • NOTE: Please do not follow these steps if you are using Redshift Provisioned Cluster.
  1. Open the Amazon Redshift console.
  2. Click Create Workgroup.
  3. Enter a workgroup name.
  4. Set the base and limit capacities.
  5. Keep the default settings, or adjust as needed.
  6. Click Next.
  7. If you don’t already have a namespace, create one.
  8. Enter a namespace name.
  9. Configure admin credentials (must match the Kinesis Firehose user).
     • Select Customize admin user credentials and manually enter a username and password.
  10. Click Associate IAM Role to attach the IAM role created earlier.
  11. Select the IAM role you created.
  12. Enable log exports for debugging and monitoring:
      • User log
      • Connection log
      • User activity log
  13. Review the configuration, then click Create.
  14. Open the workgroup you just created.
  15. Go to the Network and Security tab and click Edit.
  16. Enable Turn on Publicly Accessible to allow Firehose to send data to Redshift.
  17. Click Save Changes.

• Create a Firehose Stream for Redshift Serverless

  1. Open the Amazon Kinesis Firehose console.

  2. Click Create Firehose Stream.

  3. Under Source, select Direct PUT.

  4. Under Destination, select Amazon Redshift.

  5. Change the default stream name (this name is required in MetaRouter configuration).

  6. Select the Redshift Serverless workgroup you created earlier.

  7. Enter the Redshift database name.

  8. Configure authentication for Redshift.

  9. Enter a staging table name (data will be loaded here before being distributed to target tables).

  10. Select the S3 bucket you created earlier as the intermediary storage.

  11. Configure COPY command options as follows:

      JSON

      json 'auto ignorecase'
      

  12. Keep the buffer configuration at default (adjust as needed).

  13. Click Create Firehose Stream.

  14. Open the Configuration tab.

  15. Scroll down and click Edit for Service Access.

  16. Under IAM Role, select Choose Existing IAM Role and attach the IAM role you created earlier (same role used for Redshift).

  17. Click Save Changes.