Skip to content

AWS Kinesis Streams

Stream data to AWS Kinesis Data Streams for real-time processing and analytics.

Prerequisites

  • AWS account with Kinesis stream created
  • IAM credentials with appropriate permissions

Setup Instructions

Step 1: Prepare Kinesis Stream

  1. Create or identify your Kinesis Data Stream
  2. Note the stream name and region
  3. Configure stream capacity

Step 2: Configure Destination in Datable

  1. Navigate to Destinations in Datable
  2. Select AWS Kinesis Streams
  3. Provide configuration:
    • Destination Name: A descriptive name
    • Stream Name: Your Kinesis stream name
    • AWS Region: Stream region
    • Authentication: IAM credentials or role
    • Partition Key: Field to use for partitioning
  4. Click Save

Configuration Options

  • Batch Settings: Records per request
  • Retry Policy: Retry configuration
  • Compression: Enable compression
  • Record Format: JSON or other formats

Troubleshooting

Write Failures

  • Check IAM permissions
  • Verify stream exists and is active
  • Review throughput limits

Throttling Errors

  • Monitor shard capacity
  • Adjust batch size
  • Consider scaling stream

Support

For additional support with the AWS Kinesis Streams integration, please contact the Datable support team.