Kinesis
  • 31 Jul 2024
  • 1 Minute to read
  • Dark
    Light

Kinesis

  • Dark
    Light

Article summary

The Amazon Web Services (AWS) module allows users to integrate with AWS's Kinesis Message Queues. Connection to Kinesis queues is configured entirely in the steps.

Prerequisites 


Steps

Put Record Step

The Put Record step allows individual messages to be added to an AWS Kinesis data stream. Below are the inputs listed for the step:

InputsDescription
DataList of Byte Data that will be passed as a record to the stream.
Hash KeyOptional string representing the hash key.
Partition KeyA Unicode string representing the partition key. This is used to group data by shard within a stream and can be a maximum of 256 characters.
Region The region the data stream resides in. This can be found in the ARN for the data stream.
Sequence NumberOptional string used for the sequence number. The sequence number is unique for each partition key within a shard, and will increase each time the partition key is used.
Stream NameThe name of the data stream.


Example

The following example covers how to use the Put Records step to send a record to an AWS Kinesis Data Stream. 

  1. Verify that an Access Key ID and Secret Access key have been applied in AWS module settings. 
  2. Create a Flow and in the Toolbox, search and select the Convert String to Byte Array step. Define a string to be converted.
  3. In the Toolbox, expand Integration > AWS > Kinesis and select the Put Record step.
  4. With the Put Record step selected define the inputs.
  5. For the Data input, a list of Bytes is needed. For this example, this is represented using the output of the Convert String to Bytes step.
  6. For the Region input, change this input to constant then select the pencil icon and enter the region found in the ARN for the data stream. In this case, it is us-east-1.  
  7. Debug the Flow. A shard id should be returned as an output when selecting the step.

For further information on Integrations, visit the Decisions Forum.

Was this article helpful?

What's Next