Stream nodes receive messages and insert them into a high-availability, high-throughput queue. Every node connected to the output port will receive copies of each message in the stream.
The stream will retry outputting a message to a node if the node fails to process the message. The stream will continue to output the message until either the node processes the message successfully or the message expires after 24 hours.
Events are sent to Function nodes connected to the output of Topic nodes. Messages are batched together into events to ensure high throughput processing. Here is an overview of commonly used event properties:
|Records||Array||Array of event records.|
|Records[*].kinesis.partitionKey||string||Message partition key. Example:
|Records[*].kinesis.data||string||Message data in Base64 format|
See https://docs.aws.amazon.com/lambda/latest/dg/eventsources.html#eventsources-kinesis-streams for further details on the event format.
A label used for the node in the canvas.
Number Of Shards
The number of shards in the stream.
Messages are inserted into a single random shard. Each shard can send one copy of a message at a time to each node connected to the output port. Each message is output by each shard in the order it was received.
Stackery Port Data
When connecting a wire between the output of a Function node to the input of an Object Store node, the
STACKERY_PORTS environment variable for the Function node will contain the following information in JSON form:
|type||string||The type of the connected resource. Always set to
|id||string||The Stackery Stream node’s ID. Example:
|name||string||The Stackery Stream node’s name. Example:
|streamName||string||The name of the AWS Kinesis data stream. Example:
|streamArn||string||The AWS ARN of the AWS Kinesis data stream. Example:
See Function Output Port Connections for more details on the
STACKERY_PORTS environment variable.
|id||Cloud Service Identifier||