Documentation forSolarWinds Observability SaaS

Kinesis Data Stream metrics

Amazon Kinesis Data Stream makes it easy to collect, process, and analyze real-time, streaming data so you can get timely insights and react quickly to new information. Ensure your cloud platform is configured in SolarWinds Observability SaaS to collect this service's data. See Add an AWS cloud account. CloudWatch metrics must also be enabled for this service in the AWS Console for the metric data to be available.

Depending on the subscription pricing tier of your AWS account or its services, additional metrics may be available for this entity. To collect additional AWS metrics, enable enhanced shard-level metrics.

Many of the collected metrics from Kinesis Data Stream entities are displayed as widgets in SolarWinds Observability explorers; additional metrics may be collected and available in the Metrics Explorer. You can also create an alert for when an entity's metric value moves out of a specific range. See Entities in SolarWinds Observability SaaS for information about entity types in SolarWinds Observability SaaS.

The following table lists some of the metrics collected for these entities. To see the Kinesis Data Stream metrics in the Metrics Explorer, type AWS.Kinesis in the search box.

Basic Stream-level

Metric Units Description
sw.metrics.healthscore Percent (%)

Health score. A health score provides real-time insight into the overall health and performance of your monitored entities. The health score is calculated based on anomalies detected for the entity, alerts triggered for the entity's metrics, and the status of the entity. The health score is displayed as a single numerical value that ranges from a Good (70-100) to Moderate (40-69) to Bad (0-39) distinction.

To view the health score for Kinesis Data Stream entities in the Metrics Explorer, filter the sw.metrics.healthscore metric by entity_types and select awskinesis.

AWS.Kinesis.GetRecords.Bytes

bytes

The number of bytes retrieved from the Kinesis stream, measured over the specified time period.

AWS.Kinesis.GetRecords.IteratorAgeMilliseconds

milliseconds (ms)

The age of the last record in all GetRecords calls made against an Kinesis stream, measured over the specified time period.

AWS.Kinesis.GetRecords.Latency

milliseconds (ms)

The time taken per GetRecords operation, measured over the specified time period.

AWS.Kinesis.GetRecords.Records

Count

The number of records retrieved from the shard, measured over the specified time period. Minimum, Maximum, and Average statistics represent the records in a single GetRecords operation for the stream in the specified time period.

AWS.Kinesis.GetRecords.Success

Count

The number of successful GetRecords operations per stream, measured over the specified time period.

AWS.Kinesis.IncomingBytes

bytes

The number of bytes successfully put to the Kinesis stream over the specified time period.

AWS.Kinesis.IncomingRecords

Count

The number of records successfully put to the Kinesis stream over the specified time period.

AWS.Kinesis.PutRecord.Bytes

bytes

The number of bytes put to the Kinesis stream using the PutRecord operation over the specified time period.

AWS.Kinesis.PutRecord.Latency

milliseconds (ms)

The time taken per PutRecord operation, measured over the specified time period.

AWS.Kinesis.PutRecord.Success

Count

The number of successful PutRecord operations per Kinesis stream, measured over the specified time period.

AWS.Kinesis.PutRecords.Bytes

Binary Bytes

The number of bytes put to the Kinesis stream using the PutRecords operation over the specified time period.
AWS.Kinesis.PutRecords.FailedRecords Count The number of records that failed to be added to the Kinesis data stream. It helps in identifying issues with data ingestion.

AWS.Kinesis.PutRecords.Latency

ms

The time taken per PutRecords operation, measured over the specified time period.
AWS.Kinesis.PutRecords.PutRecords.ThrottledRecords Count The number of records that were throttled (temporarily paused) due to exceeding the provisioned throughput for the stream. It helps in monitoring and managing the data flow.

AWS.Kinesis.PutRecords.Success

Count

The number of PutRecords operations where at least one record succeeded, per Kinesis stream, measured over the specified time period.
AWS.Kinesis.PutRecords.SuccessfulRecords Count The number of records that were successfully added to the Kinesis data stream. It provides insights into the overall success rate of data ingestion.

AWS.Kinesis.PutRecords.TotalRecords

Count

The number of successful records in a PutRecords operation per Kinesis stream, measured over the specified time period.

AWS.Kinesis.ReadProvisionedThroughputExceeded

Count

The number of GetRecords calls throttled for the stream over the specified time period.
AWS.Kinesis.uptime bytes The uptime or availability of the Kinesis Data Streams service. It helps in monitoring the reliability and performance of the service.

AWS.Kinesis.WriteProvisionedThroughputExceeded

Count

The number of records rejected due to throttling for the stream over the specified time period. This metric includes throttling from PutRecord and PutRecords operations.

Enhanced Shard-level

Metric Units Description

AWS.Kinesis.IncomingBytes

bytes

The number of bytes successfully put to the shard over the specified time period.

AWS.Kinesis.IncomingRecords

Count

The number of records successfully put to the shard over the specified time period.

AWS.Kinesis.IteratorAgeMilliseconds

milliseconds (ms)

The age of the last record in all GetRecords calls made against a shard, measured over the specified time period.

AWS.Kinesis.OutgoingBytes

bytes

The number of bytes retrieved from the shard, measured over the specified time period.

AWS.Kinesis.OutgoingRecords

Count

The number of records retrieved from the shard, measured over the specified time period.

AWS.Kinesis.ReadProvisionedThroughputExceeded

Count

The number of GetRecords calls throttled for the shard over the specified time period. This exception count covers all dimensions of the following limits: 5 reads per shard per second or 2 MB per second per shard.
AWS.Kinesis.SubscribeToShard.RateExceeded Count per second The number of times the rate limit was exceeded when calling SubscribeToShard. It helps you monitor and manage throttling issues.
AWS.Kinesis.SubscribeToShard.Success Count The number of successful SubscribeToShard calls. It helps you track the success rate of your subscription requests.
AWS.Kinesis.SubscribeToShardEvent.Bytes bytes The number of bytes received from the shard in a SubscribeToShardEvent. It helps you monitor the volume of data being processed.
AWS.Kinesis.SubscribeToShardEvent.MillisBehindLatest milliseconds (ms) The number of milliseconds the consumer is behind the latest record in the shard. A value of zero means the consumer is up-to-date with the stream.
AWS.Kinesis.SubscribeToShardEvent.Records Count The number of records received in a SubscribeToShardEvent. It helps you monitor the number of records being processed.
AWS.Kinesis.SubscribeToShardEvent.Success Count The number of successful SubscribeToShardEvent calls. It helps you track the success rate of your event processing.

AWS.Kinesis.WriteProvisionedThroughputExceeded

Count

The number of records rejected due to throttling for the shard over the specified time period. This metric includes throttling from PutRecord and PutRecords operations and covers all dimensions of the following limits: 1,000 records per second per shard or 1 MB per second per shard.