Kinesis Firehose metrics
Amazon Kinesis Firehose is the easiest way to load streaming data into AWS. Ensure your cloud platform is configured in SolarWinds Observability SaaS to collect this service's data. See Add an AWS cloud account. CloudWatch metrics must also be enabled for this service in the AWS Console for the metric data to be available.
Many of the collected metrics from Kinesis Data Firehose entities are displayed as widgets in SolarWinds Observability explorers; additional metrics may be collected and available in the Metrics Explorer. You can also create an alert for when an entity's metric value moves out of a specific range. See Entities in SolarWinds Observability SaaS for information about entity types in SolarWinds Observability SaaS.
The following table lists AWS.Firehose in the search box.
| Metric | Units | Description |
|---|---|---|
sw.metrics.healthscore
|
Percent (%) |
Health score. A health score provides real-time insight into the overall health and performance of your monitored entities. The health score is calculated based on anomalies detected for the entity, alerts triggered for the entity's metrics, and the status of the entity. The health score is displayed as a single numerical value that ranges from a Good (70-100) to Moderate (40-69) to Bad (0-39) distinction. To view the health score for Kinesis Firehose entities in the Metrics Explorer, filter the |
AWS.Firehose.ActivePartitionsLimit
|
Count | The maximum number of active partitions that a Firehose stream can process before sending data to the error bucket. |
AWS.Firehose.BackupToS3.Bytes
|
bytes | The number of bytes that have been backed up to Amazon S3. |
AWS.Firehose.BackupToS3.Success
|
Count | The number of successful backup operations to Amazon S3. |
AWS.Firehose.BytesPerSecondLimit
|
bps | The maximum number of bytes that can be processed per second. |
AWS.Firehose.DataReadFromKinesisStream.Bytes
|
bytes | The number of bytes read from the Kinesis data stream. |
AWS.Firehose.DataReadFromKinesisStream.Records
|
Count | The number of records read from the Kinesis data stream. |
AWS.Firehose.DataReadFromSource.Backpressured
|
bytes | Indicates whether the data source is backpressured, meaning it is temporarily unable to accept more data. |
AWS.Firehose.DataReadFromSource.Bytes
|
bytes | The number of raw bytes read from the source database. |
AWS.Firehose.DataReadFromSource.Records
|
Count | The number of records read from the source database. |
AWS.Firehose.DeliveryToAmazonOpenSearchServerless.AuthFailure
|
Count | The number of delivery attempts that failed due to authentication issues. |
AWS.Firehose.DeliveryToAmazonOpenSearchServerless.Bytes
|
bytes | The number of bytes delivered to Amazon OpenSearch Serverless. |
AWS.Firehose.DeliveryToAmazonOpenSearchServerless.DataFreshness
|
seconds (s) | The age of the oldest record in the delivery stream, measured from the time Firehose ingested the data to the present time. |
AWS.Firehose.DeliveryToAmazonOpenSearchServerless.DeliveryRejected
|
Count | The number of delivery attempts that were rejected. |
AWS.Firehose.DeliveryToAmazonOpenSearchServerless.Records
|
Count | The number of records delivered to Amazon OpenSearch Serverless. |
AWS.Firehose.DeliveryToAmazonOpenSearchServerless.Success
|
Count | The number of successful deliveries to Amazon OpenSearch Serverless. |
AWS.Firehose.DeliveryToAmazonOpenSearchService.AuthFailure
|
Count | The number of delivery failures due to authentication issues when delivering to Amazon OpenSearch Service. |
AWS.Firehose.DeliveryToAmazonOpenSearchService.Bytes
|
bytes | The total number of bytes delivered to Amazon OpenSearch Service. |
AWS.Firehose.DeliveryToAmazonOpenSearchService.DataFreshness
|
seconds (s) | The age of the oldest record in the delivery stream, measured from the time Firehose ingested the data to the present time. |
AWS.Firehose.DeliveryToAmazonOpenSearchService.DeliveryRejected
|
Count | The number of delivery attempts that were rejected by Amazon OpenSearch Service. |
AWS.Firehose.DeliveryToAmazonOpenSearchService.Records
|
Count | The number of records successfully delivered to Amazon OpenSearch Service. |
AWS.Firehose.DeliveryToAmazonOpenSearchService.Success
|
Count | The number of successful deliveries to Amazon OpenSearch Service. |
|
|
bytes |
The number of bytes indexed to Amazon ES over the specified time period. |
|
|
Count |
The number of records indexed to Amazon ES over the specified time period. |
|
|
Count |
The sum of the successfully indexed records over the sum of records that were attempted. |
AWS.Firehose.DeliveryToHttpEndpoint.Bytes
|
bytes | The number of bytes sent to the HTTP endpoint. |
AWS.Firehose.DeliveryToHttpEndpoint.DataFreshness
|
seconds (s) | The age of the oldest record in the delivery stream, measured from the time Firehose ingested the data to the present time. |
AWS.Firehose.DeliveryToHttpEndpoint.ProcessedBytes
|
bytes | The number of bytes processed by Firehose for delivery to the HTTP endpoint. |
AWS.Firehose.DeliveryToHttpEndpoint.ProcessedRecords
|
Count | The number of records processed by Firehose for delivery to the HTTP endpoint. |
AWS.Firehose.DeliveryToHttpEndpoint.Record
|
Count | The number of individual records sent to the HTTP endpoint. |
AWS.Firehose.DeliveryToHttpEndpoint.Success
|
Count | The number of successful deliveries to the HTTP endpoint. |
|
|
bytes |
The number of bytes copied to Amazon Redshift over the specified time period. |
|
|
Count |
The number of records copied to Amazon Redshift over the specified time period. |
|
|
Count |
The sum of successful Amazon Redshift COPY commands over the sum of all Amazon Redshift COPY commands. |
|
|
bytes |
The number of bytes delivered to Amazon S3 over the specified time period. |
|
|
seconds (s) |
The age (from getting into Kinesis Firehose to now) of the oldest record in Kinesis Firehose. Any record older than this age has been delivered to the S3 bucket. |
AWS.Firehose.DeliveryToS3.ObjectCount
|
Count | The number of objects that are being delivered to your S3 bucket. |
|
|
Count |
The number of records delivered to Amazon S3 over the specified time period. |
|
|
Count |
The sum of successful Amazon S3 put commands over the sum of all Amazon S3 put commands. |
|
|
milliseconds (ms) |
The time taken per DescribeDeliveryStream operation, measured over the specified time period. |
|
|
Count |
The total number of DescribeDeliveryStream requests. |
AWS.Firehose.FailedValidation.Bytes
|
bytes | The number of bytes that failed validation during data processing. |
AWS.Firehose.FailedValidation.Records
|
Count | The number of records that failed validation during data processing. |
|
|
bytes |
The number of bytes ingested into the Kinesis Firehose stream over the specified time period. |
AWS.Firehose.IncomingPutRequests
|
Count | The number of incoming put requests to the Firehose stream. |
|
|
Count |
The number of records ingested into the Kinesis Firehose stream over the specified time period. |
AWS.Firehose.JQProcessing.Duration
|
milliseconds (ms) | The amount of time it took to execute the JQ expression in the JQ Lambda function. |
AWS.Firehose.KafkaOffsetLag
|
Count | The difference between the last record written to the Kafka topic and the last record processed by the consumer. |
AWS.Firehose.KMSKeyAccessDenied
|
Count | Indicates that access to the KMS key was denied. It usually means that the necessary permissions are not set correctly for the Kinesis Data Firehose to use the KMS key. |
AWS.Firehose.KMSKeyDisabled
|
Count | Indicates that the KMS key is disabled and cannot be used. |
AWS.Firehose.KMSKeyInvalidState
|
Count | Indicates that the KMS key is in an invalid state and cannot be used. |
AWS.Firehose.KMSKeyNotFound
|
Count | Indicates that the KMS key was not found. It usually means that the specified key does not exist or the Firehose delivery stream is not configured correctly to use the key. |
|
|
milliseconds (ms) |
The time taken per ListDeliveryStream operation, measured over the specified time period. |
|
|
Count |
The total number of ListFirehose requests. |
AWS.Firehose.PartitionCount
|
Count | The number of partitions that are currently being used in the delivery stream. It helps you monitor the distribution of data across partitions. |
AWS.Firehose.PartitionCountExceeded
|
Count | Indicates that the number of partitions being used has exceeded the configured limit. |
AWS.Firehose.PerPartitionThroughput
|
bps | The throughput for each partition in the delivery stream. |
|
|
bytes |
The number of bytes put to the Kinesis Firehose delivery stream using PutRecord over the specified time period. |
|
|
milliseconds (ms) |
The time taken per PutRecord operation, measured over the specified time period. |
|
|
Count |
The total number of PutRecord requests, which is equal to total number of records from PutRecord operations. |
|
|
bytes |
The number of bytes put to the Kinesis Firehose delivery stream using PutRecordBatch over the specified time period. |
|
|
milliseconds (ms) |
The time taken per PutRecordBatch operation, measured over the specified time period. |
|
|
Count |
The total number of records from PutRecordBatch operations. |
|
|
Count |
The total number of PutRecordBatch requests. |
AWS.Firehose.PutRequestsPerSecondLimit
|
Count per second | The maximum number of put requests that can be processed per second by the Firehose delivery stream. |
AWS.Firehose.RecordsPerSecondLimit
|
Count per second | The maximum number of records that can be processed per second by the Firehose delivery stream. |
AWS.Firehose.SourceThrottled.Delay
|
milliseconds (ms) | The amount of time that records were delayed due to throttling at the data source. |
AWS.Firehose.ThrottledRecords
|
Count | The number of records that were throttled (temporarily paused) due to exceeding the processing capacity of the Firehose delivery stream. |
|
|
milliseconds (ms) |
The time taken per UpdateDeliveryStream operation, measured over the specified time period. |
|
|
Count |
The total number of UpdateDeliveryStream requests. |