Amazon Q Business chat metrics - Amazon Q Business

Amazon Q Business chat metrics

The following table shows the Chat and conversation management metrics that Amazon Q Business sends to CloudWatch in real time.

Metric name Unit Description

ActionErrorCount

Count

The number of errors because of actions.

Valid dimensions: ApplicationId, PluginId

ActionInvocationCount

Count

The number of actions invoked.

Valid dimensions: ApplicationId, PluginId

BlockedChatMessages

Count

The number of chat messages that were blocked by Amazon Q Business due to an admin guardrail configuration. For example, a BlockedTopic or Blocked Phrase. .

Valid dimensions: ApplicationId

ChatMessages

Count

The number of chat messages This metric is emitted every time a chat message is processed.

Valid dimensions: ApplicationId

ChatMessagesWithAttachment

Count

The number of chat messages with file uploads.

Valid dimensions: ApplicationId

ChatMessagesWithNoAnswer

Count

The number of chat messages that resulted in no answer.

Valid dimensions: ApplicationId

HallucinatedChatMessages

Count

The number of system-generated chat messages with hallucination.

Note

You can create a hallucination rate metric by combining this metric with the ChatMessages metric.

Valid dimensions: ApplicationId

TimeToFirstToken

Milliseconds

The time taken to generate the first token in a chat response. This metric measures the initial response latency for chat interactions.

Valid dimensions: API name, ApplicationId

Latency

Milliseconds

The total time taken to complete a chat API request from start to finish. This metric measures the end-to-end response time for chat interactions.

Valid dimensions: API name, ApplicationId

DailyActiveUsers

Count

The number of active users from the previous day.

Note

This metric is calculated using the Maximum statistic. For more information, see CloudWatch statistics definitions.

Valid dimensions: ApplicationId

MonthlyActiveUsers

Count

The total number of unique month-to-date active users. This metric will be calculated from the 00:00 UTC on the first day of the month till 00:00 UTC from the current day.

Note

This metric is calculated using the Maximum statistic. For more information, see CloudWatch statistics definitions.

Valid dimensions: ApplicationId

WeeklyActiveUsers

Count

The total number of unique week-to-date active users. This metric will be calculated from 00:00 UTC on Sunday till 00:00 UTC from the current day.

Note

This metric is calculated using the Maximum statistic. For more information, see CloudWatch statistics definitions.

Valid dimensions: ApplicationId

NewConversations

Count

The number of new conversations started.

Valid dimensions: ApplicationId

ThumbsDownCount

Count

The feedback count for thumbs down.

Valid dimensions: ApplicationId, UsefulnessReason

ThumbsUpCount

Count

The feedback count for thumbs up.

Valid dimensions: ApplicationId, UsefulnessReason