The Monitor area of the product allows users responsible for the overall performance of their Assistant to stay informed on its overall performance and to be aware of the most common issues impacting performance. Admins and users with the Monitor permission can find this capability within the Skill Studio area of the product as a left side navigation.

Dashboard

The dashboard focuses on 4 key metrics. Each metric is analyzed on a 28 day rolling period. The 4 metrics are:

• Pass Rate: The percent of user interactions that the Assistant responds in a manner that effectively deals with the users query.
• Questions: The total number of queries from users to the Assistant.
• Active Users: The total number of unique users who submitted a request to the Assistant
• New Users: The total number of unique users who submitted a query for the first time to the Assistant.

Issue Classification

Issues can be classified into one of following classifications.

• Wrong Subject: The analysis was performed for the wrong time period, brand, country, etc.
• Wrong Metric: The analysis was performed for the wrong measure, e.g. the user asked for a metric that was not provided.
• No Data: There is no data available for the requested time period, brand, country, etc.
• Partial Response: The system provided an analytical answer, but key parts of the user's query were missed or not fully addressed.
• Lost Context: The conversation history was not taken into account.
• Error: It appears the system ran into an error
• Other: All other failure reasons