Getting started with the Report Center
Creating a new dashboard
- On the Navigation bar, select Bot/Report Center to view available dashboards.
2. Click on the Plus
icon next to the dashboard header.
3. Select a pre-populated template for use or start from a blank report.
4. Add a name for your dashboards and save.
Edit a dashboard and use filters
1. To filter data in any dashboard; Select the dashboard and click on the Filter button.
2. A drop down menu will appear on the right side of your screen. Select your needed filters. You can use the toggle functionality (Filter 1 & Filter 2) to choose two filters as per your needs.
3. To Edit the dashboard, click the Pencil
icon on the top right corner of the dashboard.
4. Once in a dashboard Edit Mode, use the Edit button on a chart to select metrics.
5. On an Edit Mode, click the Create New Chart drop down menu on the left hand corner of the dashboard. Use required charts from the drop down menu as per your need.
6. You can also use the filter/time option provided on top of a dashboard to select the provided filter and timeframe.
Transcript Viewer
1. Click on the Conversation button on the top right corner of the dashboard.
2. A conversation list opens up in the dashboard. Conversation list is per conversationId and the associated metrics.
3. Click on a conversation list, this opens up the transcript associated to a conversationId. Find below the Transcript Viewer.
Keyword Search
- A feature to search transcripts with keyword is available for use. Please look at the demonstration provided below.
Data Transporter integration with Report Center
- A demonstration for access is available below. Access to the integration is provided to admins and agent managers who have three permissions enabled.
a. Data Transporter: access enabled
b. Data Transporter: view and download history
c. Data Transporter: manage tasks - Limits on RC and DT export:
a. It is not possible to download files after 28 days of creation
b. No limit on "Just Once" task creation
c. Each user is limited to just view their own created task - A demonstration on the use of the data transporter is included below.
Public and Private Dashboards in Report Center
- Increased control over report center usage by agent managers. Newly created dashboards will be marked private (Owner/Creator view only) and can be shared with View Only access to all agent managers. A second phase by February-2025 will have enhancements that lets certain Agent Managers with an enabled permission (RC: Share private to public dashboard) access share report center dashboard functionality (Both View Only and Edit).
- Future Permissions in the Report Center:
1. RC: Share Private to Public dashboard - Estimated arrival February 2025
2. RC: Export data - Estimated arrival February 2025
Understanding Metrics
When using the report center you can include a variety of metrics to provide valuable insights for your generative AI use case. A key point to keep in mind while using the metrics would be that they are a conversation/message level and filter capabilities work in the same manner.
Here are the metrics that can be considered while creating your dashboard and charts.
Copilot Rewrite Metrics
| Metrics | Definition |
| Rewrites Used (Dimension) | Provides information if rewrite is used in a conversation. Marked true if rewrite was used else false |
| Total Rewrites Used | Total times a rewrite message was used by an agent in a conversation |
| Total Rewrites Modified and Used | Total times a rewrite message was modified by the agent and used in a conversation |
| Total Wand Clicks | Total times the wand was clicked to change agent message before use |
| Total Conversations with Wand Clicks | Total unique conversations with wand clicks |
Copilot Assist and Knowledge AI Metrics
| Metric | Measure/ Dimension | Metric Level | Dimensional Aggregations | Definition |
Answer Type
| Dimension | Conversation | # KB Question, No Answers, % KB Answer Rate | The text provided by KAI can be standard or enhanced with generative AI.
(CA Generative Answer - CoPilot Assist usage and generative enhanced answer
CA Non Generative Answer - CoPilot Assist usage and standard answer) |
| Answer Used | Dimension | Conversation | " | Marked as Yes, when the text provided by KAI is used by Copilot Assist. Marked as No, when KAI text was shown but not used by the agents. |
| # KB Questions | Measure | Conversation | Agent Name, Skills Name, Group Name | Number of knowledge base (KB) queries/questions that Conversation Assist (CA) requested KnowledgeAI (KAI). (These queries may or may not have answers provided by KAI) |
| KB Total Answers | Measure | Conversation | " | Text provided by KAI to the CA based on KB Articles or Large Language Model (LLM). (KB Generative Answers + KB Standard Answers) |
| KB Standard Answers | Measure | Conversation | " | Number of standard text provided by KAI using KB article/links. |
| KB Generative Answers | Measure | Conversation | " | Number of generative (LLM) text provided by KAI. Ex: Total Conversation: 100, # KB Questions/Queries: 50, KB Total Answers (May Contain both LLM and Standard Answers) = 10, KB Generative Answers = 5, KB Standard Answers = 5 |
| No Answers | Measure | Conversation | " | Number of questions which had no answers surfaced by KAI |
| % KB Answers Rate | Measure (%) | Conversation | " | Number of KB answers / Number of queries across all conversations |
| Agent Recommendation Shown | Measure | Conversation | " | Number of answers provided by Copilot Assist to agents. These answers may or may not be used by agents. Each query may have one or more recommendations provided. |
| Agent Recommendation Used | Measure | Conversation | " | Number of answers used by agents. Agents in Copilot Assist can choose to use the answers provided by KAI. If the Use Answer Button is clicked, it will be marked as an Agent Recommendation Used. |
| Agent Recommendation Used Rate | Measure | Conversation | " | Number of Agent Recommendations Used / Number of Agent Recommendations provided |
| Bot Recommendation Offered** | Measure | Conversation | “ | Number of bot answer delegation provided to agents. These answers may or may not be used by agents. Each query may have one or more recommendations provided. |
Bot Recommendation Used**
| Measure | Conversation | “ | Number of bot delegated answers used by bot. Agents in CA can choose to use the answers provided by KAI. If the Delegate Button is clicked, it will be marked as a Bot Recommendation Used. |
| Total Recommendation Made** | Measure | Conversation | “ | Number of answers offered to agents and offered via bots. (Agent Recommendation Shown + Bot Recommendation Offered) |
Total Recommendation Used**
| Measure | Conversation | “ | Number of answers used by agents and delegated to bots. Agents in CA can choose to use the answers provided by KAI. If the Use Answer Button or Delegate Button is clicked, it will be marked as a Total Recommendation Used. (Agent Recommendation Used + Bot Recommendation Used) |
Agent using recommendation Rate**
| Measure (%) | Conversation | “ | Unique number of agents using Recommendations / Unique number of agents Recommendations provided
Count of Unique Agentid that have a recommendation usage. |
FAQ
Which roles have access to Report Center?
Report Center has two models called conversation and engagement controller.
Conversation: Assigned Managers of a group with role Agent Manager have access to their agent data. Main Group managers have access to the complete account data.
Engagement Controller: Campaign Managers and Admins have access to EC data.
