Chatbot Overview
Conversational Bots
Intents & Entities
Intelligent Bots
Kore.ai's Approach
Kore.ai Conversational Platform
Bot Concepts and Terminology
Natural Language Processing (NLP)
Bot Types
Bot Tasks
Starting with Kore.ai Platform
How to Access Bot Builder
Working with Kore.ai Bot Builder
Building your first Bot
Getting Started with Building Bots
Using the Dialog Builder Tool
Creating a Simple Bot
Release Notes
Latest Updates
Older Releases
Deprecations
Bot Builder
Creating a Bot
Design
Develop
Storyboard
Dialog Task
User Intent Node
Dialog Node
Entity Node
Supported Entity Types
Composite Entities
Supported Colors
Supported Company Names
Form Node
Logic Node
Message Nodes
Confirmation Nodes
Service Node
Custom Authentication
2-way SSL for Service nodes
Script Node
Agent Transfer Node
WebHook Node
Grouping Nodes
Connections & Transitions
Managing Dialogs
User Prompts
Alert Tasks
Alert Tasks
Ignore Words and Field Memory
Digital Forms
Digital Views
Knowledge Graph
Terminology
Building
Generation
Importing and Exporting
Analysis
Knowledge Extraction
Small Talk
Action & Information Task
Action Tasks
Information Tasks
Establishing Flows
Natural Language
Overview
Machine Learning
Model Validation
Fundamental Meaning
NLP Settings and Guidelines
Knowledge Graph Training
Traits
Ranking and Resolver
NLP Detection
Advanced NLP Configurations
Bot Intelligence
Overview
Context Management
Session and Context Variables
Context Object
Dialog Management
Sub-Intents & Follow-up Intents
Amend Entity
Multi-Intent Detection
Sentiment Management
Tone Analysis
Sentiment Management
Default Conversations
Default Standard Responses
Channel Enablement
Test & Debug
Talk to Bot
Utterance Testing
Batch Testing
Record Conversations
Publishing your Bot
Analyzing your Bot
Overview
Dashboard
Custom Dashboard
Conversation Flows
Bot Metrics
Advanced Topics
Bot Authorization
Language Management
Collaborative Development
IVR Integration
Data Table
Universal Bots
Defining
Creating
Training
Customizing
Enabling Languages
Smart Bots
Defining
Sample Bots
Github
Asana
Travel Planning
Flight Search
Event Based Bot Actions
koreUtil Libraries
Bot Settings
Bot Functions
General Settings
PII Settings
Customizing Error Messages
Manage Sessions
Bot Management
Bot Versioning
Using Bot Variables
API Guide
API Overview
API List
API Collection
SDKs
SDK Overview
SDK Security
SDK App Registration
Web SDK Tutorial
Message Formatting and Templates
Mobile SDK Push Notification
Widget SDK Tutorial
Widget SDK – Message Formatting and Templates
Web Socket Connect & RTM
Using the BotKit SDK
Installing
Configuring
Events
Functions
BotKit SDK Tutorial – Agent Transfer
BotKit SDK Tutorial – Flight Search Sample Bot
Using an External NLP Engine
Bot Administration
Bots Admin Console
Dashboard
User Management
Managing Users
Managing Groups
Managing Role
Bots Management
Enrollment
Inviting Users
Bulk Invites
Importing Users
Synchronizing Users from AD
Security & Compliance
Using Single Sign-On
Security Settings
Cloud Connector
Analytics
Billing
How Tos
Creating a Simple Bot
Creating a Banking Bot
Transfer Funds Task
Update Balance Task
Context Switching
Using Traits
Schedule a Smart Alert
Configure Digital Forms
Add Form Data into Data Tables
Configuring Digital Views
Add Data to Data Tables
Update Data in Data Tables
Custom Dashboard
Custom Tags to filter Bot Metrics
Patterns for Intents & Entities
Build Knowledge Graph
Using nlMeta
Global Variables
Content Variables
Using Bot Functions
Configure Agent Transfer
  1. Home
  2. Docs
  3. Bots
  4. How Tos
  5. How to use Custom Tags to filter Bot Metrics

How to use Custom Tags to filter Bot Metrics

In this How-To, we will explore a scenario in a Banking Bot, where, various metrics will be used to analyze the bot performance.

For details on what Bot Metrics are and how they are implemented in the Kore.ai Bots platform, refer here.

Problem Statement

A Banking Bot client can track the following metrics:

  • Frequent Intents used by customers;
  • Usage split based on the customer type;

This document gives a detailed step-by-step approach to viewing the above statistics from the Bot Metrics page and apply filters based on Custom Meta Tags.

Pre-requisites

  • Bot building knowledge.
  • Custom Meta Tags usage, refer here for more.
  • A Banking Bot with the dialogs as mentioned below:
    • Transfer Money – Dialog task walking the user through the steps in transferring money.
      In this diaog, we have included a Script node to add Custom Meta Tag, TransferValue, based upon the amount transferred. Following script was used:

      if(context.entities.TransferAmount[0].amount > 50000){
         tags.addSessionLevelTag("TransferValue","HighValue");
      }
      
      if(context.entities.TransferAmount[0].amount > 10000)
      tags.addSessionLevelTag("TransferValue","MediumValue");
      
      if(context.entities.TransferAmount[0].amount > 0)
      tags.addSessionLevelTag("TransferValue","LowValue");

    • Manage Payee – For the user to manage their payee list.

      Here we have a Script assigning customerType meta tags:

      if(context.custType == 3){
         tags.addUserLevelTag("CustomerType","Premium");
      }
      if(context.custType == 2){
         tags.addUserLevelTag("CustomerType","Gold");
      };
      if(context.custType == 1){
         tags.addUserLevelTag("CustomerType","Regular");
      };

Implementation

Let us consider how each of the metrics mentioned in the problem statement can be viewed from the Metrics.

  1. From the left navigation panel, under Analyze click Metrics.
  2. The page will display the Intent found metrics to include successful utterances, intents, userid of the user,  and other details.
  3. These are the successful intents in the past one week as captured by the Bot.
  4. Click the Filter button to customize the report.
  5. Customize the Date periodLanguangesChannel, and the Task/Intent you want to capture.
  6. Since we want to track the Transfer Money intent, we have selected accordingly.
  7. We want the report of all the interactions by the Gold and Premium customers doing High Value money transfers.
  8. For this select the Custom Tags as follows (you can select the tag name and tag value from the type ahead drop down:
    • Customer Type – Gold, Premium
    • Transfer Value – HighValue

  9. On Applying the filter, you will see the updated Metrics page. Note that tags filter is applied only on the published version on the bot.
  10. You can repeat the above steps for all metrics like Intent not foundFailed task, etc..
Menu