{"id":43913,"date":"2022-08-13T06:00:53","date_gmt":"2022-08-13T05:00:53","guid":{"rendered":"https:\/\/developer.kore.ai\/v10-1\/?p=43913"},"modified":"2023-09-11T05:58:59","modified_gmt":"2023-09-11T04:58:59","slug":"virtual-assistants-health-and-monitoring","status":"publish","type":"post","link":"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/virtual-assistants-health-and-monitoring\/","title":{"rendered":"Virtual Assistant Health and Monitoring"},"content":{"rendered":"<section class=\"l-section wpb_row height_auto\"><div class=\"l-section-h i-cf\"><div class=\"g-cols vc_row type_default valign_top\"><div class=\"vc_col-sm-12 wpb_column vc_column_container\"><div class=\"vc_column-inner\"><div class=\"wpb_wrapper\"><div class=\"w-separator size_medium\"><\/div>\r\n\t<div class=\"wpb_text_column \">\r\n\t\t<div class=\"wpb_wrapper\">\r\n\t\t\t<p>The <b>Health and Monitoring<\/b> dashboard offers a goal-driven approach to improving the accuracy of the virtual assistant\u2019s Natural Language Processing (NLP) model. The training data is analyzed along with the test coverage and test results of the test suites to provide insights into the NLP Model\u2019s performance.<\/p>\n<p>This dashboard lets you achieve the following:<\/p>\n<ul>\n<li>Run the test suites against the in-development version of the bot to see the Virtual Assistant&#8217;s health.<\/li>\n<li>Review the test execution summary for every intent type.<\/li>\n<li>Drill down and view the coverage and key metrics of the virtual assistant determined by the Batch Test and Conversation Test executions.<\/li>\n<li>Identify incorrect intent patterns, short training utterances, incorrect entity annotations, and training recommendations and take corrective action.<\/li>\n<li>View the expected and matched results, and the detailed NLP analysis.<\/li>\n<li>Tag specific test case results that need follow-up actions and collaborate with your team to improve the performance.<\/li>\n<\/ul>\n<p><b>Note<\/b>:<\/p>\n<ul>\n<li>The Health &amp; Monitoring Dashboard is available only post 9.3 release, i.e. post-July 24, 2022.<\/li>\n<li>This feature only considers the latest In-development test executions.<\/li>\n<\/ul>\n\r\n\t\t<\/div>\r\n\t<\/div>\r\n<div class=\"w-separator size_medium\"><\/div>\r\n\t<div class=\"wpb_text_column \">\r\n\t\t<div class=\"wpb_wrapper\">\r\n\t\t\t<h2><span class=\"ez-toc-section\" id=\"Navigating_to_Health_and_Monitoring\">Navigating to Health and Monitoring<\/span><\/h2>\n<p>To navigate to the <b>Health and Monitoring<\/b> dashboard, follow these steps:<\/p>\n<ol>\n<li style=\"list-style-type: none;\">\n<ol>\n<li>Click the <b>Build<\/b> tab on the top menu of the Virtual Assistant dashboard.<\/li>\n<li>Click <b>Health &amp; Monitoring<\/b> under <b>Testing<\/b> in the left navigation menu.<\/li>\n<\/ol>\n<\/li>\n<\/ol>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230126051021\/hm-1-1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-52998\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230126051021\/hm-1-1.png\" alt=\"\" width=\"600\" height=\"400\" \/><\/a><\/p>\n<h2><span class=\"ez-toc-section\" id=\"Dashboard_Sections_and_Components\">Dashboard Sections and Components<\/span><\/h2>\n<p>The <b>Health and Monitoring<\/b> Dashboard is divided into two sections that include the following:<\/p>\n<ol>\n<li><b>NLP<\/b>: This panel extracts all test suite results from Batch Testing and presents insights into your test cases with performance analytics. The key components of this panel include the execution summary, the <b>key performance metrics<\/b>, and the <b>total test coverage<\/b> of the selected test suites for the Dialog intents, FAQs, Small Talks, and Traits. The key <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/virtual-assistants-health-and-monitoring\/#Health_and_Monitoring_Metrics\" target=\"_blank\" rel=\"noopener noreferrer\">recommendation scores<\/a> presented here depict if your virtual assistant is trained sufficiently or not.<\/li>\n<li><b>Flow<\/b>: This panel summarizes the coverage of all the conversation flows by the Virtual Assistant you&#8217;ve defined including its performance, intents&#8217; coverage and transitions. <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/flow-health-dashboard\/\" target=\"_blank\" rel=\"noopener noreferrer\">Learn more<\/a>. The key components of the <b>Flow<\/b> panel include transition coverage and intent summary panels for the test suites. <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/flow-health-dashboard\/#Flow_Dashboard_Components\" target=\"_blank\" rel=\"noopener noreferrer\">Learn more<\/a>.<\/li>\n<\/ol>\n\r\n\t\t<\/div>\r\n\t<\/div>\r\n<div class=\"w-separator size_medium\"><\/div>\r\n\t<div class=\"wpb_text_column \">\r\n\t\t<div class=\"wpb_wrapper\">\r\n\t\t\t<h2><span class=\"ez-toc-section\" id=\"Health_and_Monitoring_Metrics\">Health and Monitoring Metrics<\/span><\/h2>\n<h3><span class=\"ez-toc-section\" id=\"NLP_Intent_Coverage_Metrics\">NLP Intent Coverage Metrics<\/span><\/h3>\n<p>The following metrics extracted from Batch Testing results are displayed in two ways:<\/p>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li>As aggregate values in the <b>Bot Health<\/b> summary section.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230126054903\/HM-2-1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-53001\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230126054903\/HM-2-1.png\" alt=\"\" width=\"500\" height=\"200\" \/><\/a><\/p>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li>As individual scores in the <b>Dialog Intents<\/b>, <b>FAQs<\/b>, <b>Small Talk<\/b>, and <b>Traits<\/b> summary panels.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230126060114\/hm-3-1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-53007\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230126060114\/hm-3-1.png\" alt=\"\" width=\"500\" height=\"800\" \/><\/a><\/p>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li><b>Accuracy<\/b>: Determines if the intent identified by your ML model is correct or not.<\/li>\n<li><b>F1 Score<\/b>: Classifies the distribution and balances precision and recall scores. It is calculated as the weighted average of Precision and Recall.<\/li>\n<li><b>Precision Score<\/b>: Defines how precise\/accurate your model is and is calculated as the ratio of true positives over total predicted positives (sum of true and false positives).<\/li>\n<li><b>Recall Score<\/b>: Defines the fraction of the relevant utterances that are successfully identified and is calculated as the ratio of true positives over actual positives (sum of true positives and false negatives).<\/li>\n<li><b>Total Test Coverage %<\/b>: The average of the Total Test Coverage scores for <b>Dialog Intents<\/b>, <b>FAQs<\/b>, <b>Small Talk<\/b>, <b>Traits<\/b>, and <b>Entities<\/b>.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>These metrics help gain actionable insights into your test cases to perform <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/nlp\/ml-model\/\" target=\"_blank\" rel=\"noopener noreferrer\">ML Model Validation<\/a>.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Flow_Health_Metrics\">Flow Health Metrics<\/span><\/h3>\n<p>The Flow Health metrics display all the test suite results from the conversation testing and presents insights into your test cases with performance analytics. <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/flow-health-dashboard\/#Flow_Metrics\" target=\"_blank\" rel=\"noopener noreferrer\">Learn more<\/a>.<\/p>\n\r\n\t\t<\/div>\r\n\t<\/div>\r\n<div class=\"w-separator size_medium\"><\/div>\r\n\t<div class=\"wpb_text_column \">\r\n\t\t<div class=\"wpb_wrapper\">\r\n\t\t\t<h2><span class=\"ez-toc-section\" id=\"Test_Cases_Detailed_Analysis\">Test Cases Detailed Analysis<\/span><\/h2>\n<p>To get the detailed NLP data of all the test cases executed for all the test suites that are considered in the VA, click the <b>View Test Cases<\/b> link in the <b>NLP<\/b> section.<\/p>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230126085559\/Hm-10-1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-53092\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230126085559\/Hm-10-1.png\" alt=\"\" width=\"500\" height=\"200\" \/><\/a><\/p>\n<p>The <b>Test Cases- Detailed Analysis<\/b> window displays test results for Intents, Entities, and Traits as described below. The summary data helps identify the errors or areas of improvement for each category and fix them.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Navigating_to_the_Test_Case_Details_Section\">Navigating to the Test Case Details Section<\/span><\/h3>\n<p>To view the <b>Details<\/b> section, follow these steps:<\/p>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li style=\"list-style-type: none;\">\n<ol>\n<li>In the <b>Test Cases &#8211; Detailed Analysis<\/b> window, click the <b>Intents<\/b>, <b>Entities<\/b>, or <b>Traits<\/b> tab. A summary table with the following details is displayed:<\/li>\n<\/ol>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><b>Intents<\/b><\/p>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li><b>Test Cases<\/b>: The test case name.<\/li>\n<li><b>Intent Type<\/b>: Displays if the intent is a Dialog intent, FAQ, or Small Talk.<\/li>\n<li><b>Expected Intent<\/b>: Intent expected in the user utterance.<\/li>\n<li><b>Matched Intent<\/b>: Intent actually matched in the utterance.<\/li>\n<li><b>Result Type<\/b>: Displays if the match detected is <i>True Positive<\/i>, <i>False Positive<\/i>, or <i>False Negative<\/i>.<\/li>\n<li><b>Tags<\/b>: The tag labeled for the conversation by the analyst.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230126074611\/Hm-7-1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-53076\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230126074611\/Hm-7-1.png\" alt=\"\" width=\"500\" height=\"350\" \/><\/a><\/p>\n<p><b>Entities<\/b><\/p>\n<p>A summary table with the following details is displayed:<\/p>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li><b>Utterances<\/b>: The user utterance captured in the test case.<\/li>\n<li><b>Entity Name<\/b>: The entity name mapped to the test case for the utterance.<\/li>\n<li><b>Expected Value<\/b>: The Entity expected in the user utterance.<\/li>\n<li><b>Matched Value<\/b>: The Entity actually matched in the utterance.<\/li>\n<li><b>Entity Result<\/b>: Displays if an entity is matched (<i>True<\/i>), or not (<i>False<\/i>).<\/li>\n<li><b>Tags<\/b>: The tag labeled for the conversation by the analyst.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230126074942\/Hm-8-1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-53079\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230126074942\/Hm-8-1.png\" alt=\"\" width=\"500\" height=\"350\" \/><\/a><\/p>\n<p><b>Traits<\/b><\/p>\n<p>A summary table with the following details is displayed:<\/p>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li><b>Test Cases<\/b>: The test case of the trait.<\/li>\n<li><b>Intent Type<\/b>: Displays <b>Trait<\/b>.<\/li>\n<li><b>Trait Name<\/b>: The name of the trait analyzed in the test case.<\/li>\n<li><b>Expected Trait<\/b>: The trait expected in the user utterance.<\/li>\n<li><b>Matched Trait<\/b>: Displays the actual trait matched in the utterance.<\/li>\n<li><b>Trait Result<\/b>: Displays if the match detected is <i>True Positive<\/i>, <i>False Positive<\/i>, or <i>False Negative<\/i>.<\/li>\n<li><b>Tags<\/b>: The tag labeled for the conversation by the analyst.<\/li>\n<li><a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230126075358\/Hm-9-2.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-53085\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230126075358\/Hm-9-2.png\" alt=\"\" width=\"500\" height=\"350\" \/><\/a><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><b>Tags<\/b><\/p>\n<p>After analyzing the reason for failure, you can collaborate with your team members using tags for test case executions. <b>Tags<\/b> are labels mapped to the test case results of intents, entities, and traits, indicating follow-up actions or suggestions.<\/p>\n<p>The following tags are available for intents, entities, and traits:<\/p>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li><b>Add Negative Pattern<\/b>: Indicates that the user has to add a negative pattern to the intent\/entity\/trait test execution.<\/li>\n<li><b>NeedNLPHelp<\/b>: Indicates that the test execution requires explicit NLP help.<\/li>\n<li><b>Needs Negative Pattern<\/b>: Indicates that the intent\/entity\/trait test execution needs a negative pattern to execute as expected.<\/li>\n<li><b>Needs Training<\/b>: Indicates that the virtual assistant needs training for the identified intent\/entity\/trait after the test execution.<\/li>\n<li><b>New Intent<\/b>: Indicates a new intent during test execution.<\/li>\n<\/ul>\n<ol start=\"2\">\n<li style=\"list-style-type: none;\">\n<ol start=\"2\">\n<li>Hover over the desired entry, and click the <b>detailed view<\/b> icon.<\/li>\n<\/ol>\n<\/li>\n<\/ol>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230126064219\/Hm-4-1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-53035\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230126064219\/Hm-4-1.png\" alt=\"\" width=\"500\" height=\"400\" \/><\/a><\/p>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li style=\"list-style-type: none;\">\n<ol start=\"2\">\n<li style=\"list-style-type: none;\">\n<ol start=\"2\">\n<li>A sliding window with the test results for the selected test case and intent type appears.<\/li>\n<\/ol>\n<\/li>\n<\/ol>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><b>Intent and Entity Details<\/b><\/p>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230126070221\/hm-5new.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-53054\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230126070221\/hm-5new.png\" alt=\"\" width=\"500\" height=\"400\" \/><\/a><\/p>\n<p><b>Trait Details<\/b> are displayed in the test case details window if you select the <b>trait<\/b> intent type.<\/p>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230126071244\/Hm-6-1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-53069\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230126071244\/Hm-6-1.png\" alt=\"\" width=\"500\" height=\"400\" \/><\/a><\/p>\n<p>&nbsp;<\/p>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li>Click the <b>expansion arrow<\/b> icon under <b>Entity<\/b> to view the entity order expected by the ML engine and the actual entity order.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220813071738\/entity-dropdown.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-43936\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220813071738\/entity-dropdown.png\" alt=\"\" width=\"500\" height=\"300\" \/><\/a><\/p>\n\r\n\t\t<\/div>\r\n\t<\/div>\r\n<div class=\"w-separator size_medium\"><\/div>\r\n\t<div class=\"wpb_text_column \">\r\n\t\t<div class=\"wpb_wrapper\">\r\n\t\t\t<h4>NLP Analysis<\/h4>\n<p>The <b>NLP Analysis<\/b> section displays the detailed view of the historic analysis generated at the time of the test case execution for failed and successful test cases. For the selected intent type, this section gives an overview of the intents that are qualified (the definitive and probable matches) and disqualified to serve as crucial information for users trying to decode the reason for failed test cases. The following details are displayed as a graphical representation in this section:<\/p>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li><a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/nlp\/traits\/#Trait_Definition\" target=\"_blank\" rel=\"noopener noreferrer\">Traits<\/a> (if applicable)<\/li>\n<li><a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/test-your-bot\/testing-your-bot-with-nlp\/#ML_Model\" target=\"_blank\" rel=\"noopener noreferrer\">Machine Learning (ML) engine<\/a><\/li>\n<li><a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/test-your-bot\/testing-your-bot-with-nlp\/#FM_Model\" target=\"_blank\" rel=\"noopener noreferrer\">Fundamental Meaning (FM) engine<\/a><\/li>\n<li><a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/test-your-bot\/testing-your-bot-with-nlp\/#Knowledge_Graph\" target=\"_blank\" rel=\"noopener noreferrer\">Knowledge Graph (KG) engine<\/a><\/li>\n<li><a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/nlp\/traits\/#Trait_Association_Rules\" target=\"_blank\" rel=\"noopener noreferrer\">Trait Rule<\/a> (if applicable)<\/li>\n<li><a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/test-your-bot\/testing-your-bot-with-nlp\/#Ranking_and_Resolver\" target=\"_blank\" rel=\"noopener noreferrer\">Ranking and Resolver<\/a><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>This is different from analyzing the test results under <b>Utterance Testing<\/b> where the current analysis information is displayed based on the changes to the trained data. <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/test-your-bot\/testing-your-bot-with-nlp\/#Analyzing_the_Test_Results\" target=\"_blank\" rel=\"noopener noreferrer\">Learn more<\/a>.<\/p>\n<p>To view the <b>NLP Analysis<\/b> section, follow these steps:<\/p>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li style=\"list-style-type: none;\">\n<ol>\n<li style=\"list-style-type: none;\">\n<ol>\n<li>Please follow <b>steps 1 to 3<\/b> mentioned in the <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/virtual-assistants-health-and-monitoring\/#Navigating_to_the_Test_Case_Details_Section\" target=\"_blank\" rel=\"noopener noreferrer\">Navigating to the Test Case Details<\/a> section.<\/li>\n<li>Click the <b>NLP Analysis<\/b> tab as shown below:<\/li>\n<\/ol>\n<\/li>\n<\/ol>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220813074726\/nlp-analysis.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-43940\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220813074726\/nlp-analysis.png\" alt=\"\" width=\"460\" height=\"350\" \/><\/a><\/p>\n<h2><span class=\"ez-toc-section\" id=\"Test_Suite_Summary\">Test Suite Summary<\/span><\/h2>\n<p>For <b>Flow Health<\/b>, clicking the <b>View Test Suites<\/b> link displays the following details:<\/p>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li>Test Suite<\/li>\n<li>Result<\/li>\n<li>Duration<\/li>\n<li>Test Cases<\/li>\n<li>Pass<\/li>\n<li>Fail<\/li>\n<li>Not Executed<\/li>\n<li>Pass percentage<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>Please click <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/flow-health-dashboard\/#Flow_Metrics\" target=\"_blank\" rel=\"noopener noreferrer\">here<\/a> to learn more about Test Suite Performance and Test Coverage Analysis.<\/p>\n\r\n\t\t<\/div>\r\n\t<\/div>\r\n<div class=\"w-separator size_medium\"><\/div>\r\n\t<div class=\"wpb_text_column \">\r\n\t\t<div class=\"wpb_wrapper\">\r\n\t\t\t<h4>Utterance Testing<\/h4>\n<p>Based on the test case failures, you can retrain your virtual assistant using the <b>Utterance testing<\/b> option for all possible user utterances and inputs. Training is how you enhance the performance of the NLP engine to prioritize one task or user intent over another based on the user input. To learn more, please refer to this <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/test-your-bot\/testing-your-bot-with-nlp\/#Training_the_Bot\">link<\/a>.<\/p>\n<p>To navigate to the <b>Utterance Testing<\/b> window, follow these steps:<\/p>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li style=\"list-style-type: none;\">\n<ol>\n<li>Click the <b>go to utterance testing<\/b> (magic wand) icon on the <b>Test Cases &#8211; Detailed Analysis<\/b> page.<br \/>\n<a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220813105703\/magic-wand-1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-43982\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220813105703\/magic-wand-1.png\" alt=\"\" width=\"800\" height=\"300\" \/><\/a><\/li>\n<\/ol>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>In the <b>Utterance Testing<\/b> window shown below, you can do the following:<\/p>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li>Test &amp; <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/test-your-bot\/testing-your-bot-with-nlp\/#Training_the_Assistant\" target=\"_blank\" rel=\"noopener noreferrer\">Train<\/a> your virtual assistant based on these <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/nlp\/user-utterances\/#Recommendations\" target=\"_blank\" rel=\"noopener noreferrer\">recommendations <\/a>to understand different user utterances and match them with intents and entities.<\/li>\n<li>View the <b>NLP analysis<\/b> flow and <b>Fields\/Entities<\/b> analysis data including the confidence score based on the NER training.<\/li>\n<li>Use the <b>Mark as an incorrect match<\/b> link to match the user input with the right intent when it is mapped to an incorrect task.<a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220813120216\/mark-incorrect.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-44017\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220813120216\/mark-incorrect.png\" alt=\"\" width=\"800\" height=\"350\" \/><\/a><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\r\n\t\t<\/div>\r\n\t<\/div>\r\n<div class=\"w-separator size_medium\"><\/div>\r\n\t<div class=\"wpb_text_column \">\r\n\t\t<div class=\"wpb_wrapper\">\r\n\t\t\t<h2><span class=\"ez-toc-section\" id=\"Dialog_Intent_Summary\">Dialog Intent Summary<\/span><\/h2>\n<p>This section provides the performance metrics, test coverage and analytics for only the <b>Dialog Intents<\/b> test cases.<br \/>\n<a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220725110503\/dialog-intent-summary.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-43366\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220725110503\/dialog-intent-summary.png\" alt=\"\" width=\"800\" height=\"300\" \/><\/a><\/p>\n<p>The sub-sections available include:<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Test_Coverage\">Test Coverage<\/span><\/h3>\n<p>This section displays the count and percentage of the intents covered and not covered. You can find the list of intents not covered using the <b>View details<\/b> option and start adding test cases for them. An Intent is considered as covered when the intent has at least one test case in the selected test suite(s).<\/p>\n<h3><span class=\"ez-toc-section\" id=\"NLP_Performance_Metrics\">NLP Performance Metrics<\/span><\/h3>\n<p>This section gives the breakdown of the test case results for the given intent type. The result type could have one of the following values:<\/p>\n<ul>\n<li><b>True Positive (TP)<\/b>: Percentage of utterances that have correctly matched expected intent.<br \/>\nIn the case of Small Talk, it would be when the list of expected and actual intents are the same.<br \/>\nIn the case of Traits, this would include the traits matched over and above the expected matches.<\/li>\n<li><b>False Positive (FP)<\/b>: Percentage of utterances that have matched an unexpected intent. In the case of Small Talk, it would be when the list of expected and actual intents are different.<\/li>\n<li><b>False Negative (FN)<\/b>: Percentage of utterances that have not matched expected intent. In the case of Small Talk, it would be when the list of expected Small Talk intent is blank but the actual Small Talk is mapped to an intent.<\/li>\n<\/ul>\n<p><b>Recommendation Notification<\/b>: Shows any training recommendations available for the dialog intents.<\/p>\n<p>The test execution results for the selected test suite(s) and intent type can be analyzed in the details window which provides a drill-down view of the following performance metrics for intents, entities, and traits<\/p>\n<table>\n<tbody>\n<tr>\n<th><b>Metric Name<\/b><\/th>\n<th><b>Description<\/b><\/th>\n<th><b>Intent<\/b><\/th>\n<th><b>Entity<\/b><\/th>\n<th><b>Trait<\/b><\/th>\n<\/tr>\n<tr>\n<td><b>Expected Intent\/Value<\/b><\/td>\n<td>Please refer to Intents in <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/virtual-assistants-health-and-monitoring\/#Navigating_to_the_Test_Case_Details_Section\" target=\"_blank\" rel=\"noopener noreferrer\">this<\/a> section.<\/td>\n<td>Yes<\/td>\n<td>Yes<\/td>\n<td>Yes<\/td>\n<\/tr>\n<tr>\n<td><b>Matched Intent\/Value<\/b><\/td>\n<td>Please refer to Intents in <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/virtual-assistants-health-and-monitoring\/#Navigating_to_the_Test_Case_Details_Section\" target=\"_blank\" rel=\"noopener noreferrer\">this<\/a> section.<\/td>\n<td>Yes<\/td>\n<td>Yes<\/td>\n<td>Yes<\/td>\n<\/tr>\n<tr>\n<td><b>Parent Intent<\/b><\/td>\n<td><a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/bot-intelligence\/sub-intents-and-follow-up-intents\/\">Learn more<\/a>.<\/td>\n<td>Yes<\/td>\n<td>No<\/td>\n<td>Yes<\/td>\n<\/tr>\n<tr>\n<td><b>Task State<\/b><\/td>\n<td>The status of the intent or task against which the intent is identified. Possible values include <b>Configured<\/b> or <b>Published<\/b>.<br \/>\n.<\/td>\n<td>Yes<\/td>\n<td>No<\/td>\n<td>Yes<\/td>\n<\/tr>\n<tr>\n<td><b>Result Type<\/b><\/td>\n<td>Please refer to Intents in <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/virtual-assistants-health-and-monitoring\/#Navigating_to_the_Test_Case_Details_Section\" target=\"_blank\" rel=\"noopener noreferrer\">this<\/a> section.<\/td>\n<td>Yes<\/td>\n<td>No<\/td>\n<td>Yes<\/td>\n<\/tr>\n<tr>\n<td><b>Matched Intent Score and Expected Intent Score<\/b><\/td>\n<td>Displays the individual scores for the following<\/p>\n<ul>\n<li><a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/test-your-bot\/testing-your-bot-with-nlp\/#ML_Model\">Machine Learning (ML) score<\/a><\/li>\n<li><a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/test-your-bot\/testing-your-bot-with-nlp\/#FM_Model\">Fundamental Meaning (FM) score<\/a><\/li>\n<li><a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/test-your-bot\/testing-your-bot-with-nlp\/#Ranking_and_Resolver\">Ranking and Resolver (RR) score<\/a><\/li>\n<\/ul>\n<\/td>\n<td>Yes<\/td>\n<td>No<\/td>\n<td>Yes<\/td>\n<\/tr>\n<tr>\n<td><b>Entity Name<\/b><\/td>\n<td>Please refer to Entities in <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/virtual-assistants-health-and-monitoring\/#Navigating_to_the_Test_Case_Details_Section\" target=\"_blank\" rel=\"noopener noreferrer\">this<\/a> section..<\/td>\n<td>No<\/td>\n<td>Yes<\/td>\n<td>No<\/td>\n<\/tr>\n<tr>\n<td><b>Result<\/b><\/td>\n<td>Returns <i><b>True<\/b><\/i> if an entity is identified and <i><b>False<\/b><\/i> if not.<\/td>\n<td>No<\/td>\n<td>Yes<\/td>\n<td>No<\/td>\n<\/tr>\n<tr>\n<td><b>Identified by<\/b><\/td>\n<td>The NLU engine that identified the entity.<\/td>\n<td>No<\/td>\n<td>Yes<\/td>\n<td>No<\/td>\n<\/tr>\n<tr>\n<td><b>Identified using<\/b><\/td>\n<td>The reference entity type that was used to identify the entity during test execution.<\/td>\n<td>No<\/td>\n<td>Yes<\/td>\n<td>No<\/td>\n<\/tr>\n<tr>\n<td><b>Confidence Score<\/b><\/td>\n<td>A score to determine if the test execution resulted in a favorable outcome (high score) or not (low score) when an utterance is trained for the entity.<\/td>\n<td>No<\/td>\n<td>Yes<\/td>\n<td>No<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h2><span class=\"ez-toc-section\" id=\"Dialog_Intent_Flow_Health\">Dialog Intent Flow Health<\/span><\/h2>\n<p>Please refer to this <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/flow-health-dashboard\/#Dialog_Intent_Summary\" target=\"_blank\" rel=\"noopener noreferrer\">link<\/a> for more information.<\/p>\n<p>The following sections can be accessed from the <b>Dialog Intent Summary<\/b> panel:<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Conversation_Test_Results_Analysis\">Conversation Test Results Analysis<\/span><\/h3>\n<p>Please refer to this <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/flow-health-dashboard\/#Conversation_Test_Results_Analysis\" target=\"_blank\" rel=\"noopener noreferrer\">link<\/a> for more information.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Transitions_Coverage\">Transitions Coverage<\/span><\/h3>\n<p>Please refer to this <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/flow-health-dashboard\/#Transitions_Coverage\" target=\"_blank\" rel=\"noopener noreferrer\">link<\/a> for more information.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"View_Intents_Summary\">View Intents Summary<\/span><\/h3>\n<p>Please refer to this <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/flow-health-dashboard\/#View_Intent_Summary\" target=\"_blank\" rel=\"noopener noreferrer\">link <\/a>for more information.<\/p>\n\r\n\t\t<\/div>\r\n\t<\/div>\r\n<div class=\"w-separator size_medium\"><\/div>\r\n\t<div class=\"wpb_text_column \">\r\n\t\t<div class=\"wpb_wrapper\">\r\n\t\t\t<p><b>View Recommendations<\/b><\/p>\n<p>You can view relevant training recommendations for dialog intents, FAQs, or Small Talks when errors and warnings are triggered during the test execution. To view the recommendations summary, click <b>View Recommendations<\/b> on the top right of the details page.<\/p>\n<p>To view the details of the utterance validations, errors, warnings, and recommendations and correct them, click the <b>Recommendations<\/b> column.<br \/>\n<a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220725112143\/dialog-recommendations.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-43383\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220725112143\/dialog-recommendations.png\" alt=\"\" width=\"800\" height=\"6300\" \/><\/a><\/p>\n<h2><span class=\"ez-toc-section\" id=\"Viewing_Specific_Test_Results\">Viewing Specific Test Results<\/span><\/h2>\n<p>To know how to get the drill-down view of a specific NLP test case execution, please refer to the <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/virtual-assistants-health-and-monitoring\/#NLP_-_Test_Cases_Detailed_Analysis\">Test Cases &#8211; Detailed Analysis<\/a> section.<\/p>\n\r\n\t\t<\/div>\r\n\t<\/div>\r\n\r\n\t<div class=\"wpb_text_column \">\r\n\t\t<div class=\"wpb_wrapper\">\r\n\t\t\t<h3><span class=\"ez-toc-section\" id=\"NLP-_FAQs_Summary\">NLP- FAQs Summary<\/span><\/h3>\n<p>The <b>FAQ Summary<\/b> section displays the <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/virtual-assistants-health-and-monitoring\/#Health_and_Monitoring_Metrics\">recommendation scores<\/a> generated for FAQs from the latest batch test executions.<br \/>\n<a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220725120536\/FAQ-summary.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-43426\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220725120536\/FAQ-summary.png\" alt=\"\" width=\"800\" height=\"300\" \/><\/a><\/p>\n<p><b>Viewing Additional FAQ Recommendations<\/b><\/p>\n<p>For <b>FAQ Details<\/b>, clicking <b>View Recommendations<\/b> will display the report that was already run during the previous run time. To know how to view and manage additional recommendations, please refer to this <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/nlp\/training-validations\/#How_to_Use_the_NLU_Validate_Model\" target=\"_blank\" rel=\"noopener noreferrer\">link<\/a>.<\/p>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220725121433\/FAQ-recommendations-1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-43438\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220725121433\/FAQ-recommendations-1.png\" alt=\"\" width=\"800\" height=\"300\" \/><\/a><br \/>\n<a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220725121234\/FAQ-recommendations.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-43435\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220725121234\/FAQ-recommendations.png\" alt=\"\" width=\"800\" height=\"300\" \/><\/a><\/p>\n<p><b>Knowledge Graph<\/b>: Clicking this button will take you to the <b>Knowledge Graph<\/b> section where you can perform <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/bot-builder-tool\/knowledge-task\/knowledge-ontology-analysis\/\">KG Analysis<\/a>.<br \/>\n<a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220725121631\/FAQ-kg.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-43442\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220725121631\/FAQ-kg.png\" alt=\"\" width=\"800\" height=\"300\" \/><\/a><br \/>\n<a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220725121829\/FAQ-kg-1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-43445\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220725121829\/FAQ-kg-1.png\" alt=\"\" width=\"800\" height=\"648\" \/><\/a><\/p>\n<h3><span class=\"ez-toc-section\" id=\"Flow-_FAQs_Summary\">Flow- FAQs Summary<\/span><\/h3>\n<p>Please refer to this <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/flow-health-dashboard\/#FAQs_Summary\" target=\"_blank\" rel=\"noopener noreferrer\">link<\/a> for more information.<\/p>\n\r\n\t\t<\/div>\r\n\t<\/div>\r\n<div class=\"w-separator size_medium\"><\/div>\r\n\t<div class=\"wpb_text_column \">\r\n\t\t<div class=\"wpb_wrapper\">\r\n\t\t\t<h3><span class=\"ez-toc-section\" id=\"NLP-_Small_Talk_Summary\">NLP- Small Talk Summary<\/span><\/h3>\n<p>The <b>Small Talk Summary<\/b> panel displays the <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/virtual-assistants-health-and-monitoring\/#Health_and_Monitoring_Metrics\">recommendation scores<\/a> generated for Small Talk interactions from the latest batch test executions.<br \/>\n<a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220802085333\/small-talk-newstats.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-43696\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220802085333\/small-talk-newstats.png\" alt=\"\" width=\"800\" height=\"300\" \/><\/a><\/p>\n<p><b>Small Talk button<\/b>: Click this button to view the group name and the relevant user utterances, and Bot utterances.<br \/>\n<a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220725120047\/small-talk-button.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-43418\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220725120047\/small-talk-button.png\" alt=\"\" width=\"800\" height=\"300\" \/><\/a><\/p>\n<h3><span class=\"ez-toc-section\" id=\"Flow-_Small_Talk_Summary\">Flow- Small Talk Summary<\/span><\/h3>\n<p>Please refer to this <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/flow-health-dashboard\/#Small_Talk\" target=\"_blank\" rel=\"noopener noreferrer\">link<\/a> for more information.<\/p>\n\r\n\t\t<\/div>\r\n\t<\/div>\r\n<div class=\"w-separator size_medium\"><\/div>\r\n\t<div class=\"wpb_text_column \">\r\n\t\t<div class=\"wpb_wrapper\">\r\n\t\t\t<h2><span class=\"ez-toc-section\" id=\"Trait_and_Entity_Summary_Information\">Trait and Entity Summary Information<\/span><\/h2>\n<p>The <b>Trait Summary<\/b> and <b>Entity Summary<\/b> sections display the <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/virtual-assistants-health-and-monitoring\/#Health_and_Monitoring_Metrics\">recommendation scores<\/a> generated for traits and entities respectively from the latest batch test executions.<\/p>\n<p><b>Trait Summary<\/b><\/p>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220725113828\/trait-summary.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-43404\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220725113828\/trait-summary.png\" alt=\"\" width=\"700\" height=\"300\" \/><\/a><\/p>\n<p><b>Entity Summary<\/b><br \/>\n<a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220725113649\/entity-summary.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-43401\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220725113649\/entity-summary.png\" alt=\"\" width=\"700\" height=\"300\" \/><\/a><\/p>\n<p><b>Test Coverage and Test Results Analysis<\/b><\/p>\n<p>Please refer to <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/virtual-assistants-health-and-monitoring\/#Test_Coverage\">Test Coverage<\/a> and <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/virtual-assistants-health-and-monitoring\/#NLP_-_Test_Results_Analysis\">Test Results Analysis<\/a> for information on the sub-sections of these summary panels.<\/p>\n\r\n\t\t<\/div>\r\n\t<\/div>\r\n<div class=\"w-separator size_medium\"><\/div>\r\n\t<div class=\"wpb_text_column \">\r\n\t\t<div class=\"wpb_wrapper\">\r\n\t\t\t<h2><span class=\"ez-toc-section\" id=\"NLP_Batch_Test_Results_Summary_for_Universal_Bots\">NLP Batch Test Results Summary for Universal Bots<\/span><\/h2>\n<p><span style=\"font-weight: 400;\">The XO Platform now displays batch test results for Universal bots for each test run in the summary view for <\/span><a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/virtual-assistants-health-and-monitoring\/#NLP-_FAQs_Summary\"><span style=\"font-weight: 400;\">FAQs<\/span><\/a><span style=\"font-weight: 400;\">, <\/span><a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/virtual-assistants-health-and-monitoring\/#Dialog_Intent_Summary\"><span style=\"font-weight: 400;\">Dialog Intents<\/span><\/a><span style=\"font-weight: 400;\">, and <\/span><a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/virtual-assistants-health-and-monitoring\/#NLP-_Small_Talk_Summary\"><span style=\"font-weight: 400;\">Small Talk<\/span><\/a><span style=\"font-weight: 400;\"> during Batch Testing. The actionable insights help understand the test coverage and NLP performance for each intent type in the Universal Bot.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The only difference between Standard and Universal Bots is that the insights derived are based on the intents of all the linked bots. For instance, the intent coverage is based on the comparison of the intents covered in the test suite and the total number of intents present in all the linked bots.\u00a0<\/span><\/p>\n<h3><span class=\"ez-toc-section\" id=\"Test_Suite_Summary-2\"><span style=\"font-weight: 400;\">Test Suite Summary<\/span><\/span><\/h3>\n<p><span style=\"font-weight: 400;\">The <\/span><strong>Test Suite Summary<\/strong><span style=\"font-weight: 400;\"> for the Universal Bot is the same for Dialog Intents, FAQs, and Small Talk. However, for the Universal Bot, the system takes the total number of respective intents in all the linked bots as the denominator to calculate the coverage metrics.<\/span><\/p>\n<h3><span class=\"ez-toc-section\" id=\"Intent_Summary\"><span style=\"font-weight: 400;\">Intent Summary<\/span><\/span><\/h3>\n<p><span style=\"font-weight: 400;\">The <\/span><b>NLP<\/b> <b>Intent Summary<\/b><span style=\"font-weight: 400;\"> sections are the same for Universal Bots, except the <\/span><b>Recommendations<\/b><span style=\"font-weight: 400;\"> information is not displayed for<\/span><b> Dialogs<\/b><span style=\"font-weight: 400;\"> and <\/span><b>FAQs<\/b>,<span style=\"font-weight: 400;\">\u00a0as shown below:<\/span><\/p>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230902131018\/universalbot-test-summary.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-58966\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230902131018\/universalbot-test-summary.png\" alt=\"\" width=\"600\" height=\"400\" \/><\/a><\/p>\n<h3><span class=\"ez-toc-section\" id=\"Dialog_Intents\"><span style=\"font-weight: 400;\">Dialog Intents<\/span><\/span><\/h3>\n<p><span style=\"font-weight: 400;\">The <\/span><b>Dialog<\/b> <b>Intent Details<\/b><span style=\"font-weight: 400;\"> page for Universal Bot summarizes the following information:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Intent Name<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Bot Name<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Training Utterance<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Test Cases<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/virtual-assistants-health-and-monitoring\/#NLP_Performance_Metrics\" target=\"_blank\" rel=\"noopener noreferrer\"><span style=\"font-weight: 400;\">NLP performance metrics<\/span><\/a><span style=\"font-weight: 400;\">: TP, FP, FN, and F1.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/virtual-assistants-health-and-monitoring\/#NLP_Intent_Coverage_Metrics\" target=\"_blank\" rel=\"noopener noreferrer\"><span style=\"font-weight: 400;\">Coverage metrics<\/span><\/a><span style=\"font-weight: 400;\">: Precision, Recall, and Accuracy.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Covered In (The Test Suites that cover the intent).<\/span><\/li>\n<\/ul>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230902131435\/dialog-intent-universalbot.png\"><span style=\"font-weight: 400;\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-58969\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230902131435\/dialog-intent-universalbot.png\" alt=\"\" width=\"650\" height=\"500\" \/><\/span><\/a><br \/>\nPlease refer to <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/virtual-assistants-health-and-monitoring\/#Intent_Details_Window\"><span style=\"font-weight: 400;\">Intent Details Window<\/span><\/a><span style=\"font-weight: 400;\"> for more information on the above values.<\/span><\/p>\n<p><b>Note<\/b><span style=\"font-weight: 400;\">: The <\/span><b>Recommendations<\/b><span style=\"font-weight: 400;\"> option is not available for Universal Bot on this page.<\/span><\/p>\n<p>To view the intents not covered on the<strong> Dialog Intent Details<\/strong> page, click the <strong>Three-dotted\/Ellipses<\/strong> icon and select <strong><em>View Intents Not Covered<\/em><\/strong>.<\/p>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230902131726\/dialog-intent-details-universalbot.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-58972\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230902131726\/dialog-intent-details-universalbot.png\" alt=\"\" width=\"650\" height=\"400\" \/><\/a><\/p>\n<p>In the <strong>Not Covered Intent<\/strong>s List, you can view the respective Bot Name, as shown below. This helps analyze which Bots don\u2019t identify the tested intents and improve test execution accordingly.<\/p>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230902132023\/dialog-notcoveredintents-universalbot.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-58975\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230902132023\/dialog-notcoveredintents-universalbot.png\" alt=\"\" width=\"650\" height=\"450\" \/><\/a><\/p>\n<p>The <strong>Search<\/strong> and <strong>Filter <\/strong>options help select specific intents not covered by a Bot.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"FAQ\">FAQ<\/span><\/h3>\n<p>The <strong>FAQ Details<\/strong> page for Universal Bot summarizes the following information:<\/p>\n<ul>\n<li>Intent Name<\/li>\n<li>Bot<\/li>\n<li>Path<\/li>\n<li>Alt Question<\/li>\n<li>Test Cases<\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/virtual-assistants-health-and-monitoring\/#NLP_Performance_Metrics\" target=\"_blank\" rel=\"noopener noreferrer\"><span style=\"font-weight: 400;\">NLP performance metrics<\/span><\/a><span style=\"font-weight: 400;\">: TP, FP, FN, and F1.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/virtual-assistants-health-and-monitoring\/#NLP_Intent_Coverage_Metrics\" target=\"_blank\" rel=\"noopener noreferrer\"><span style=\"font-weight: 400;\">Coverage metrics<\/span><\/a><span style=\"font-weight: 400;\">: Precision, Recall, and Accuracy.<\/span><\/li>\n<li>Covered In (The Test Suites that cover the intent).<\/li>\n<\/ul>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230902132507\/FAQ-details-universalbot.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-58978\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230902132507\/FAQ-details-universalbot.png\" alt=\"\" width=\"600\" height=\"250\" \/><\/a><\/p>\n<p>Please refer to <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/virtual-assistants-health-and-monitoring\/#Intent_Details_Window\">Intent Details Window<\/a> for more information on the above values.<\/p>\n<p><strong>\u00a0<\/strong><strong>Note<\/strong>: The <strong>Knowledge Graph<\/strong> and <strong>Recommendations<\/strong> options are not available for Universal Bot on this page.<\/p>\n<p>To view the intents not covered on the<strong> FAQ Details<\/strong> page, click the <strong>Three-dotted\/Ellipses<\/strong> icon and select <strong><em>View Intents Not Covered<\/em><\/strong>.<\/p>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230902132752\/view-intents-not-covered-faq-universalbot.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-58981\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230902132752\/view-intents-not-covered-faq-universalbot.png\" alt=\"\" width=\"650\" height=\"350\" \/><\/a><br \/>\nIn the <strong>Not Covered Intents<\/strong> List, you can view the respective Bot Name, as shown below.<\/p>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230902133015\/faq-notcoveredintents-universalbot.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-58984\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230902133015\/faq-notcoveredintents-universalbot.png\" alt=\"\" width=\"650\" height=\"350\" \/><\/a><\/p>\n<h3><span class=\"ez-toc-section\" id=\"Small_Talk\">Small Talk<\/span><\/h3>\n<p>The <strong>Small Talk Details<\/strong> page for Universal Bot summarizes the following information:<\/p>\n<ul>\n<li>Intent<\/li>\n<li>Group<\/li>\n<li>Bot<\/li>\n<li>Test Cases<\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/virtual-assistants-health-and-monitoring\/#NLP_Performance_Metrics\" target=\"_blank\" rel=\"noopener noreferrer\"><span style=\"font-weight: 400;\">NLP performance metrics<\/span><\/a><span style=\"font-weight: 400;\">: TP, FP, FN, and F1.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/virtual-assistants-health-and-monitoring\/#NLP_Intent_Coverage_Metrics\" target=\"_blank\" rel=\"noopener noreferrer\"><span style=\"font-weight: 400;\">Coverage metrics<\/span><\/a><span style=\"font-weight: 400;\">: Precision, Recall, and Accuracy.<\/span><\/li>\n<li>Covered In (The Test Suites that cover the intent).<\/li>\n<\/ul>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230902133332\/smalltalk-universalbot.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-58987\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230902133332\/smalltalk-universalbot.png\" alt=\"\" width=\"650\" height=\"350\" \/><\/a><br \/>\nPlease refer to <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/virtual-assistants-health-and-monitoring\/#Intent_Details_Window\">Intent Details Window<\/a> for more information on the above values.<\/p>\n<p><strong>Note<\/strong>: The <strong>Small Talk<\/strong> option is not available for Universal Bot on this page.<\/p>\n<p>To view the intents not covered on the<strong> Small Talk Details<\/strong> page, click the <strong>Three-dotted\/Ellipses<\/strong> icon and select <strong><em>View Intents Not Covered<\/em><\/strong>.<\/p>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230902133608\/smalltalk-viewintentsnot-covered-universalbot.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-58990\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230902133608\/smalltalk-viewintentsnot-covered-universalbot.png\" alt=\"\" width=\"650\" height=\"350\" \/><\/a><\/p>\n<p>In the <strong>Not Covered Intent<\/strong>s List, you can view the respective Bot Name, as shown below.<\/p>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230902133825\/smalltalk-intentsnotcovered-universalbot.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-58993\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20230902133825\/smalltalk-intentsnotcovered-universalbot.png\" alt=\"\" width=\"650\" height=\"350\" \/><\/a><\/p>\n\r\n\t\t<\/div>\r\n\t<\/div>\r\n<div class=\"w-separator size_medium\"><\/div>\r\n\t<div class=\"wpb_text_column \">\r\n\t\t<div class=\"wpb_wrapper\">\r\n\t\t\t<h2><span class=\"ez-toc-section\" id=\"Intent_Details_Window\">Intent Details Window<\/span><\/h2>\n<p>The <b>View Details<\/b> link in the Dialog intent, FAQ, and Small Talk summary sections provides access to a drill-down view of the key performance metrics and recommendations of the covered intents. The given data helps identify the intent-related issues proactively in the training phase itself to work on fixing them accordingly.<\/p>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220813115516\/vd.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-44013\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220813115516\/vd.png\" alt=\"\" width=\"700\" height=\"300\" \/><\/a><\/p>\n<p>Here\u2019s what you can do:<\/p>\n<p><b>View the Training Data Summary<\/b><\/p>\n<p>You can view the training data summary with the relevant recommendation metrics for Dialog Intents, FAQs, and Small Talks in the details panel.<br \/>\n<a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220813103747\/traning-summary.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-43976\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220813103747\/traning-summary.png\" alt=\"\" width=\"800\" height=\"300\" \/><\/a><\/p>\n<p>The summary of all the metrics displayed is given below:<\/p>\n<table>\n<tbody>\n<tr>\n<th><b>Recommendation Metric<\/b><\/th>\n<th><b>Dialog Intent<\/b><\/th>\n<th><b>FAQ<\/b><\/th>\n<th><b>Small Talk<\/b><\/th>\n<\/tr>\n<tr>\n<td><b>Intent<\/b><\/td>\n<td>The name of the dialog intent.<\/td>\n<td>The name of the FAQ intent.<\/td>\n<td>The name of the Small Talk intent.<\/td>\n<\/tr>\n<tr>\n<td><b>Utterances<\/b><\/td>\n<td>The count of the training utterances for that intent.<\/td>\n<td>N\/A<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td><b>Test Cases<\/b><\/td>\n<td>The count of the test cases that are present in the selected test suites for that intent.<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td><b>True Positive (TP)<\/b><\/td>\n<td>The count of the intent test cases that resulted in TP.<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td><b>False Negative (FN)<\/b><\/td>\n<td>The count of the intent test cases that resulted in FN.<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td><b>False Positive (FP)<\/b><\/td>\n<td>The count of the intent test cases that resulted in FP.<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td><b>Covered In<\/b><\/td>\n<td>Name of the test suites in which the intent test cases are present.<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td><b>F1, Accuracy, Precision, and Recall scores<\/b><\/td>\n<td>These <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/analyzing-your-bot\/virtual-assistants-health-and-monitoring\/#Health_and_Monitoring_Metrics\">recommendation scores<\/a> are displayed based on the outcomes.<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td><b>Recommendations<\/b><\/td>\n<td>Displays the count of training recommendations for that intent. Clicking on it will display the summary of the training recommendations and their probable corrective actions.<\/td>\n<td>N\/A<\/td>\n<td>N\/A<\/td>\n<\/tr>\n<tr>\n<td><b>Group<\/b><\/td>\n<td>N\/A<\/td>\n<td>N\/A<\/td>\n<td>The group to which the Small Talk interaction is mapped.<\/td>\n<\/tr>\n<tr>\n<td><b>Path<\/b><\/td>\n<td>N\/A<\/td>\n<td>The node path in the Knowledge Graph.<\/td>\n<td>N\/A<\/td>\n<\/tr>\n<tr>\n<td><b>Alt Question<\/b><\/td>\n<td>N\/A<\/td>\n<td>The number of alternative questions mapped to an FAQ.<\/td>\n<td>N\/A<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p><b>View Intents Not Covered<\/b><\/p>\n<p>This feature helps identify the intents not covered so as to include them in the test data for better and holistic <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/test-your-bot\/testing-your-bot-with-nlp\/#Testing_the_Bot\">testing of the virtual assistant<\/a>. Click the <b>three-dot menu<\/b> on the right side of the panel to view the list of <b>intents not covered<\/b> in batch testing.<br \/>\n<a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220813114358\/vinc.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-44005\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220813114358\/vinc.png\" alt=\"\" width=\"700\" height=\"300\" \/><\/a><\/p>\n<p>You can include the intents from this list to retrain your virtual assistant and improve performance.<\/p>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220725112854\/not-covered-1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-43394\" src=\"https:\/\/kore-wordpress.s3.us-east-2.amazonaws.com\/developer.kore.ai\/v10-1\/wp-content\/uploads\/sites\/35\/20220725112854\/not-covered-1.png\" alt=\"\" width=\"400\" height=\"300\" \/><\/a><\/p>\n\r\n\t\t<\/div>\r\n\t<\/div>\r\n<div class=\"w-separator size_medium\"><\/div><\/div><\/div><\/div><\/div><\/div><\/section>\n","protected":false},"excerpt":{"rendered":"The Health and Monitoring dashboard offers a goal-driven approach to improving the accuracy of the virtual assistant\u2019s Natural Language Processing (NLP) model. The training data is analyzed along with the test coverage and test results of the test suites to provide insights into the NLP Model\u2019s performance. This dashboard lets you achieve the following: Run...","protected":false},"author":21,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[45],"tags":[],"class_list":["post-43913","post","type-post","status-publish","format-standard","hentry","category-analyzing-your-bot"],"_links":{"self":[{"href":"https:\/\/developer.kore.ai\/v10-1\/wp-json\/wp\/v2\/posts\/43913","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/developer.kore.ai\/v10-1\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/developer.kore.ai\/v10-1\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/developer.kore.ai\/v10-1\/wp-json\/wp\/v2\/users\/21"}],"replies":[{"embeddable":true,"href":"https:\/\/developer.kore.ai\/v10-1\/wp-json\/wp\/v2\/comments?post=43913"}],"version-history":[{"count":78,"href":"https:\/\/developer.kore.ai\/v10-1\/wp-json\/wp\/v2\/posts\/43913\/revisions"}],"predecessor-version":[{"id":59189,"href":"https:\/\/developer.kore.ai\/v10-1\/wp-json\/wp\/v2\/posts\/43913\/revisions\/59189"}],"wp:attachment":[{"href":"https:\/\/developer.kore.ai\/v10-1\/wp-json\/wp\/v2\/media?parent=43913"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/developer.kore.ai\/v10-1\/wp-json\/wp\/v2\/categories?post=43913"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/developer.kore.ai\/v10-1\/wp-json\/wp\/v2\/tags?post=43913"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}