{"id":60531,"date":"2023-12-11T13:16:49","date_gmt":"2023-12-11T13:16:49","guid":{"rendered":"https:\/\/developer.kore.ai\/v10-1\/?p=60531"},"modified":"2024-04-01T12:00:42","modified_gmt":"2024-04-01T11:00:42","slug":"kore-xo-gpt-model","status":"publish","type":"post","link":"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/nlp\/kore-xo-gpt-model\/","title":{"rendered":"Kore.ai XO GPT Module"},"content":{"rendered":"<section class=\"l-section wpb_row height_auto\"><div class=\"l-section-h i-cf\"><div class=\"g-cols vc_row type_default valign_top\"><div class=\"vc_col-sm-12 wpb_column vc_column_container\"><div class=\"vc_column-inner\"><div class=\"wpb_wrapper\"><div class=\"ult-spacer spacer-6ae86fec7be15\" data-id=\"6ae86fec7be15\" data-height=\"10\" data-height-mobile=\"10\" data-height-tab=\"10\" data-height-tab-portrait=\"\" data-height-mobile-landscape=\"\" style=\"clear:both;display:block;\"><\/div>\r\n\t<div class=\"wpb_text_column \">\r\n\t\t<div class=\"wpb_wrapper\">\r\n\t\t\t<p>The new Kore.ai XO GPT Models module provides fine-tuned large language models optimized for enterprise conversational AI applications. These models have been evaluated and fine-tuned to be accurate, safe, and efficient for production deployment. Initial capabilities include Conversation Summarization and User Query Rephrasing. Additional models for features like Intent Resolution, Bot Response Rephrasing, Entity Co-referencing, etc., are planned in future updates.<\/p>\n<div class=\"alert alert-info\"><b>Note<\/b>: The Kore.ai XO GPT Module is currently available only for English language interactions. The respective models are available only in our global deployment (US Cloud \u2013\u00a0https:\/\/bots.kore.ai).<\/div>\n<h2><span class=\"ez-toc-section\" id=\"Advantages_of_Using_Koreai_XO_GPT\">Advantages of Using Kore.ai XO GPT<\/span><\/h2>\n<p>The following are a few advantages of using Kore.ai XO GPT.<\/p>\n<ul>\n<li><strong>Accuracy<\/strong>: The XO GPT module leverages smaller foundation models, typically under 10 billion parameters, that have been fine-tuned specifically for conversational AI applications. By tuning smaller models rather than directly prompting larger generative models, the XO GPT Models achieve better accuracy, relevance, and interpretability for production deployment.<\/li>\n<li><strong>High Performance<\/strong>: The XO GPT Models are hosted along with the XO Platform and are relatively smaller in size. This results in faster response times, making them suitable for production use cases for digital and voice interactions.<\/li>\n<li><strong>Accelerate Time-to-Value with Pre-Tuned Models<\/strong>: The Kore.ai XO GPT Models come pre-fine-tuned for conversational AI use cases, eliminating the complex process of prompt engineering required for adopting commercial LLMs. Enterprises can rapidly deploy these models to start realizing value immediately without needing in-house machine learning expertise or long tuning cycles.<\/li>\n<li><strong>Data Security and Privacy<\/strong>: The Kore.ai XO GPT Models are fully integrated into the XO Platform, enabling the same enterprise-grade data confidentiality, privacy, and governance enforced across the XO stack.<\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"Fine_Tuning_Process\">Fine Tuning Process<\/span><\/h2>\n<p>Fine-tuning is an iterative process of taking a pre-trained LLM and adapting it to perform conversational AI tasks.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Koreais_Model_Fine-Tuning_Process\">Kore.ai\u2019s Model Fine-Tuning Process<\/span><\/h3>\n<ol>\n<li><strong>Data Collection<\/strong>: We gather a dataset specific to the desired task. This dataset serves as the training material for fine-tuning the LLM.<\/li>\n<li><strong>Selecting a base LLM<\/strong>: The pre-trained LLM is loaded considering their purpose and the features to which they will be applied.<\/li>\n<li><strong>Training Process<\/strong>: The training process utilizes the task-specific dataset to train the model, involving the model&#8217;s parameters adjustment to grasp the nuances of the target task.<\/li>\n<li><strong>Validation and Iteration<\/strong>: The fine-tuned model is evaluated on a separate validation dataset to ensure it performs well. If necessary, we iterate through the fine-tuning process to achieve optimal results.<\/li>\n<\/ol>\n<h2><span class=\"ez-toc-section\" id=\"Features_Supported_by_Koreai_XO_GPT\">Features Supported by Kore.ai XO GPT<\/span><\/h2>\n<p>The Kore.ai XO GPT module supports the following features:<\/p>\n<ul>\n<li><b>Conversation Summary<\/b>: This model generates concise, natural language summaries of interactions between the virtual assistant, users, and human agents. It distills the key intents, entities, decisions, and outcomes into an easy-to-read synopsis. Companies can leverage conversation summarization to boost agent productivity, ensure process compliance, and create better contextual recommendations \u2013 without having to read lengthy transaction histories. It is pre-integrated with Kore.ai\u2019s Contact Center platform. It is also extensible to third-party applications via API integration. <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/api-guide\/conversation-summary-api\/\" target=\"_blank\" rel=\"noopener noreferrer\">Learn more<\/a>.<\/li>\n<li><b>Rephrase Dialog Responses<\/b><span style=\"font-weight: 400;\">: This feature sends all User Prompts, Error Prompts, and Bot Responses to the configured LLM with the conversation context, which depends on the configured number of user inputs. Responses are rephrased based on the context and user emotion, providing the end user with a more empathetic, natural, and contextual conversation experience. <\/span><a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/nlp\/dynamic-conversations-features\/#Rephrase_Dialog_Responses\"><span style=\"font-weight: 400;\">Learn more<\/span><\/a><span style=\"font-weight: 400;\">.<\/span><\/li>\n<li><b>Rephrase User Query<\/b>: This XO GPT model utilizes the bot domain knowledge and conversation history to expand and rephrase user queries for improved understanding by downstream NLP components. This includes better recognition of contextual intents, entity co-referencing, and more. <a href=\"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/nlp\/dynamic-conversations-features\/#Rephrase_User_Query\" target=\"_blank\" rel=\"noopener noreferrer\">Learn more<\/a>.<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n\r\n\t\t<\/div>\r\n\t<\/div>\r\n<\/div><\/div><\/div><\/div><\/div><\/section>\n","protected":false},"excerpt":{"rendered":"The new Kore.ai XO GPT Models module provides fine-tuned large language models optimized for enterprise conversational AI applications. These models have been evaluated and fine-tuned to be accurate, safe, and efficient for production deployment. Initial capabilities include Conversation Summarization and User Query Rephrasing. Additional models for features like Intent Resolution, Bot Response Rephrasing, Entity Co-referencing,...","protected":false},"author":26,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[],"class_list":["post-60531","post","type-post","status-publish","format-standard","hentry","category-nlp"],"_links":{"self":[{"href":"https:\/\/developer.kore.ai\/v10-1\/wp-json\/wp\/v2\/posts\/60531","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/developer.kore.ai\/v10-1\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/developer.kore.ai\/v10-1\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/developer.kore.ai\/v10-1\/wp-json\/wp\/v2\/users\/26"}],"replies":[{"embeddable":true,"href":"https:\/\/developer.kore.ai\/v10-1\/wp-json\/wp\/v2\/comments?post=60531"}],"version-history":[{"count":12,"href":"https:\/\/developer.kore.ai\/v10-1\/wp-json\/wp\/v2\/posts\/60531\/revisions"}],"predecessor-version":[{"id":61580,"href":"https:\/\/developer.kore.ai\/v10-1\/wp-json\/wp\/v2\/posts\/60531\/revisions\/61580"}],"wp:attachment":[{"href":"https:\/\/developer.kore.ai\/v10-1\/wp-json\/wp\/v2\/media?parent=60531"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/developer.kore.ai\/v10-1\/wp-json\/wp\/v2\/categories?post=60531"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/developer.kore.ai\/v10-1\/wp-json\/wp\/v2\/tags?post=60531"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}