{"id":57444,"date":"2023-06-25T08:16:30","date_gmt":"2023-06-25T07:16:30","guid":{"rendered":"https:\/\/developer.kore.ai\/v10-1\/?p=57444"},"modified":"2024-01-19T13:29:41","modified_gmt":"2024-01-19T13:29:41","slug":"genai-prompt","status":"publish","type":"post","link":"https:\/\/developer.kore.ai\/v10-1\/docs\/bots\/bot-builder-tool\/dialog-task\/genai-prompt\/","title":{"rendered":"GenAI Prompt (BETA)"},"content":{"rendered":"
<\/div>\r\n\t
\r\n\t\t
\r\n\t\t\t

The GenAI Prompt lets bot developers leverage the full potential of LLM and Generative AI models to quickly build their own prompts. Developers can select a specific AI model, tweak its settings, and preview the response for the prompt. The node allows developers to creatively leverage LLMs by defining the prompt using conversation context and the response from the LLMs in defining the subsequent conversation flow.<\/p>\n

Node Behavior<\/span><\/h2>\n

Runtime<\/span><\/h3>\n

You can work with this node like with any other node within Dialog Tasks and can invoke it within multiple tasks. During runtime, the node behaves as follows:<\/p>\n

    \n
  1. On reaching the GenAI Prompt, the platform parses any variable used in the prompt and constructs the request using the Prompt and the Advanced Settings.<\/li>\n
  2. An API call is made to the model with the request.<\/li>\n
  3. The response is stored in the context object<\/a> as part of the dialog context and can be used to define the transitions or any other part of the bot configuration.<\/li>\n
  4. The platform exits from the GenAI Prompt node when a successful response is received, or the defined timeout condition is met.<\/li>\n<\/ol>\n

    Enable the Node<\/span><\/h2>\n

    This node is not available by default. You can enable it for all Dialog Tasks as follows:<\/p>\n