Skip to main content

Availability

EditionDeployment Type
Community & EnterpriseSelf-Managed, Hybrid
Chats are customized interfaces that allow users to have one-on-one conversations with specific LLM providers, tools, and data based on their needs. Access is tailored to the user’s group, ensuring relevant and secure interactions. This page covers the administrator’s perspective on configuring and managing Chat Rooms. For the user’s perspective on interacting with these chats, see the Chat Interface documentation.

Configuration

The Add/Edit Chat View enables administrators to configure a new or existing chat room. Below is an explanation of each field and its purpose:
  • Name: The name of the chat room.
  • Description: A description for this chat room.
  • LLM Settings: Select the model call settings. These control parameters like temperature and max tokens. For more details, see LLM Call Settings.
  • LLM: The specific language model powering the chat (e.g., Anthropic Claude, OpenAI GPT).
  • Groups: Access control determining which user groups can see and use the chat.
  • Filters: Governance policies applied to the chat interactions.
  • System Prompt: The guiding instructions for the LLM’s persona and behavior.
  • Enable Tool Support: Toggles tool usage for the chat room.
  • Default Tools: Select default tools that will be available in this chat room. These tools will be automatically accessible to the AI when responding to user queries. For more details, see Tools.
  • RAG Results or Source to Include for Model: Configures vector database integration for context.
  • Default Data Source: Setting a default data source will automatically include this vector database in all conversations in this chat room, allowing the model to reference its contents when generating responses. For more details, see Data Sources (RAG).

How to Create a Chat Room

  1. Navigate to the Chats section in the AI Studio dashboard.
  2. Click the green + ADD CHAT button.
  3. Fill in the required fields such as Name and configure the desired parameters like LLM and System Prompt.
  4. Click Create Chat to save the configuration. Chat Configuration UI