Atlas AI Assistant - Configuration

Atlas 5.1 introduces the AI Assistant. For a general overview please see the following article: Atlas AI Assistant

In this article we will look at the various configuration settings that administrators can set to control how the AI is used and the information it can return.

In this article:

• AI Glossary
• Access the configuration settings
• Control who can use the AI Assistant
• Manage the Knowledge Collection
  • Review Sync Logs
  • Perform a Full Crawl of the Knowledge Collection

AI Glossary

First we want to supply some definitions as these can be new concepts to a lot of users:

• Generative AI: A type of artificial intelligence that can create new content, such as text, images, or music, based on learning from large datasets of existing material.
• LLM (Large Language Model): An advanced computer program designed to understand and generate human-like text by analyzing vast amounts of written language.
• Prompt: A question or statement given to an AI or computer program, which it uses as a basis to generate a response or perform a task.
• Prompt Engineering: The art and practice of carefully crafting prompts to elicit the most effective and accurate responses from AI models.
• System Prompt or Meta Prompt: A higher-level instruction or query given to an AI system that often guides or structures the way the AI interprets and responds to subsequent user prompts.
• Grounding: The process of linking the AI's language understanding and responses to real-world knowledge, context, or specific data to ensure relevance and accuracy.
• Fine-Tuning: The process of making small adjustments to an AI model, especially a pre-trained one, to specialize its performance for a specific task or type of data.

Access the configuration settings

To access the configuration settings you will need to be part of either the Atlas ConneX Enterprise Administrators or Atlas AI Admins groups.

If you are a member of one of those groups, you can access the AI Assistant settings by opening the My Atlas panel and clicking on AI Assistant:

You will be presented with 2 options to configure for the assistant - the System prompt and the Request limits per user:

• We recommend caution when changing the System prompt since changes may cause the AI to respond in unexpected ways, but if you are confident with prompt engineering then this is where you can change it.
  • The token [Facts] found in the prompt refers to the Knowledge Collection(s) available for the AI for your organisation, so by default it can only answer questions about the provided information.
• The limit per user can be very important to control, as you are paying for the required processing in Azure to serve the user requests. This value is the number of requests per user per month. You will need to determine what is the best value here for your organisation based on how much users need to use the assistant.

Control who can use the AI Assistant

Administrators can control who can use the assistant by managing the group Atlas AI Users. This group can be found in your Azure Active Directory (Microsoft Entra ID).

Manage the Knowledge Collection

At this time, the assistant only works with a single Knowledge Collection. This is found under the Atlas Configuration workspace in the Global Knowledge Collection library. Due to this restriction you will currently need to copy or move documents or text files containing information into this library. In future releases we will allow multiple Knowledge Collections which can point to your existing workspaces.

Review Sync Logs

In the Atlas Configuration workspace you can access the Knowledge Collection Sync Logs list from the Site Contents. This will allow you to see the syncs (crawls) that have occurred, when they occurred, and who requested them, as well as any errors encountered during the sync. This includes both automatic syncs and user-requested syncs.

Perform a Full Sync of the Knowledge Collection

Please note that the below will change in Atlas 5.2 and crawls will be managed from the AI Assistant section of the My Atlas menu.

If the information you have added to your Knowledge Collection is not being used in responses and you can see that a sync has occurred since you made the change or addition, you may need to perform a Full Sync. This is not the same index as used by SharePoint Search, so we cannot simply reindex the library. Instead, from the Atlas Configuration workspace access the Global Knowledge Collection list you can click the ellipsis (...) in the library bar and choose Sync Knowledge Collection:

After clicking this you will see a confirmation - you need to check the box, then click Confirm to start the full sync:

Please note that performing syncs will incur some Azure processing costs, so this should not be done unless there is a problem with the existing data.