Using AI with Vizlib Extensions

The following Vizlib extensions use artificial intelligence (AI) to analyze your data and provide valuable insights:

• Vizlib Hi
• Vizlib Teamwork (with Vizlib Hi component)
• Chart Summarizer

Vizlib Hi and Vizlib Teamwork extensions support both -based Large Language Model (LLM), called Lineos AI and third-party LLMs.

By default, all AI-friendly Vizlib extensions use an insightsoftware-based solution - Lineos AI - to analyze your data. Lineos AI uses custom system prompts that can't be edited.

To improve your experience with using AI for Vizlib products, has introduced the support for third-party LLMs. Using third-party LLMs enables you to decide which LLM you want to use with Vizlib. You can additionally customize the prompts.

Configure Third-Party LLMs for Vizlib Extensions in VMC

Before you start, make sure that the following conditions are fulfilled:

• You have Vizlib Server installed. For more information on Vizlib Server installation, see Installation Prerequisites (Enterprise Only) and Installation (Enterprise Only).

• Your Vizlib Server license key is up-to-date. You can find an up-to-date license key in Vizlib Portal > Products > Vizlib Server.

• The Allowed AI Features property in Vizlib Portal > Accounts > Settings is set to All or Only 3rd party LLMs.

• You established the Server connection with extensions for which you want to configure third-party LLMs. You can verify it on your Vizlib Management Console (VMC) Dashboard.

  Figure 1: Extensions with Server connection

  

• You have Enabled CORS in VMC > System Settings > Security > CORS options.

Add an AI Profile in VMC

If you want to use third-party LLMs, you need to configure an AI profile.

1. Navigate to VMC > AI > AI Profiles and click the Add AI Profile button. The software opens the Edit AI Profile modal.

2. In the AI Profile Name, define the name of the profile.
3. In AI Provider settings define the following properties depending on the selected provider:
   • Azure OpenAI: Endpoint URL, API Version, Model, API Key
   • Open AI and Open AI Compatible: Endpoint URL, Model, API Key
4. (Optional) Enable custom System Prompt. Insert or type your prompt in the text field. If disabled, the system uses a default prompt for a given query type.
5. (Optional) Define the following LLM Settings:
   • Temperature
   • Max Tokens
   • Presence Penalty
   • Frequency Penalty

6. In the Access and Security decide who can access the AI Profile.

7. Once all required fields are configured, Test Connection.
8. If the connection test is successful, click Add AI Profile.

You have created and added AI Profile. The profile is listed in VMC > AI > AI Profiles. The data in your extensions will be run through third-party LLMs.

Add a Stream to Connect with AI in VMC

After adding an AI Profile, add a new stream to connect with the created AI profile. You can connect the stream to the AI profile in VMC > AI > Vizlib Hi or Chart Summarizer.

1. Vizlib Hi: Click the Add Vizlib Hi Stream button.

   Chart Summarizer: Click the Add Chart Summarizer Stream button.

2. Insert a stream Name and select an AI Profile.
3. Define the access level by selecting Secure Stream or Public.
4. (Optional) If you selected Secure Stream, navigate to Security Rules and configure rules for relevant resource types.
5. Click Add Stream.

You have added and connected the stream with your configured AI profile.

Now, you need to set-up third-party LLMs in the extension's property panel. For more information, see Configure Vizlib Hi.

Limitations

• Vizlib Teamwork: the third party LLMs support is available only in the offline version of the extension.