Updates: Copilot Rewrite: Management Console
➡️ Exact delivery dates may vary, and brands may therefore not have immediate access to all features on the date of publication. Please contact your LivePerson account team for the exact dates on which you will have access to the features.
🚨The timing and scope of these features or functionalities remain at the sole discretion of LivePerson and are subject to change.
Generative AI - Onboard and manage your own LLM
If you’ve invested in your own LLM from one of the following providers — Amazon, Anthropic, Cohere, Google, IBM, Microsoft or OpenAI — you can use it to power the Generative AI features in your Conversational Cloud solution. This lets you align the solution with your brand’s overall LLM strategy.
LivePerson now offers a self-service UI for onboarding and managing use of your own LLM in your Conversational AI solution. Use the new LLM Management page in the Management Console to:
- Add an LLM subscription: Add as many subscriptions as you require.
No credentials beyond what the LLM provider requires are needed.
- Change the default models: You can customize which LLMs are used by default in prompts in the Prompt Library. Prompt engineers remain free to select a different model (from the list of models that you’ve specified as allowed).
- Disable or enable a subscription: As you’re testing models, you might want to hide certain models from users who are creating prompts in LivePerson’s Prompt Library. Disabling a subscription hides the subscription (and, by extension, its associated models) from users, so they can’t select it for use in a prompt. You can disable and re-enable a subscription at any time.
- Delete a subscription: Delete a subscription that you no longer have use for. Once the subscription is deleted, prompts that use the associated models are automatically switched to use a default model. This ensures the prompts continue to work.
Early Access release
The LLM Management page is in Early Access release for experimentation. As always, test thoroughly before incorporating into your Production solution.
Getting started
- Activate our Generative AI features. Think of this as a broadly applied LivePerson Generative AI switch that must be turned on.
- Contact your LivePerson representative to request enablement. We’ll flip the back-end switch that needs to be turned on.
- Verify that you have the proper access permissions:
- Conversation Builder: Administrator
- Conversation Builder: Bot Builder
Ensure these permissions are added to your assigned user profile (via Manage > Users & Skills).
Keep in mind that, depending on the Generative AI feature you’re using (KnowledgeAI™ agents, Routing AI agents, automated conversation summaries, etc.), you might or might not need to take additional steps to activate the specific Generative AI feature too. To learn more, refer to the documentation on the given feature.