Module Details | |
| Core or GitHub Module | Core |
| Restart Required | No |
| Step Location | AI > LiteLLM |
| Settings Location | Settings > LiteLLM Settings |
| Prerequisites |
|
The LiteLLM Module enables Users to connect to a self-hosted LiteLLM proxy and access models from 100+ providers through a single configuration. This module gives Users one place to manage provider credentials, track spend, and enables the switching of models without reconfiguring Decisions.
Once prerequisites are installed, the Module automatically exposes Chat Completion and Create Embeddings steps in the toolbox.
Note for Third-Party Systems and Subscriptions
Customers are responsible for securing and maintaining accounts with third-party systems and subscriptions.
Configuration/Properties
Installation
- To set up the Module in Decisions, navigate to Settings > Administration > Features, locate the LiteLLM Module, and select Install.
- The AI Common Module will automatically install in the background if this is the first AI Module installed in the environment.
Creating a Dependency:
- After installing the module, navigate to the project that will utilize Google Gemini.
- Then, within the Project, navigate to Manage > Configuration > Dependencies.
- Select Manage, navigate to Modules, and select Decisions.AI.GoogleGemini.
- Select Confirm to save the change.
For more information on installing Modules, please visit Installing Modules in Decisions.
For more information about creating a project dependency for a Module, please visit Adding Modules as a Project Dependency
Available Steps
The table below provides a list of all the steps within the module.
| Step Name | Description |
|---|---|
| Chat Completion | The Chat Completion step enables prompts to be submitted to a large language model(LLM) and will return the response the LLM gives back. Prompts can be added directly or pulled from the Flow. Users can also select the model they want to review the prompt. |
| Create Embeddings | The Create Embeddings step allows Users to generate text embeddings. |
Feature Changes
| Description | Version | Release Date | Developer Task |
|---|---|---|---|
| Added support for the LiteLLM module, which allows Users to connect to a self-hosted LiteLLM proxy and access models from 100+ providers through a single configuration. Chat Completion, Embeddings, and Get Model List steps are included in the Module. | 9.31 | September 2026 | [DT-048370] |