Post

LiteLLM

LLM proxy to call 100+ LLMs in a unified interface & track spend, set budgets per virtual key/user

LiteLLM

Installation

Default install:

1
bash -c "$(curl -fsSL https://raw.githubusercontent.com/community-scripts/ProxmoxVE/main/ct/litellm.sh)"
CPU: 2 cores RAM: 2048 MB Disk: 4 GB OS: Debian 13

Default Credentials

UsernamePassword
adminsk-1234

Configuration

Config file:

1
/opt/litellm/litellm.yaml

Notes

Update master key in the config file

Web Interface

Port: 4000

Source code
Loading...