Post

LiteLLM

LLM proxy to call 100+ LLMs in a unified interface & track spend, set budgets per virtual key/user

LiteLLM

Installation

Default install:

1
bash -c "$(wget -qLO - https://github.com/community-scripts/ProxmoxVE/raw/main/ct/litellm.sh)"
CPU: 2 cores RAM: 2048 MB Disk: 4 GB OS: Debian 13

Default Credentials

UsernamePassword
adminsk-1234

Configuration

Config file:

1
/opt/litellm/litellm.yaml

Notes

Update master key in the config file

Web Interface

Port: 4000

This post is licensed under CC BY 4.0 by the author.