Tags

Local LLMs and ChatGPT on One Endpoint with LiteLLM

Using LiteLLM Proxy to unify Lemonade (AMD ROCm llama.cpp) and a ChatGPT subscription behind a single OpenAI-compatible API in my homelab.