Skip to main content

Setup

If your LiteLLM deployment is hosted on a private or corporate network, make sure you’re connected to your company’s VPN before proceeding.
Make sure you are on the latest version of Firebender (1.0.3) for the best LiteLLM integration experience.
  1. Go to firebender.com/settings?tab=provider
  2. Ensure the org LiteLLM API key and base URL are configured. If not, ask your LiteLLM admin or whoever manages your LiteLLM deployment.
  1. Add your own LiteLLM virtual key provided by your admin.
  1. Open Models in Firebender Settings and click Model Sync.
  1. Firebender should now pull in your LiteLLM models, and you can select them from the model selector in chat.