phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-25 10:44:24 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

fix(main.py): misrouting ollama models to nlp cloud

Browse source
This commit is contained in:
Krrish Dholakia 2023-11-14 18:55:01 -08:00
parent 465f427465
commit 1738341dcb
5 changed files with 94 additions and 47 deletions
Download patch file Download diff file Expand all files Collapse all files

1
litellm/proxy/proxy_cli.py
View file

@ -113,7 +113,6 @@ def run_server(host, port, api_base, api_version, model, alias, add_key, headers
print("\033[1;32mDone successfully\033[0m")
return
if model and "ollama" in model:
print(f"ollama called")
run_ollama_serve()
if test != False:
click.echo('\nLiteLLM: Making a test ChatCompletions request to your proxy')