Litellm ollama refactor (#7162)

* refactor(ollama/): refactor ollama `/api/generate` to use base llm config

Addresses https://github.com/andrewyng/aisuite/issues/113#issuecomment-2512369132

* test: skip unresponsive test

* test(test_secret_manager.py): mark flaky test

* test: fix google sm test

* fix: fix init.py
This commit is contained in:
Krish Dholakia 2024-12-10 21:45:35 -08:00 committed by GitHub
parent 6c6834dde7
commit e9fbefca5d
11 changed files with 322 additions and 235 deletions

View file

@ -78,7 +78,7 @@ def test_get_model_info_gemini_pro():
def test_get_model_info_ollama_chat():
from litellm.llms.ollama import OllamaConfig
from litellm.llms.ollama.completion.transformation import OllamaConfig
with patch.object(
litellm.module_level_client,