litellm-mirror/litellm/llms
Krish Dholakia be3c7b401e
LiteLLM Minor fixes + improvements (08/03/2024) (#5488)
* fix(internal_user_endpoints.py): set budget_reset_at for /user/update

* fix(vertex_and_google_ai_studio_gemini.py): handle accumulated json

Fixes https://github.com/BerriAI/litellm/issues/5479

* fix(vertex_ai_and_gemini.py): fix assistant message function call when content is not None

Fixes https://github.com/BerriAI/litellm/issues/5490

* fix(proxy_server.py): generic state uuid for okta sso

* fix(lago.py): improve debug logs

Debugging for https://github.com/BerriAI/litellm/issues/5477

* docs(bedrock.md): add bedrock cross-region inferencing to docs

* fix(azure.py): return azure response headers on aembedding call

* feat(azure.py): return azure response headers for `/audio/transcription`

* fix(types/utils.py): standardize deepseek / anthropic prompt caching usage information

Closes https://github.com/BerriAI/litellm/issues/5285

* docs(usage.md): add docs on litellm usage object

* test(test_completion.py): mark flaky test
2024-09-03 21:21:34 -07:00
..
AI21 add all ai21 params 2024-09-02 11:54:40 -07:00
anthropic LiteLLM Minor Fixes + Improvements (#5474) 2024-09-02 14:29:57 -07:00
bedrock refactor get_secret 2024-09-03 10:42:12 -07:00
cerebras add cerebras config 2024-08-31 08:34:46 -07:00
cohere Bedrock Embeddings refactor + model support (#5462) 2024-09-01 13:29:58 -07:00
custom_httpx Merge pull request #5292 from OgnjenFrancuski/main 2024-08-23 20:42:35 -07:00
files_apis feat(batches): add azure openai batches endpoint support 2024-08-22 14:46:51 -07:00
fine_tuning_apis fix: initial commit 2024-08-27 17:35:56 -07:00
huggingface_llms_metadata add hf tgi and conversational models 2023-09-27 15:56:45 -07:00
prompt_templates Minor LiteLLM Fixes and Improvements (#5456) 2024-08-31 17:58:10 -07:00
sagemaker fix(bedrock_httpx.py): support 'Auth' header as extra_header 2024-08-27 16:08:54 -07:00
togetherai fix install on 3.8 2024-08-27 17:09:16 -07:00
tokenizers feat(utils.py): bump tiktoken dependency to 0.7.0 2024-06-10 21:21:23 -07:00
vertex_ai_and_google_ai_studio LiteLLM Minor fixes + improvements (08/03/2024) (#5488) 2024-09-03 21:21:34 -07:00
__init__.py add linting 2023-08-18 11:05:05 -07:00
aleph_alpha.py fix: move to using pydantic obj for setting values 2024-07-11 13:18:36 -07:00
azure.py LiteLLM Minor fixes + improvements (08/03/2024) (#5488) 2024-09-03 21:21:34 -07:00
azure_text.py fix(azure_text.py): fix streaming parsing 2024-08-27 15:52:55 -07:00
base.py anthropic prompt caching cost tracking (#5453) 2024-08-31 14:50:12 -07:00
base_aws_llm.py refactor get_secret 2024-09-03 10:42:12 -07:00
baseten.py fix: move to using pydantic obj for setting values 2024-07-11 13:18:36 -07:00
clarifai.py Clarifai : Fixed model name 2024-08-07 16:59:33 +00:00
cloudflare.py fix: move to using pydantic obj for setting values 2024-07-11 13:18:36 -07:00
custom_llm.py fix(custom_llm.py): pass input params to custom llm 2024-07-25 19:03:52 -07:00
databricks.py LiteLLM Minor Fixes + Improvements (#5474) 2024-09-02 14:29:57 -07:00
fireworks_ai.py fix + test fireworks ai param mapping for tools 2024-06-26 06:57:04 -07:00
gemini.py refactor: replace .error() with .exception() logging for better debugging on sentry 2024-08-16 09:22:47 -07:00
huggingface_restapi.py fix(huggingface_restapi.py): fix tests 2024-08-23 21:40:27 -07:00
maritalk.py fix: move to using pydantic obj for setting values 2024-07-11 13:18:36 -07:00
nlp_cloud.py fix: move to using pydantic obj for setting values 2024-07-11 13:18:36 -07:00
nvidia_nim.py fix nvidia nim param mapping 2024-07-05 14:44:12 -07:00
ollama.py feat(ollama.py): support ollama /api/embed endpoint 2024-08-20 09:10:08 -07:00
ollama_chat.py fix(ollama_chat.py): fix passing assistant message with tool call param 2024-08-22 10:00:03 -07:00
oobabooga.py fix: move to using pydantic obj for setting values 2024-07-11 13:18:36 -07:00
openai.py fix(openai.py): fix error re-raising 2024-08-27 17:06:25 -07:00
openrouter.py refactor: add black formatting 2023-12-25 14:11:20 +05:30
palm.py refactor: replace .error() with .exception() logging for better debugging on sentry 2024-08-16 09:22:47 -07:00
petals.py fix: move to using pydantic obj for setting values 2024-07-11 13:18:36 -07:00
predibase.py refactor: replace .error() with .exception() logging for better debugging on sentry 2024-08-16 09:22:47 -07:00
replicate.py fix: now supports single tokens prediction 2024-07-25 19:06:07 +02:00
text_completion_codestral.py fix test codestral api 2024-08-20 08:45:44 -07:00
together_ai.py fix: fix linting errors 2024-07-11 13:36:55 -07:00
triton.py Fix not sended json_data_for_triton 2024-08-14 09:57:48 +07:00
vllm.py fix: move to using pydantic obj for setting values 2024-07-11 13:18:36 -07:00
volcengine.py add initial support for volcengine 2024-06-26 16:53:44 -07:00
watsonx.py fix: move to using pydantic obj for setting values 2024-07-11 13:18:36 -07:00