litellm-mirror/litellm/llms
Krish Dholakia 72e961af3c
LiteLLM Minor Fixes and Improvements (08/06/2024) (#5567)
* fix(utils.py): return citations for perplexity streaming

Fixes https://github.com/BerriAI/litellm/issues/5535

* fix(anthropic/chat.py): support fallbacks for anthropic streaming (#5542)

* fix(anthropic/chat.py): support fallbacks for anthropic streaming

Fixes https://github.com/BerriAI/litellm/issues/5512

* fix(anthropic/chat.py): use module level http client if none given (prevents early client closure)

* fix: fix linting errors

* fix(http_handler.py): fix raise_for_status error handling

* test: retry flaky test

* fix otel type

* fix(bedrock/embed): fix error raising

* test(test_openai_batches_and_files.py): skip azure batches test (for now) quota exceeded

* fix(test_router.py): skip azure batch route test (for now) - hit batch quota limits

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>

* All `model_group_alias` should show up in `/models`, `/model/info` , `/model_group/info` (#5539)

* fix(router.py): support returning model_alias model names in `/v1/models`

* fix(proxy_server.py): support returning model alias'es on `/model/info`

* feat(router.py): support returning model group alias for `/model_group/info`

* fix(proxy_server.py): fix linting errors

* fix(proxy_server.py): fix linting errors

* build(model_prices_and_context_window.json): add amazon titan text premier pricing information

Closes https://github.com/BerriAI/litellm/issues/5560

* feat(litellm_logging.py): log standard logging response object for pass through endpoints. Allows bedrock /invoke agent calls to be correctly logged to langfuse + s3

* fix(success_handler.py): fix linting error

* fix(success_handler.py): fix linting errors

* fix(team_endpoints.py): Allows admin to update team member budgets

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
2024-09-06 17:16:24 -07:00
..
AI21 add all ai21 params 2024-09-02 11:54:40 -07:00
anthropic LiteLLM Minor Fixes and Improvements (08/06/2024) (#5567) 2024-09-06 17:16:24 -07:00
AzureOpenAI LiteLLM Minor Fixes and Improvements (#5537) 2024-09-05 18:21:42 -07:00
bedrock LiteLLM Minor Fixes and Improvements (08/06/2024) (#5567) 2024-09-06 17:16:24 -07:00
cerebras add cerebras config 2024-08-31 08:34:46 -07:00
cohere Bedrock Embeddings refactor + model support (#5462) 2024-09-01 13:29:58 -07:00
custom_httpx LiteLLM Minor Fixes and Improvements (08/06/2024) (#5567) 2024-09-06 17:16:24 -07:00
files_apis feat(batches): add azure openai batches endpoint support 2024-08-22 14:46:51 -07:00
fine_tuning_apis fix: initial commit 2024-08-27 17:35:56 -07:00
huggingface_llms_metadata add hf tgi and conversational models 2023-09-27 15:56:45 -07:00
OpenAI fix import 2024-09-05 14:42:56 -07:00
prompt_templates LiteLLM Minor fixes + improvements (08/04/2024) (#5505) 2024-09-04 22:16:55 -07:00
sagemaker fix(bedrock_httpx.py): support 'Auth' header as extra_header 2024-08-27 16:08:54 -07:00
togetherai fix install on 3.8 2024-08-27 17:09:16 -07:00
tokenizers feat(utils.py): bump tiktoken dependency to 0.7.0 2024-06-10 21:21:23 -07:00
vertex_ai_and_google_ai_studio LiteLLM Minor Fixes and Improvements (#5537) 2024-09-05 18:21:42 -07:00
__init__.py add linting 2023-08-18 11:05:05 -07:00
aleph_alpha.py fix: move to using pydantic obj for setting values 2024-07-11 13:18:36 -07:00
azure_text.py use correct type hints for audio transcriptions 2024-09-05 09:12:27 -07:00
base.py anthropic prompt caching cost tracking (#5453) 2024-08-31 14:50:12 -07:00
base_aws_llm.py LiteLLM Minor fixes + improvements (08/04/2024) (#5505) 2024-09-04 22:16:55 -07:00
baseten.py fix: move to using pydantic obj for setting values 2024-07-11 13:18:36 -07:00
clarifai.py Clarifai : Fixed model name 2024-08-07 16:59:33 +00:00
cloudflare.py fix: move to using pydantic obj for setting values 2024-07-11 13:18:36 -07:00
custom_llm.py fix(custom_llm.py): pass input params to custom llm 2024-07-25 19:03:52 -07:00
databricks.py LiteLLM Minor Fixes + Improvements (#5474) 2024-09-02 14:29:57 -07:00
fireworks_ai.py fix + test fireworks ai param mapping for tools 2024-06-26 06:57:04 -07:00
gemini.py refactor: replace .error() with .exception() logging for better debugging on sentry 2024-08-16 09:22:47 -07:00
huggingface_restapi.py fix(huggingface_restapi.py): fix tests 2024-08-23 21:40:27 -07:00
maritalk.py fix: move to using pydantic obj for setting values 2024-07-11 13:18:36 -07:00
nlp_cloud.py fix: move to using pydantic obj for setting values 2024-07-11 13:18:36 -07:00
nvidia_nim.py fix nvidia nim param mapping 2024-07-05 14:44:12 -07:00
ollama.py LiteLLM Minor fixes + improvements (08/04/2024) (#5505) 2024-09-04 22:16:55 -07:00
ollama_chat.py LiteLLM Minor fixes + improvements (08/04/2024) (#5505) 2024-09-04 22:16:55 -07:00
oobabooga.py fix: move to using pydantic obj for setting values 2024-07-11 13:18:36 -07:00
openrouter.py refactor: add black formatting 2023-12-25 14:11:20 +05:30
palm.py LiteLLM Minor fixes + improvements (08/04/2024) (#5505) 2024-09-04 22:16:55 -07:00
petals.py fix: move to using pydantic obj for setting values 2024-07-11 13:18:36 -07:00
predibase.py LiteLLM Minor fixes + improvements (08/04/2024) (#5505) 2024-09-04 22:16:55 -07:00
replicate.py fix: now supports single tokens prediction 2024-07-25 19:06:07 +02:00
text_completion_codestral.py LiteLLM Minor fixes + improvements (08/04/2024) (#5505) 2024-09-04 22:16:55 -07:00
together_ai.py fix: fix linting errors 2024-07-11 13:36:55 -07:00
triton.py Fix not sended json_data_for_triton 2024-08-14 09:57:48 +07:00
vllm.py fix: move to using pydantic obj for setting values 2024-07-11 13:18:36 -07:00
volcengine.py add initial support for volcengine 2024-06-26 16:53:44 -07:00
watsonx.py fix: move to using pydantic obj for setting values 2024-07-11 13:18:36 -07:00