phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 19:24:27 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
17241 commits 2490 branches 894 tags 548 MiB
Commit graph

27 commits

Author SHA1 Message Date
Krish Dholakia
11f85d883f LiteLLM Minor Fixes + Improvements (#5474) 
* feat(proxy/_types.py): add lago billing to callbacks ui

Closes https://github.com/BerriAI/litellm/issues/5472

* fix(anthropic.py): return anthropic prompt caching information

Fixes https://github.com/BerriAI/litellm/issues/5364

* feat(bedrock/chat.py): support 'json_schema' for bedrock models

Closes https://github.com/BerriAI/litellm/issues/5434

* fix(bedrock/embed/embeddings.py): support async embeddings for amazon titan models

* fix: linting fixes

* fix: handle key errors

* fix(bedrock/chat.py): fix bedrock ai21 streaming object

* feat(bedrock/embed): support bedrock embedding optional params

* fix(databricks.py): fix usage chunk

* fix(internal_user_endpoints.py): apply internal user defaults, if user role updated

Fixes issue where user update wouldn't apply defaults

* feat(slack_alerting.py): provide multiple slack channels for a given alert type

multiple channels might be interested in receiving an alert for a given type

* docs(alerting.md): add multiple channel alerting to docs
 2024-09-02 14:29:57 -07:00
Krish Dholakia
5f993f46a0 anthropic prompt caching cost tracking (#5453) 
* fix(utils.py): support 'drop_params' for embedding requests

Fixes https://github.com/BerriAI/litellm/issues/5444

* feat(anthropic/cost_calculation.py): Support calculating cost for prompt caching on anthropic

* feat(types/utils.py): allows us to migrate to openai's equivalent, once that comes out

* fix: fix linting errors

* test: mark flaky test
 2024-08-31 14:09:35 -07:00
Krrish Dholakia
425d8711b3 fix(utils.py): only filter additional properties if gemini/vertex ai 2024-08-23 14:22:59 -07:00
Krrish Dholakia
2a6aa6da7a fix(utils.py): handle additionalProperties is False for vertex ai / gemini calls 
Fixes https://github.com/BerriAI/litellm/issues/5338

Also adds together ai json mode support
 2024-08-23 09:21:32 -07:00
Krrish Dholakia
d87e8f5b30 feat(utils.py): support global vertex ai safety settings param 2024-08-21 17:37:50 -07:00
Krrish Dholakia
5c1a5978f9 fix(azure.py): fix optional param elif statement 2024-08-20 12:24:51 -07:00
Krrish Dholakia
3b49b32a24 test(test_optional_params.py): use num_retries instead of 'max_retries' if given 2024-08-09 17:02:29 -07:00
Krrish Dholakia
d382de7b74 fix(huggingface_restapi.py): fixes issue where 'wait_for_model' was not being passed as expected 2024-08-09 08:36:35 -07:00
Ishaan Jaff
222ab467b5 fix all optional param tests 2024-08-07 17:52:40 -07:00
Ishaan Jaff
476d0fc463 fix test_drop_params_parallel_tool_calls 2024-08-07 16:26:56 -07:00
Krrish Dholakia
bbc56f7202 fix(utils.py): parse out aws specific params from openai call 
Fixes https://github.com/BerriAI/litellm/issues/5009
 2024-08-03 12:04:44 -07:00
Krrish Dholakia
ce7257ec5e feat(vertex_ai_partner.py): initial working commit for calling vertex ai mistral 
Closes https://github.com/BerriAI/litellm/issues/4874
 2024-07-27 12:54:14 -07:00
Krrish Dholakia
23a3be184b build(model_prices_and_context_window.json): add model pricing for vertex ai llama 3.1 api 2024-07-23 17:36:07 -07:00
Krrish Dholakia
a00a1267bc fix(utils.py): support 'drop_params' for 'parallel_tool_calls' 
Closes https://github.com/BerriAI/litellm/issues/4584

 OpenAI-only param
 2024-07-08 07:36:41 -07:00
Krrish Dholakia
60b4249767 fix(utils.py): re-integrate separate gemini optional param mapping (google ai studio) 
Fixes https://github.com/BerriAI/litellm/issues/4333
 2024-06-21 09:01:32 -07:00
Krrish Dholakia
9dd5c9fdf9 fix(utils.py): allow dropping specific openai params 2024-06-20 11:48:06 -07:00
Krrish Dholakia
72a0fa7db5 feat(utils.py): support dynamically setting 'drop_params' 
Allows user to turn this on/off for individual calls by passing in as a completion arg
 2024-06-05 08:44:04 -07:00
Krrish Dholakia
23087295e1 fix(azure.py): support dropping 'tool_choice=required' for older azure API versions 
Closes https://github.com/BerriAI/litellm/issues/3876
 2024-06-01 18:44:50 -07:00
Krrish Dholakia
915e599772 fix(openai.py): only allow 'user' as optional param if openai model 2024-05-29 15:15:02 -07:00
Krrish Dholakia
e3c5e004c5 feat(databricks.py): add embedding model support 2024-05-23 18:22:03 -07:00
Krrish Dholakia
b45b3890ff test(test_optional_params.py): fix optional params 2024-05-10 14:08:47 -07:00
Krrish Dholakia
cfb6df4987 fix(main.py): support new 'supports_system_message=False' param 
Fixes https://github.com/BerriAI/litellm/issues/3325
 2024-05-03 21:31:45 -07:00
Krrish Dholakia
4efaacc5ce fix(anthropic.py): handle whitespace characters for anthropic calls 2024-05-03 17:31:34 -07:00
ishaan-jaff
de8283dac4 (feat) support extra_headers 2024-02-23 08:48:21 -08:00
ishaan-jaff
14788e3648 (test) get optional_params Azure 2024-01-13 14:32:41 -08:00
Krrish Dholakia
79978c44ba refactor: add black formatting 2023-12-25 14:11:20 +05:30
Krrish Dholakia
e3ec848c10 test(test_optional_params.py): unit tests for get_optional_params_embeddings() 2023-12-14 14:32:36 -08:00