Krish Dholakia
aa9f1896c6
anthropic prompt caching cost tracking ( #5453 )
...
* fix(utils.py): support 'drop_params' for embedding requests
Fixes https://github.com/BerriAI/litellm/issues/5444
* feat(anthropic/cost_calculation.py): Support calculating cost for prompt caching on anthropic
* feat(types/utils.py): allows us to migrate to openai's equivalent, once that comes out
* fix: fix linting errors
* test: mark flaky test
2024-08-31 14:50:12 -07:00
Krrish Dholakia
425d8711b3
fix(utils.py): only filter additional properties if gemini/vertex ai
2024-08-23 14:22:59 -07:00
Krrish Dholakia
2a6aa6da7a
fix(utils.py): handle additionalProperties is False for vertex ai / gemini calls
...
Fixes https://github.com/BerriAI/litellm/issues/5338
Also adds together ai json mode support
2024-08-23 09:21:32 -07:00
Krrish Dholakia
d87e8f5b30
feat(utils.py): support global vertex ai safety settings param
2024-08-21 17:37:50 -07:00
Krrish Dholakia
5c1a5978f9
fix(azure.py): fix optional param elif statement
2024-08-20 12:24:51 -07:00
Krrish Dholakia
3b49b32a24
test(test_optional_params.py): use num_retries instead of 'max_retries' if given
2024-08-09 17:02:29 -07:00
Krrish Dholakia
d382de7b74
fix(huggingface_restapi.py): fixes issue where 'wait_for_model' was not being passed as expected
2024-08-09 08:36:35 -07:00
Ishaan Jaff
222ab467b5
fix all optional param tests
2024-08-07 17:52:40 -07:00
Ishaan Jaff
476d0fc463
fix test_drop_params_parallel_tool_calls
2024-08-07 16:26:56 -07:00
Krrish Dholakia
bbc56f7202
fix(utils.py): parse out aws specific params from openai call
...
Fixes https://github.com/BerriAI/litellm/issues/5009
2024-08-03 12:04:44 -07:00
Krrish Dholakia
ce7257ec5e
feat(vertex_ai_partner.py): initial working commit for calling vertex ai mistral
...
Closes https://github.com/BerriAI/litellm/issues/4874
2024-07-27 12:54:14 -07:00
Krrish Dholakia
23a3be184b
build(model_prices_and_context_window.json): add model pricing for vertex ai llama 3.1 api
2024-07-23 17:36:07 -07:00
Krrish Dholakia
a00a1267bc
fix(utils.py): support 'drop_params' for 'parallel_tool_calls'
...
Closes https://github.com/BerriAI/litellm/issues/4584
OpenAI-only param
2024-07-08 07:36:41 -07:00
Krrish Dholakia
60b4249767
fix(utils.py): re-integrate separate gemini optional param mapping (google ai studio)
...
Fixes https://github.com/BerriAI/litellm/issues/4333
2024-06-21 09:01:32 -07:00
Krrish Dholakia
9dd5c9fdf9
fix(utils.py): allow dropping specific openai params
2024-06-20 11:48:06 -07:00
Krrish Dholakia
72a0fa7db5
feat(utils.py): support dynamically setting 'drop_params'
...
Allows user to turn this on/off for individual calls by passing in as a completion arg
2024-06-05 08:44:04 -07:00
Krrish Dholakia
23087295e1
fix(azure.py): support dropping 'tool_choice=required' for older azure API versions
...
Closes https://github.com/BerriAI/litellm/issues/3876
2024-06-01 18:44:50 -07:00
Krrish Dholakia
915e599772
fix(openai.py): only allow 'user' as optional param if openai model
2024-05-29 15:15:02 -07:00
Krrish Dholakia
e3c5e004c5
feat(databricks.py): add embedding model support
2024-05-23 18:22:03 -07:00
Krrish Dholakia
b45b3890ff
test(test_optional_params.py): fix optional params
2024-05-10 14:08:47 -07:00
Krrish Dholakia
cfb6df4987
fix(main.py): support new 'supports_system_message=False' param
...
Fixes https://github.com/BerriAI/litellm/issues/3325
2024-05-03 21:31:45 -07:00
Krrish Dholakia
4efaacc5ce
fix(anthropic.py): handle whitespace characters for anthropic calls
2024-05-03 17:31:34 -07:00
ishaan-jaff
de8283dac4
(feat) support extra_headers
2024-02-23 08:48:21 -08:00
ishaan-jaff
14788e3648
(test) get optional_params Azure
2024-01-13 14:32:41 -08:00
Krrish Dholakia
79978c44ba
refactor: add black formatting
2023-12-25 14:11:20 +05:30
Krrish Dholakia
e3ec848c10
test(test_optional_params.py): unit tests for get_optional_params_embeddings()
2023-12-14 14:32:36 -08:00
