Commit graph

13528 commits

Author SHA1 Message Date
Krrish Dholakia
cd73ea245a test(test_lowest_latency_routing.py): use mock responses 2024-06-20 21:05:23 -07:00
Krrish Dholakia
e96326a211 docs(input.md): update docs with parallel_tool_calls 2024-06-20 21:01:49 -07:00
Krrish Dholakia
5ff74f90ad bump: version 1.40.19 → 1.40.20 2024-06-20 20:54:29 -07:00
Krish Dholakia
e7e7b0e265
Merge pull request #4328 from BerriAI/litellm_proxy_testing
test(test_python_38.py): add coverage for non-gen settings config.yaml flow
2024-06-20 20:46:46 -07:00
Krrish Dholakia
46da517cdf test(test_python_38.py): add longer delay 2024-06-20 20:42:32 -07:00
Krrish Dholakia
9b5aa90bb7 test(test_python_38.py): add relevant installs 2024-06-20 20:39:59 -07:00
Krish Dholakia
f86290584a
Merge pull request #4290 from BerriAI/litellm_specific_deployment
feat(router.py): allow user to call specific deployment via id
2024-06-20 20:36:13 -07:00
Krish Dholakia
790d7057cb
Merge pull request #4323 from BerriAI/litellm_fix_duration_in_s
fix(key_management_endpoints.py): use common _duration_in_seconds function
2024-06-20 20:35:59 -07:00
Krrish Dholakia
906f3698de fix(proxy_cli.py): fix tab error 2024-06-20 20:32:22 -07:00
Krrish Dholakia
40ca30813e test(test_python_38.py): add coverage for non-gen settings config.yaml flow
Adds testing for this https://github.com/BerriAI/litellm/issues/4324
2024-06-20 20:29:10 -07:00
Ishaan Jaff
aa3c14fa46 make sure linting runs proxy_cli.py 2024-06-20 20:20:08 -07:00
Ishaan Jaff
df8317774c ci/cd again 2024-06-20 20:07:33 -07:00
Ishaan Jaff
0810b5fcb4 ci/cd again 2024-06-20 20:06:52 -07:00
Ishaan Jaff
0f29207c48 test add flake8 check on cli.py 2024-06-20 20:05:32 -07:00
Krish Dholakia
c36a2cc262
Merge pull request #4325 from vanpelt/patch-3
Update proxy_cli.py
2024-06-20 19:33:08 -07:00
Chris Van Pelt
306c2b425d
Update proxy_cli.py
Fixed indentation to so we don't get an `UnboundLocalError`.  Fixes #4324
2024-06-20 17:48:16 -07:00
Krrish Dholakia
3feaf231ac docs(drop_params.md): drop unsupported params 2024-06-20 17:43:07 -07:00
Krish Dholakia
8ab29d7171
Merge pull request #4321 from BerriAI/litellm_fallbacks_assert_access
fix(user_api_key_auth.py): ensure user has access to fallback models
2024-06-20 17:26:12 -07:00
Krrish Dholakia
511c0dc4d7 fix(key_management_endpoints.py): use common _duration_in_seconds function 2024-06-20 17:02:31 -07:00
Krrish Dholakia
d3a3146155 fix(vertex_httpx.py): support setting custom api base for vertex ai calls
Closes https://github.com/BerriAI/litellm/issues/4317
2024-06-20 16:33:37 -07:00
Krrish Dholakia
5729eb5168 fix(user_api_key_auth.py): ensure user has access to fallback models
for client side fallbacks, checks if user has access to fallback models
2024-06-20 16:02:19 -07:00
Krrish Dholakia
14da2d5ade fix(_logging.py): fix timestamp format for json logs
Outputs timestamp in ISO 8601 format to work with fluentbit
2024-06-20 15:20:21 -07:00
Krrish Dholakia
248ee488f0 fix(proxy_cli.py): fix double counting json logs 2024-06-20 15:15:23 -07:00
Krish Dholakia
c8a40eca05
Merge pull request #4313 from BerriAI/litellm_drop_specific_params
fix(utils.py): allow dropping specific openai params
2024-06-20 15:15:19 -07:00
Ishaan Jaff
aa8f0637d1
Merge pull request #4318 from BerriAI/litellm_use_custom_routing_strat
[Feat] allow using custom router strategy
2024-06-20 15:11:51 -07:00
Ishaan Jaff
112c25217b
Merge pull request #4320 from BerriAI/docs_add_algolia_search
docs - add algolia search 🫡
2024-06-20 14:50:54 -07:00
Ishaan Jaff
648c20aef9 docs - add algolia search 2024-06-20 14:49:36 -07:00
Ishaan Jaff
cdc1e952ac router - add doc string 2024-06-20 14:36:51 -07:00
Ishaan Jaff
91d9d59717 docs - routing 2024-06-20 14:32:52 -07:00
Krrish Dholakia
db2cf5b5a5 build(model_prices_and_context_window.json): fixes https://github.com/BerriAI/litellm/issues/4305 2024-06-20 14:22:48 -07:00
Krrish Dholakia
473509aed3 build(model_prices_and_context_window.json): fix azure/gpt-35-turbo-1106 pricing 2024-06-20 14:17:49 -07:00
Krrish Dholakia
df3afa652f fix(proxy/utils.py): fix linting error 2024-06-20 14:13:38 -07:00
Ishaan Jaff
7fb4e12b9f test custom routing strat 2024-06-20 14:11:33 -07:00
Krrish Dholakia
8275c3d47f test(test_tpm_rpm_routing_v2.py): use mock endpoints for call 2024-06-20 14:09:45 -07:00
Ishaan Jaff
b6066d1ece feat - set custom routing strategy 2024-06-20 13:49:44 -07:00
Krrish Dholakia
5cb0c1ad70 fix(utils.py): add new error string to context window exception mapping 2024-06-20 12:01:11 -07:00
Krrish Dholakia
a0f08e0dad fix(utils.py): allow dropping specific openai params 2024-06-20 11:48:06 -07:00
Krrish Dholakia
d6eb986b8e fix(utils.py): add together ai exception mapping 2024-06-20 11:29:57 -07:00
Ishaan Jaff
3d90b25005
Merge pull request #4304 from williamjeong2/main
Fix model name for deepseek-coder in documentation
2024-06-20 10:59:23 -07:00
Krrish Dholakia
8766a58a16 test(test_alangfuse.py): fix race condition 2024-06-20 10:56:10 -07:00
Ishaan Jaff
713a6d4b32
Merge pull request #4308 from paul-gauthier/deepseek-coder-v2
Updated deepseek coder for v2, added openrouter version
2024-06-20 10:56:09 -07:00
Krrish Dholakia
9704e1cde0 test(test_alangfuse.py): fix test to flush in order 2024-06-20 10:22:15 -07:00
Ishaan Jaff
411eb38304
Merge pull request #4311 from BerriAI/litellm_add_claude-3-5-sonnet-20240620
Add `vertex_ai/claude-3-5-sonnet@20240620` and `bedrock/anthropic.claude-3-5-sonnet-20240620-v1:0`
2024-06-20 08:30:38 -07:00
Ishaan Jaff
579af0edae docs add bedrock sonnet 2024-06-20 08:27:35 -07:00
Ishaan Jaff
780e00b2a7 docs add claude-3-5-sonnet@20240620 vertex ai 2024-06-20 08:26:13 -07:00
Ishaan Jaff
3fcc2031aa add anthropic.claude-3-5-sonnet-20240620-v1:0 on vertex, bedrock 2024-06-20 08:24:04 -07:00
Ishaan Jaff
a1b0e7958d docs add claude-3 sonnet 3-5 2024-06-20 08:22:38 -07:00
Ishaan Jaff
7cfc143055
Merge pull request #4310 from lowjiansheng/js-add-anthropic-35
Add claude 3.5 sonnet model
2024-06-20 08:20:48 -07:00
lowjiansheng
683c379b68 add claude 35 sonnet 2024-06-20 23:11:51 +08:00
Paul Gauthier
59199a4362 Updated deepseek coder for v2, added openrouter version 2024-06-20 07:17:52 -07:00