Commit graph

8681 commits

Author SHA1 Message Date
Krrish Dholakia
82c53d7e2f test(anthropic.py): more logging for test 2024-03-12 19:07:52 -07:00
Krish Dholakia
df5d9a78b8
Merge pull request #2483 from BerriAI/litellm_proxy_perf
fix(proxy_server.py): cache master key check
2024-03-12 19:01:46 -07:00
ishaan-jaff
786df1d574 (fix) locust load test 2024-03-12 18:52:49 -07:00
ishaan-jaff
8bfb00cdab (fix) default langfuse setting 2024-03-12 17:42:31 -07:00
Krrish Dholakia
39f9bfad80 fix(proxy_server.py): cache master key check 2024-03-12 15:15:33 -07:00
ishaan-jaff
b9bfc7c36c (fix) use cohere_chat optional params 2024-03-12 14:31:43 -07:00
ishaan-jaff
5b0b251d42 (feat) support tool_calling on cohere command-r 2024-03-12 14:24:48 -07:00
ishaan-jaff
2dbc95653e (feat) cohere tool calling 2024-03-12 13:19:17 -07:00
Krish Dholakia
0d18f3c0ca
Merge pull request #2473 from BerriAI/litellm_fix_compatible_provider_model_name
fix(openai.py): return model name with custom llm provider for openai-compatible endpoints (e.g. mistral, together ai, etc.)
2024-03-12 12:58:29 -07:00
Krish Dholakia
1ba102c618
Merge pull request #2475 from BerriAI/litellm_azure_dall_e_3_cost_tracking
fix(azure.py): support cost tracking for azure/dall-e-3
2024-03-12 12:57:31 -07:00
Krrish Dholakia
e342ecd873 test: set verbose for test 2024-03-12 12:56:38 -07:00
ishaan-jaff
a18c941621 (fix) failing cohere test 2024-03-12 12:44:19 -07:00
ishaan-jaff
d136238f6f (v0) tool calling 2024-03-12 12:35:52 -07:00
Ishaan Jaff
b2d5f775ca
Merge pull request #2478 from BerriAI/litellm_fix_dynamo_team_alias
(fix) patch dynamoDB team_model_alias bug
2024-03-12 12:34:53 -07:00
ishaan-jaff
6f069d26f3 (fix) patch dynamoDB tea_model_alias bug 2024-03-12 11:17:12 -07:00
Krrish Dholakia
d07c813ef9 test: add more logging for failing test 2024-03-12 11:15:14 -07:00
Ishaan Jaff
5172fb1de9
Merge pull request #2474 from BerriAI/litellm_support_command_r
[New-Model] Cohere/command-r
2024-03-12 11:11:56 -07:00
Krrish Dholakia
5d12236457 bump: version 1.31.3 → 1.31.4 2024-03-12 11:07:45 -07:00
Krrish Dholakia
d2286fb93c fix(main.py): trigger new build 2024-03-12 11:07:14 -07:00
Krrish Dholakia
fd4086d5da fix(proxy_server.py): fix /user/info for non-existent user id 2024-03-12 11:05:41 -07:00
Krrish Dholakia
7dd94c802e fix(azure.py): support cost tracking for azure/dall-e-3 2024-03-12 10:55:54 -07:00
ishaan-jaff
777cf094e5 (feat) use model json to get cohere_models 2024-03-12 10:53:26 -07:00
ishaan-jaff
aa8b5e9768 (feat) add cohere_chat to model_prices 2024-03-12 10:51:33 -07:00
ishaan-jaff
e5bb65669d (feat) exception mapping for cohere_chat 2024-03-12 10:45:42 -07:00
ishaan-jaff
8fabaed543 (docs) cohere-comand-r 2024-03-12 10:34:08 -07:00
ishaan-jaff
f50539ace9 (test) command_r 2024-03-12 10:30:33 -07:00
Krrish Dholakia
0033613b9e fix(openai.py): return model name with custom llm provider for openai compatible endpoints 2024-03-12 10:30:10 -07:00
ishaan-jaff
7635c764cf (feat) cohere_chat provider 2024-03-12 10:29:26 -07:00
Ishaan Jaff
01921aeb5a
Merge pull request #2471 from BerriAI/litellm_azure_instruct
(feat) support azure/gpt-instruct models
2024-03-12 10:27:24 -07:00
ishaan-jaff
042a71cdc7 (feat) v0 support command-r 2024-03-12 10:26:58 -07:00
Krrish Dholakia
84c7a5b693 fix(anthropic.py): fix linting errors 2024-03-12 10:23:56 -07:00
Krrish Dholakia
f00c489c1b fix(anthropic.py): fix streaming 2024-03-12 09:56:26 -07:00
ishaan-jaff
ea83c8c9b0 (docs) using azure_text models 2024-03-12 09:54:34 -07:00
Krrish Dholakia
86ed0aaba8 fix(anthropic.py): support streaming with function calling 2024-03-12 09:52:11 -07:00
ishaan-jaff
223ac464d7 (fix) support streaming for azure/instruct models 2024-03-12 09:50:43 -07:00
ishaan-jaff
b193b01f40 (feat) support azure/gpt-instruct models 2024-03-12 09:30:15 -07:00
Tyler Brandt
a8f95beb9a fix: add dependency for google-cloud-aiplatform 2024-03-12 09:24:59 -07:00
Krrish Dholakia
10f5f342bd docs(virtual_keys.md): cleanup doc 2024-03-12 07:05:55 -07:00
Krrish Dholakia
47424b8c90 docs(routing.md): fix routing example on docs 2024-03-11 22:17:04 -07:00
Ishaan Jaff
477056339b
Merge pull request #2465 from BerriAI/litellm_router_docs
(docs) using litellm router
2024-03-11 21:18:38 -07:00
ishaan-jaff
e46980c56c (docs) using litellm router 2024-03-11 21:18:10 -07:00
ishaan-jaff
824b8b1b62 bump: version 1.31.2 → 1.31.3 2024-03-11 21:02:56 -07:00
Ishaan Jaff
1c28b8ee2d
Merge pull request #2462 from BerriAI/litellm_imp_mem_use
[Litellm-Proxy, Router] improve memory usage - don't store messages in memory, previous models in memory
2024-03-11 19:04:25 -07:00
Ishaan Jaff
cd8f25f6f8
Merge branch 'main' into litellm_imp_mem_use 2024-03-11 19:00:56 -07:00
Ishaan Jaff
881063c424
Merge pull request #2461 from BerriAI/litellm_improve_mem_use
LiteLLM -  improve memory utilization - don't use inMemCache on Router
2024-03-11 18:59:57 -07:00
ishaan-jaff
b6e7882fdb (fix) test mem usage 2024-03-11 16:53:03 -07:00
ishaan-jaff
eae1710c4b (fix) mem usage router.py 2024-03-11 16:52:06 -07:00
ishaan-jaff
3dda6f0cf3 (fix) test_mem_usage 2024-03-11 16:38:31 -07:00
ishaan-jaff
1bd3bb1128 (fix) improve mem util 2024-03-11 16:22:04 -07:00
Krish Dholakia
5647d945ff
Merge pull request #2448 from BerriAI/litellm_delete_key_security_fix
fix(proxy_server.py): prevent user from deleting non-user owned keys
2024-03-11 15:47:34 -07:00