Commit graph

8681 commits

Author SHA1 Message Date
Ishaan Jaff
5232e9b5fc
Update load_test.yml 2024-03-13 17:00:19 -07:00
Ishaan Jaff
7b44de5901
Update load_test.yml 2024-03-13 16:53:40 -07:00
Aaron Bach
daca0a93ce Update docs 2024-03-13 17:37:59 -06:00
Ishaan Jaff
e578ce979e
Update load_test.yml 2024-03-13 16:35:51 -07:00
Ishaan Jaff
f19acd8a53
Update load_test.yml 2024-03-13 16:32:33 -07:00
Krrish Dholakia
cf090acb25 fix(proxy_server.py): move to using UPDATE + SET for track_cost_callback 2024-03-13 16:13:37 -07:00
Ishaan Jaff
0c2b13991b
Update load_test.yml 2024-03-13 16:07:24 -07:00
Aaron Bach
9fd6ac04c5 Add support for claude-3-haiku-20240307 (anthropic) 2024-03-13 16:46:50 -06:00
Ishaan Jaff
58b446b184
Update load_test.yml 2024-03-13 15:27:59 -07:00
ishaan-jaff
60f34066a5 (fix) default dockerfile use num_workers = 1 2024-03-13 15:23:53 -07:00
Ishaan Jaff
99783ae369
Update load_test.yml 2024-03-13 15:22:17 -07:00
Ishaan Jaff
fc54358c26
Update load_test.yml 2024-03-13 15:08:20 -07:00
ishaan-jaff
d28145f916 (fix) fake openai endpoint 2024-03-13 15:07:50 -07:00
ishaan-jaff
acd8f7b48c (fix) example fake openai endpoint 2024-03-13 15:06:44 -07:00
Ishaan Jaff
07a6957cca
Create locustfile.py 2024-03-13 15:05:46 -07:00
Ishaan Jaff
75e9bab41d
Update load_test.yml 2024-03-13 15:04:39 -07:00
Ishaan Jaff
10a3f8e4d4
Create load_test.yml 2024-03-13 15:04:01 -07:00
ishaan-jaff
788583a737 (ci/cd) use fake-openai-endpoint in docker builds 2024-03-13 14:57:41 -07:00
Ishaan Jaff
8a886c6e93
Merge pull request #2501 from BerriAI/litellm_fix_using_enterprise_docker
(fix) using enterprise folder on litellm Docker
2024-03-13 14:26:21 -07:00
ishaan-jaff
992aba2a77 (fix) predict/spend/logs test 2024-03-13 14:09:51 -07:00
ishaan-jaff
ba5cc19edf (test) using get_predict_spend_logs 2024-03-13 14:00:04 -07:00
Ishaan Jaff
d82be720d2
Merge pull request #2493 from BerriAI/litellm_return_429_no_models_available
[Proxy] return 429 when no models available
2024-03-13 13:33:43 -07:00
Krrish Dholakia
f5eb0a1751 bump: version 1.31.8 → 1.31.9 2024-03-13 12:37:50 -07:00
Krrish Dholakia
16e3aaced5 docs(enterprise.md): add prompt injection detection to docs 2024-03-13 12:37:32 -07:00
Krish Dholakia
3e66b50602
Merge pull request #2498 from BerriAI/litellm_prompt_injection_detection
feat(prompt_injection_detection.py): support simple heuristic similarity check for prompt injection attacks
2024-03-13 12:28:19 -07:00
Krrish Dholakia
dbc7552d15 docs: refactor team based logging in docs 2024-03-13 12:26:39 -07:00
ishaan-jaff
82246d8e30 (fix) using enterprise folder on litellm 2024-03-13 12:16:58 -07:00
Krrish Dholakia
b3493269b3 fix(proxy_server.py): support checking openai user param 2024-03-13 12:00:27 -07:00
ishaan-jaff
7924700df6 bump: version 1.31.7 → 1.31.8 2024-03-13 11:55:57 -07:00
Ishaan Jaff
fd99f9f64a
Merge pull request #2500 from BerriAI/litellm_fix_using_enterpise
(fix) issue with using litellm enterprise on Admin UI
2024-03-13 11:55:29 -07:00
Krrish Dholakia
a0f08766fe bump: version 1.31.6 → 1.31.7 2024-03-13 11:35:24 -07:00
Krrish Dholakia
dfac742324 fix(factory.py): fix mistral api prompt formatting 2024-03-13 11:34:45 -07:00
Krrish Dholakia
234cdbbfef feat(prompt_injection_detection.py): support simple heuristic similarity check for prompt injection attacks 2024-03-13 10:32:21 -07:00
ishaan-jaff
771d09312e (fix) issue with using litellm enterprise license 2024-03-13 10:30:31 -07:00
Ishaan Jaff
ac867daadc
Merge pull request #2204 from BerriAI/dependabot/pip/orjson-3.9.15
build(deps): bump orjson from 3.9.7 to 3.9.15
2024-03-13 08:50:15 -07:00
Ishaan Jaff
0058e0270c
Merge pull request #2470 from tylerbrandt/gcp-dep
fix: add dependency for google-cloud-aiplatform
2024-03-13 08:17:08 -07:00
ishaan-jaff
4c526ade27 (fix) errors fro litellm proxy 2024-03-13 08:05:32 -07:00
ishaan-jaff
3aeada232e (fix) return 429 error 2024-03-13 08:03:28 -07:00
ishaan-jaff
aaa008ecde (fix) raising No healthy deployment 2024-03-13 08:00:56 -07:00
Krrish Dholakia
9e692d6cce docs(sidebar.js): add dall e 3 cost tracking to docs 2024-03-12 22:26:10 -07:00
Krrish Dholakia
1b93ada827 bump: version 1.31.5 → 1.31.6 2024-03-12 21:36:33 -07:00
Krish Dholakia
9f2d540ebf
Merge pull request #2472 from BerriAI/litellm_anthropic_streaming_tool_calling
fix(anthropic.py): support claude-3 streaming with function calling
2024-03-12 21:36:01 -07:00
Krrish Dholakia
488c4b9939 docs(cost_tracking.md): add docs for cost tracking dall e 3 calls 2024-03-12 21:35:17 -07:00
Ishaan Jaff
7b4f9691c7
Merge pull request #2479 from BerriAI/litellm_cohere_tool_call
[FEAT Cohere/command-r tool calling
2024-03-12 21:20:59 -07:00
Krrish Dholakia
55612a6a5f fix(anthropic.py): add more logging 2024-03-12 21:18:38 -07:00
Ishaan Jaff
3922b827f8
Merge pull request #2484 from BerriAI/litellm_fix_langfuse_default
[Proxy-High Traffic] Fix using Langfuse in high traffic
2024-03-12 19:35:24 -07:00
Krrish Dholakia
d620b4dc5d fix(anthropic.py): bug fix 2024-03-12 19:32:42 -07:00
Krrish Dholakia
e892fc99a3 fix(anthropic.py): concurrent request fix 2024-03-12 19:25:05 -07:00
Krrish Dholakia
2b5ba1c7af bump: version 1.31.4 → 1.31.5 2024-03-12 19:18:05 -07:00
Krish Dholakia
8beb6bb2bc
Merge pull request #2382 from BerriAI/litellm_cost_tracking_fix
fix(proxy_server.py): support cost tracking if general_settings is none
2024-03-12 19:15:23 -07:00