Commit graph

8587 commits

Author SHA1 Message Date
ishaan-jaff
10a8eb223a (fix) update load test result 2024-03-13 17:53:51 -07:00
Ishaan Jaff
b075e9f7a9
Update load_test.yml 2024-03-13 17:39:01 -07:00
Ishaan Jaff
22d034522f
Update load_test.yml 2024-03-13 17:19:47 -07:00
Ishaan Jaff
3237f788e0
Update load_test.yml 2024-03-13 17:15:06 -07:00
Ishaan Jaff
f5631cc237
Update load_test.yml 2024-03-13 17:10:33 -07:00
Ishaan Jaff
5c9b42321d
Update load_test.yml 2024-03-13 17:06:36 -07:00
Ishaan Jaff
8fb035bc39
Merge pull request #2505 from bachya/claude-3-haiku
Add support for `claude-3-haiku-20240307` (`anthropic`)
2024-03-13 17:01:57 -07:00
Ishaan Jaff
5232e9b5fc
Update load_test.yml 2024-03-13 17:00:19 -07:00
Ishaan Jaff
7b44de5901
Update load_test.yml 2024-03-13 16:53:40 -07:00
Aaron Bach
daca0a93ce Update docs 2024-03-13 17:37:59 -06:00
Ishaan Jaff
e578ce979e
Update load_test.yml 2024-03-13 16:35:51 -07:00
Ishaan Jaff
f19acd8a53
Update load_test.yml 2024-03-13 16:32:33 -07:00
Ishaan Jaff
0c2b13991b
Update load_test.yml 2024-03-13 16:07:24 -07:00
Aaron Bach
9fd6ac04c5 Add support for claude-3-haiku-20240307 (anthropic) 2024-03-13 16:46:50 -06:00
Ishaan Jaff
58b446b184
Update load_test.yml 2024-03-13 15:27:59 -07:00
ishaan-jaff
60f34066a5 (fix) default dockerfile use num_workers = 1 2024-03-13 15:23:53 -07:00
Ishaan Jaff
99783ae369
Update load_test.yml 2024-03-13 15:22:17 -07:00
Ishaan Jaff
fc54358c26
Update load_test.yml 2024-03-13 15:08:20 -07:00
ishaan-jaff
d28145f916 (fix) fake openai endpoint 2024-03-13 15:07:50 -07:00
ishaan-jaff
acd8f7b48c (fix) example fake openai endpoint 2024-03-13 15:06:44 -07:00
Ishaan Jaff
07a6957cca
Create locustfile.py 2024-03-13 15:05:46 -07:00
Ishaan Jaff
75e9bab41d
Update load_test.yml 2024-03-13 15:04:39 -07:00
Ishaan Jaff
10a3f8e4d4
Create load_test.yml 2024-03-13 15:04:01 -07:00
ishaan-jaff
788583a737 (ci/cd) use fake-openai-endpoint in docker builds 2024-03-13 14:57:41 -07:00
Ishaan Jaff
8a886c6e93
Merge pull request #2501 from BerriAI/litellm_fix_using_enterprise_docker
(fix) using enterprise folder on litellm Docker
2024-03-13 14:26:21 -07:00
ishaan-jaff
992aba2a77 (fix) predict/spend/logs test 2024-03-13 14:09:51 -07:00
ishaan-jaff
ba5cc19edf (test) using get_predict_spend_logs 2024-03-13 14:00:04 -07:00
Ishaan Jaff
d82be720d2
Merge pull request #2493 from BerriAI/litellm_return_429_no_models_available
[Proxy] return 429 when no models available
2024-03-13 13:33:43 -07:00
Krrish Dholakia
f5eb0a1751 bump: version 1.31.8 → 1.31.9 2024-03-13 12:37:50 -07:00
Krrish Dholakia
16e3aaced5 docs(enterprise.md): add prompt injection detection to docs 2024-03-13 12:37:32 -07:00
Krish Dholakia
3e66b50602
Merge pull request #2498 from BerriAI/litellm_prompt_injection_detection
feat(prompt_injection_detection.py): support simple heuristic similarity check for prompt injection attacks
2024-03-13 12:28:19 -07:00
Krrish Dholakia
dbc7552d15 docs: refactor team based logging in docs 2024-03-13 12:26:39 -07:00
ishaan-jaff
82246d8e30 (fix) using enterprise folder on litellm 2024-03-13 12:16:58 -07:00
Krrish Dholakia
b3493269b3 fix(proxy_server.py): support checking openai user param 2024-03-13 12:00:27 -07:00
ishaan-jaff
7924700df6 bump: version 1.31.7 → 1.31.8 2024-03-13 11:55:57 -07:00
Ishaan Jaff
fd99f9f64a
Merge pull request #2500 from BerriAI/litellm_fix_using_enterpise
(fix) issue with using litellm enterprise on Admin UI
2024-03-13 11:55:29 -07:00
Krrish Dholakia
a0f08766fe bump: version 1.31.6 → 1.31.7 2024-03-13 11:35:24 -07:00
Krrish Dholakia
dfac742324 fix(factory.py): fix mistral api prompt formatting 2024-03-13 11:34:45 -07:00
Krrish Dholakia
234cdbbfef feat(prompt_injection_detection.py): support simple heuristic similarity check for prompt injection attacks 2024-03-13 10:32:21 -07:00
ishaan-jaff
771d09312e (fix) issue with using litellm enterprise license 2024-03-13 10:30:31 -07:00
Ishaan Jaff
ac867daadc
Merge pull request #2204 from BerriAI/dependabot/pip/orjson-3.9.15
build(deps): bump orjson from 3.9.7 to 3.9.15
2024-03-13 08:50:15 -07:00
Ishaan Jaff
0058e0270c
Merge pull request #2470 from tylerbrandt/gcp-dep
fix: add dependency for google-cloud-aiplatform
2024-03-13 08:17:08 -07:00
ishaan-jaff
4c526ade27 (fix) errors fro litellm proxy 2024-03-13 08:05:32 -07:00
ishaan-jaff
3aeada232e (fix) return 429 error 2024-03-13 08:03:28 -07:00
ishaan-jaff
aaa008ecde (fix) raising No healthy deployment 2024-03-13 08:00:56 -07:00
Krrish Dholakia
9e692d6cce docs(sidebar.js): add dall e 3 cost tracking to docs 2024-03-12 22:26:10 -07:00
Krrish Dholakia
1b93ada827 bump: version 1.31.5 → 1.31.6 2024-03-12 21:36:33 -07:00
Krish Dholakia
9f2d540ebf
Merge pull request #2472 from BerriAI/litellm_anthropic_streaming_tool_calling
fix(anthropic.py): support claude-3 streaming with function calling
2024-03-12 21:36:01 -07:00
Krrish Dholakia
488c4b9939 docs(cost_tracking.md): add docs for cost tracking dall e 3 calls 2024-03-12 21:35:17 -07:00
Ishaan Jaff
7b4f9691c7
Merge pull request #2479 from BerriAI/litellm_cohere_tool_call
[FEAT Cohere/command-r tool calling
2024-03-12 21:20:59 -07:00