Commit graph

5641 commits

Author SHA1 Message Date
Ishaan Jaff
ea3491a765 simplify calling azure/commmand-r-plus 2024-04-05 09:18:11 -07:00
Ishaan Jaff
442c053280 skip vertex test for this PR 2024-04-05 09:06:15 -07:00
Ishaan Jaff
12c5c96012 test - azure/command-r-plus 2024-04-05 08:56:05 -07:00
Ishaan Jaff
296f10e2c9 fix add azure/command-r-plus 2024-04-05 08:53:24 -07:00
Ishaan Jaff
593275794d add azure command_r_plust 2024-04-05 08:51:39 -07:00
Ishaan Jaff
a0d429eadc (ci/cd) aws suspended account 2024-04-04 17:43:16 -07:00
Ishaan Jaff
c0ef9b1e84 ui - new build 2024-04-04 17:36:26 -07:00
Ishaan Jaff
16926d7b93 Merge pull request #2850 from BerriAI/litellm_track_cost_tag
[UI] Show Usage Per Tag
2024-04-04 17:31:36 -07:00
Ishaan Jaff
1c51e17205 ui show spend per tag 2024-04-04 16:57:45 -07:00
Krrish Dholakia
9b8e1fe052 test(test_caching.py): skip test - aws suspended account
will need to recreate these objects on a new aws account
2024-04-04 15:07:19 -07:00
Krrish Dholakia
48a5948081 fix(router.py): handle id being passed in as int 2024-04-04 14:23:10 -07:00
Krrish Dholakia
a7da061ed8 test(test_router.py): fix casting 2024-04-04 13:54:16 -07:00
Krrish Dholakia
a8b4bc747e fix(main.py): trigger new build 2024-04-04 13:36:21 -07:00
Krrish Dholakia
99e9b29526 test(test_router.py): fix test to check cast 2024-04-04 13:32:50 -07:00
Ishaan Jaff
a613d5183a Merge pull request #2840 from BerriAI/litellm_return_cache_key_responses
[FEAT] Proxy - Delete Cache Keys + return cache key in responses
2024-04-04 11:52:52 -07:00
Krrish Dholakia
0294c3f8a9 test(test_router.py): fix test to check type 2024-04-04 11:45:12 -07:00
Ishaan Jaff
f8fe8c787a return cache key in streming responses 2024-04-04 11:00:00 -07:00
Krrish Dholakia
053a06df97 build(config.yml): add missing dep 2024-04-04 10:59:26 -07:00
Ishaan Jaff
a515441ad1 feat - delete cache key 2024-04-04 10:56:47 -07:00
Krrish Dholakia
f863f30c4f refactor(main.py): trigger new build 2024-04-04 10:54:13 -07:00
Krrish Dholakia
0716526c53 fix(proxy_server.py): fix linting error 2024-04-04 10:40:32 -07:00
Krrish Dholakia
1f56ea6015 build: trigger new build 2024-04-04 10:23:13 -07:00
Krrish Dholakia
b73cd05674 build: trigger new build 2024-04-04 10:20:25 -07:00
Ishaan Jaff
d0977d61ff v0 return cache key in responses 2024-04-04 10:11:18 -07:00
Krrish Dholakia
f2823b6689 test(test_secret_manager.py): skip test - aws account suspended 2024-04-04 10:10:21 -07:00
Krrish Dholakia
c90da63650 test(test_completion.py): skip sagemaker test - aws account suspended 2024-04-04 09:52:24 -07:00
Krrish Dholakia
1216e1c3c3 test(test_models.py): fix delete model test 2024-04-04 08:46:08 -07:00
Krish Dholakia
a2dd945bd4 Merge pull request #2827 from BerriAI/litellm_model_add_api
fix(proxy_server.py): persist models added via `/model/new` to db
2024-04-03 23:30:39 -07:00
Krrish Dholakia
ec29f44c1f fix: raise correct error 2024-04-03 22:37:51 -07:00
Krrish Dholakia
a4a8129a13 fix(router.py): fix pydantic object logic 2024-04-03 21:57:19 -07:00
Krrish Dholakia
acdb3a7f7e test(test_acooldowns_router.py): fix tpm 2024-04-03 21:24:42 -07:00
Ishaan Jaff
bb9440fde6 (ci/cd) run again 2024-04-03 21:02:08 -07:00
Ishaan Jaff
fc7097beed (ui) new ui build 2024-04-03 21:01:25 -07:00
Ishaan Jaff
91ec3478e1 test - voyage ai embedding 2024-04-03 20:54:35 -07:00
Krish Dholakia
b01e1c24df Merge branch 'main' into litellm_model_add_api 2024-04-03 20:29:44 -07:00
Krrish Dholakia
db9f674937 build(schema.prisma): add proxy model table to prisma schema 2024-04-03 20:17:38 -07:00
Krrish Dholakia
129bb52e9d fix(proxy_server.py): persist models added via /model/new to db
allows models to be used across instances

https://github.com/BerriAI/litellm/issues/2319 , https://github.com/BerriAI/litellm/issues/2329
2024-04-03 20:16:41 -07:00
Ishaan Jaff
0f6b31a49a ci/cd run again 2024-04-03 20:13:46 -07:00
Ishaan Jaff
984a08a500 ui - new build 2024-04-03 19:42:26 -07:00
Ishaan Jaff
13c1130d90 fix team update bug 2024-04-03 19:38:07 -07:00
Krrish Dholakia
7880dcbdf7 fix(openai.py): support passing prompt as list instead of concat string 2024-04-03 15:23:20 -07:00
Krrish Dholakia
126c0cca81 fix(lunary.py): move parse_version to inside lunarylogger 2024-04-03 13:52:42 -07:00
Krrish Dholakia
5fe8aa27d1 feat(prometheus.py): track team based metrics on prometheus 2024-04-03 13:43:21 -07:00
Krrish Dholakia
f3fcfe3007 fix(proxy_server.py): return original model response via response headers - /v1/completions
to help devs with debugging
2024-04-03 13:05:43 -07:00
Krrish Dholakia
be3146c505 test(test_text_completion.py): unit testing for text completion pydantic object 2024-04-03 12:26:51 -07:00
Krish Dholakia
ead123dd98 Merge pull request #2711 from YiShiYiYuan/main
🐞 fix: djl vllm support
2024-04-03 09:41:46 -07:00
Krrish Dholakia
2d0c450079 fix(proxy_cli.py): revert db timeout change - user-controllable param
db timeout is a user controllable param, not necessary to change defaults
2024-04-03 09:37:57 -07:00
Krrish Dholakia
895073e68a fix(proxy_server.py): bump default db timeouts 2024-04-03 09:35:08 -07:00
Krrish Dholakia
96e0078b3a fix(_types.py): make /metrics public 2024-04-03 09:17:40 -07:00
Krrish Dholakia
6f64eccafe refactor(main.py): trigger new build 2024-04-03 08:01:26 -07:00