phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity
6036 commits 1603 branches 645 tags 320 MiB
Commit graph

6036 commits

This branch
This branch
All branches
Author SHA1 Message Date
ishaan-jaff
dee025b7a3 (docs) misc/cookbook - OpenAI python timeout 2024-01-23 19:31:31 -08:00
ishaan-jaff
b0902f0a8c (ci/cd) add more logging to timeout test 2024-01-23 18:39:19 -08:00
Ishaan Jaff
d00548ee5d
Merge pull request #1576 from BerriAI/litellm_map_openai_auth_errors 
[Feat] Make Proxy Auth Exceptions OpenAI compatible
 2024-01-23 18:32:00 -08:00
Ishaan Jaff
a0cd4e78fc
Merge branch 'main' into litellm_map_openai_auth_errors 2024-01-23 18:31:48 -08:00
Krish Dholakia
61cc8762f1
Merge pull request #1570 from BerriAI/litellm_reset_key_budget 
feat(proxy/utils.py): Support keys with budget duration (resets spend on duration end)
 2024-01-23 18:10:42 -08:00
Krish Dholakia
9784d03d65
Merge branch 'main' into litellm_reset_key_budget 2024-01-23 18:10:32 -08:00
Krrish Dholakia
ef760cb21c build(requirements.txt): add apscheduler to requirements 2024-01-23 17:56:11 -08:00
Krrish Dholakia
d6844f43c8 test(test_keys.py): use correct model name for token counting 2024-01-23 17:46:14 -08:00
ishaan-jaff
b3ce0ac728 (test) proxy_custom_auth use new exceptions 2024-01-23 17:36:13 -08:00
ishaan-jaff
d2675a1ff3 (test) switch dynamodb test to use new exceptions 2024-01-23 17:34:18 -08:00
ishaan-jaff
feb367bbb9 (feat) all endpoints raise OpenAI compatible exceptions 2024-01-23 17:32:47 -08:00
ishaan-jaff
37dd1114f2 (test) update prisma test 2024-01-23 17:30:01 -08:00
Krrish Dholakia
7b5e3b9934 refactor(proxy/utils.py): fix linting issue 2024-01-23 17:22:22 -08:00
Krish Dholakia
4ca4913468
Merge pull request #1574 from BerriAI/litellm_fix_streaming_spend_tracking 
[WIP] fix(utils.py): fix proxy streaming spend tracking
 2024-01-23 17:07:40 -08:00
Ishaan Jaff
fdb6a7409b
Merge pull request #1575 from BerriAI/litellm_ui_view_spend 
[Feat] UI view spend per API Key
 2024-01-23 17:02:19 -08:00
Krish Dholakia
5defa93a9d Updated config.yml 2024-01-23 16:59:56 -08:00
ishaan-jaff
0e9339b390 (feat) /spend/logs 2024-01-23 16:57:51 -08:00
Krish Dholakia
7b8353e5c6 Updated config.yml 2024-01-23 16:52:08 -08:00
Krrish Dholakia
f47db44b4f test(test_keys.py): fix streaming test 2024-01-23 16:27:45 -08:00
ishaan-jaff
8ae8edfdb4 (fix) add doc string for /spend/keys 2024-01-23 16:27:25 -08:00
ishaan-jaff
6a7126af93 (fix) UI 2024-01-23 16:24:13 -08:00
Krrish Dholakia
7e0adbb9bd fix(proxy/utils.py): remove original auth sk-.. key before logging to spend logs 2024-01-23 16:19:32 -08:00
ishaan-jaff
e723df30f3 (feat) ui improvements 2024-01-23 16:14:39 -08:00
Krrish Dholakia
d52f5234b4 fix(utils.py): fix double hashing issue on spend logs, streaming usage metadata logging iss 
ue for spend logs
 2024-01-23 16:14:01 -08:00
Krrish Dholakia
f8870fb48e fix(utils.py): fix proxy streaming spend tracking 2024-01-23 15:59:03 -08:00
ishaan-jaff
1158ff4995 (feat) use cli args to start streamlit 2024-01-23 15:58:14 -08:00
ishaan-jaff
a2da9c30fb (feat) add /spend/keys endpoint 2024-01-23 15:10:10 -08:00
Ishaan Jaff
5702be1601
Merge pull request #1572 from BerriAI/litellm_use_same_response_id_across_chunks 
[Fix] Streaming - Use same `response_id` across chunks
 2024-01-23 14:40:50 -08:00
Krrish Dholakia
afada01ffc fix(utils.py): fix streaming cost tracking 2024-01-23 14:39:45 -08:00
ishaan-jaff
2f11b92698 v0 view spend logs 2024-01-23 14:15:19 -08:00
Krish Dholakia
7eb96e46a4 Updated config.yml 2024-01-23 13:55:08 -08:00
ishaan-jaff
b40176810e (test) dynamic timeouts - router 2024-01-23 13:27:49 -08:00
ishaan-jaff
64a387d09b (test) test chunk_ids match across chunks for bedrock 2024-01-23 13:06:05 -08:00
ishaan-jaff
d455833dfb (test) same response id across chunks 2024-01-23 12:57:04 -08:00
ishaan-jaff
39b4f19bd8 (fix) same response_id across chunk 2024-01-23 12:56:03 -08:00
ishaan-jaff
6d81da3f43 bump: version 1.18.10 → 1.18.11 2024-01-23 12:37:23 -08:00
Ishaan Jaff
861587e49d
Merge pull request #1569 from BerriAI/litellm_proxy_sagemaker_streaming 
[Fix] LiteLLM Proxy - Streaming Sagemaker Support on /chat/completions
 2024-01-23 12:35:16 -08:00
Krrish Dholakia
b1a105e309 feat(proxy/utils.py): enable background process to reset key budgets 2024-01-23 12:33:13 -08:00
ishaan-jaff
e8cd27f2b7 (fix) sagemaker streaming support 2024-01-23 12:31:16 -08:00
ishaan-jaff
44e213e842 (fix) select_data_generator 2024-01-23 12:13:34 -08:00
ishaan-jaff
a61dbc1613 (fix) select_data_generator - sagemaker 2024-01-23 12:08:58 -08:00
ishaan-jaff
bd37a9cb5e (fix) proxy - streaming sagemaker 2024-01-23 11:12:16 -08:00
Krrish Dholakia
01a2514b98 bump: version 1.18.9 → 1.18.10 2024-01-23 10:32:02 -08:00
Krrish Dholakia
05754ef238 test(test_router.py): add more testing for dynamically passing params to router 2024-01-23 10:31:49 -08:00
ishaan-jaff
6c1f8378c1 (test) fix sagemaker stream test 2024-01-23 10:07:13 -08:00
ishaan-jaff
3f37cf0bec (test) router.py revert to stable version 2024-01-23 09:05:19 -08:00
ishaan-jaff
fa2c94aacb (docs) remove custom_auth in example config.yaml 2024-01-23 08:40:21 -08:00
ishaan-jaff
d5b1cc7150 (ci/cd) run prisma.connect() before test 2024-01-23 08:36:49 -08:00
ishaan-jaff
5ad0971c5a (test) fix incorrect test lol 2024-01-23 08:21:14 -08:00
Ishaan Jaff
5e72d1901b Merge pull request #1534 from BerriAI/litellm_custom_cooldown_times 
[Feat] Litellm.Router set custom cooldown times
 2024-01-23 08:05:59 -08:00