phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 19:54:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
19706 commits 2497 branches 898 tags 550 MiB
Commit graph

1913 commits

Author SHA1 Message Date
Krrish Dholakia
3cf1623727 refactor(proxy/utils.py): fix linting issue 2024-01-23 17:22:22 -08:00
Krish Dholakia
2ba8863f75 Merge pull request #1574 from BerriAI/litellm_fix_streaming_spend_tracking 
[WIP] fix(utils.py): fix proxy streaming spend tracking
 2024-01-23 17:07:40 -08:00
ishaan-jaff
9ae3d8c243 (feat) /spend/logs 2024-01-23 16:57:51 -08:00
ishaan-jaff
97fd419cb5 (fix) add doc string for /spend/keys 2024-01-23 16:27:25 -08:00
Krrish Dholakia
a5e53271d3 fix(utils.py): fix double hashing issue on spend logs, streaming usage metadata logging iss 
ue for spend logs
 2024-01-23 16:14:01 -08:00
Krrish Dholakia
344e232549 fix(utils.py): fix proxy streaming spend tracking 2024-01-23 15:59:03 -08:00
ishaan-jaff
9c85d05d24 (feat) add /spend/keys endpoint 2024-01-23 15:10:10 -08:00
Krrish Dholakia
88486a3123 fix(utils.py): fix streaming cost tracking 2024-01-23 14:39:45 -08:00
Krrish Dholakia
e6f05e858b feat(proxy/utils.py): enable background process to reset key budgets 2024-01-23 12:33:13 -08:00
ishaan-jaff
a045400516 (fix) select_data_generator 2024-01-23 12:13:34 -08:00
ishaan-jaff
18fceed1e0 (fix) select_data_generator - sagemaker 2024-01-23 12:08:58 -08:00
ishaan-jaff
1f229a46ad (fix) proxy - streaming sagemaker 2024-01-23 11:12:16 -08:00
Krish Dholakia
3eaae0e73c Merge pull request #1557 from BerriAI/litellm_emit_spend_logs 
feat(utils.py): emit response cost as part of logs
 2024-01-22 21:02:40 -08:00
Krrish Dholakia
579dfc3013 test: fix tests 2024-01-22 20:20:17 -08:00
Krrish Dholakia
db2b7bfd4e fix(openai.py): fix linting issue 2024-01-22 18:20:15 -08:00
Krrish Dholakia
2ea18785ca feat(utils.py): emit response cost as part of logs 2024-01-22 15:53:04 -08:00
Ishaan Jaff
742142f9bf Merge branch 'main' into litellm_budget_per_key 2024-01-22 15:49:57 -08:00
Krrish Dholakia
e423aeff85 fix: support streaming custom cost completion tracking 2024-01-22 15:15:34 -08:00
Ishaan Jaff
8ba29125be Merge pull request #1538 from BerriAI/litellm_use_custom_key_gen 
[Feat] Proxy Auth - Use custom_key_generate
 2024-01-22 14:21:19 -08:00
ishaan-jaff
b7f1ad5355 (fix) spend tracking per key - when no cache hit 2024-01-22 13:18:33 -08:00
ishaan-jaff
1ba8e703e9 (feat) working budgets per key 2024-01-22 12:13:19 -08:00
ishaan-jaff
b13e3a0b90 (feat) working create budgets per key 2024-01-22 11:58:20 -08:00
Krrish Dholakia
59483da18b fix: fix proxy logging 2024-01-20 18:22:45 -08:00
Krrish Dholakia
2acdcc6671 fix: support info level logging on pkg + proxy 2024-01-20 17:45:47 -08:00
Krrish Dholakia
a5afe5bf41 fix(caching.py): add logging module support for caching 2024-01-20 17:34:29 -08:00
ishaan-jaff
e3b605c703 v0 using custom_key_generate 2024-01-20 08:39:52 -08:00
Krrish Dholakia
d0265a4341 fix(proxy_server.py): run all endpoints through custom auth 2024-01-19 20:24:33 -08:00
Krrish Dholakia
27d2f2246e fix(proxy_server.py): fix key info to handle pydantic v1 2024-01-19 18:52:09 -08:00
Krrish Dholakia
beca1eaae7 test(tests/): add unit testing for proxy server endpoints 2024-01-19 14:54:29 -08:00
Krrish Dholakia
43d52a4657 docs(health.md): add /health/readiness and /health/liveliness to docs 2024-01-19 08:45:23 -08:00
Ishaan Jaff
fe6ac13654 Merge pull request #1509 from BerriAI/litellm_track_cost_user_id_chat_completions 
[Feat] Proxy - Track Cost Per User (Using `user` passed to requests)
 2024-01-18 20:44:02 -08:00
Krrish Dholakia
164a132751 Merge branch 'main' into litellm_tpm_rpm_rate_limits 2024-01-18 19:10:07 -08:00
ishaan-jaff
c4133314a5 (fix) safe access litellm_params, proxy_server_request 2024-01-18 18:05:51 -08:00
ishaan-jaff
9e952ef7e9 (feat) use user_id passed to request - cost track 2024-01-18 17:51:48 -08:00
Krrish Dholakia
9c0179d132 fix(proxy_server.py): support setting tpm/rpm limits per user / per key 2024-01-18 17:03:18 -08:00
Ishaan Jaff
6c6c2facad Merge pull request #1500 from BerriAI/litellm_create_keys_with_team_id 
[Feat] /key/generate - create keys with`team_id`
 2024-01-18 16:35:14 -08:00
ishaan-jaff
6aff6e5c1d (fix) add team_id to doc string 2024-01-18 15:23:05 -08:00
ishaan-jaff
f2f2cabfcd (feat) write team_id to User Table 2024-01-18 14:42:46 -08:00
Ishaan Jaff
e6ec5a2f8c Merge pull request #1498 from BerriAI/litellm_spend_tracking_logs 
[Feat] Proxy - Add Spend tracking logs
 2024-01-18 14:21:51 -08:00
ishaan-jaff
d50ba0e7ac (fix) write team_id to key table 2024-01-18 13:54:08 -08:00
ishaan-jaff
260bb5f098 (fix) support team_id for /key/generate 2024-01-18 13:48:52 -08:00
ishaan-jaff
fab53c236d (fix) use get_logging_payload 2024-01-18 13:40:48 -08:00
Krrish Dholakia
44553bcc3a fix(parallel_request_limiter.py): decrement count for failed llm calls 
https://github.com/BerriAI/litellm/issues/1477
 2024-01-18 12:42:14 -08:00
ishaan-jaff
d42db904f6 (feat) spendLogs table DynamoDB 2024-01-18 12:39:11 -08:00
ishaan-jaff
8855276500 (feat) track cost streaming 2024-01-18 12:21:56 -08:00
ishaan-jaff
d8420b430d (v0 ) working - writing /chat/completion spend tracking 2024-01-18 11:54:15 -08:00
Krrish Dholakia
c00117679b fix(proxy_server.py): show all models user has access to in /models 2024-01-18 10:56:37 -08:00
Krrish Dholakia
c2813594ea fix(proxy/utils.py): fix isoformat to string logic 2024-01-18 09:32:30 -08:00
Krish Dholakia
05682f6eb4 Merge pull request #1483 from BerriAI/litellm_model_access_groups_feature 
feat(proxy_server.py): support model access groups
 2024-01-17 18:16:53 -08:00
ishaan-jaff
622251ab8d (fix) cleanup 2024-01-17 17:54:18 -08:00