Commit graph

2628 commits

Author SHA1 Message Date
Ishaan Jaff
a428857d95 Merge pull request #4322 from BerriAI/litellm_bug_fix_spend_tracking
[Fix]  user field and user_api_key_* is sometimes omitted randomly
2024-06-20 21:10:13 -07:00
Krish Dholakia
2e814bb57d Merge pull request #4290 from BerriAI/litellm_specific_deployment
feat(router.py): allow user to call specific deployment via id
2024-06-20 20:36:13 -07:00
Krish Dholakia
9e37674a28 Merge pull request #4323 from BerriAI/litellm_fix_duration_in_s
fix(key_management_endpoints.py): use common _duration_in_seconds function
2024-06-20 20:35:59 -07:00
Ishaan Jaff
6cc427790e make sure linting runs proxy_cli.py 2024-06-20 20:20:08 -07:00
Chris Van Pelt
ae0e2ba9e5 Update proxy_cli.py
Fixed indentation to so we don't get an `UnboundLocalError`.  Fixes #4324
2024-06-20 17:48:16 -07:00
Ishaan Jaff
beb67dca38 fix update_cache function 2024-06-20 17:27:25 -07:00
Krrish Dholakia
9032fd0cce fix(key_management_endpoints.py): use common _duration_in_seconds function 2024-06-20 17:02:31 -07:00
Ishaan Jaff
e7180dc624 fix don't store bad api key in user api key cache 2024-06-20 16:55:12 -07:00
Krrish Dholakia
66948d083f fix(user_api_key_auth.py): ensure user has access to fallback models
for client side fallbacks, checks if user has access to fallback models
2024-06-20 16:02:19 -07:00
Krrish Dholakia
86225afdb0 fix(_logging.py): fix timestamp format for json logs
Outputs timestamp in ISO 8601 format to work with fluentbit
2024-06-20 15:20:21 -07:00
Krrish Dholakia
4ba5c71350 fix(proxy_cli.py): fix double counting json logs 2024-06-20 15:15:23 -07:00
Krrish Dholakia
73c2108d41 fix(proxy/utils.py): fix linting error 2024-06-20 14:13:38 -07:00
Krrish Dholakia
84043f4fd4 fix(litellm_logging.py): initialize global variables
Fixes https://github.com/BerriAI/litellm/issues/4281
2024-06-19 18:39:45 -07:00
Krrish Dholakia
477ed99896 feat(router.py): allow user to call specific deployment via id
Allows easier health checks for specific deployments by just passing in model id
2024-06-19 13:02:46 -07:00
Ishaan Jaff
343d956c6e Merge pull request #4286 from BerriAI/litellm_support_options_health_endpoints
feat - support CURL OPTIONS for `/health/readiness` endpoint
2024-06-19 12:25:32 -07:00
Ishaan Jaff
69c32eaa0e add options for /health/readiness and liveliness 2024-06-19 12:13:35 -07:00
Ishaan Jaff
c4a8177f89 add health/readiness OPTIONS 2024-06-19 12:00:48 -07:00
Ishaan Jaff
0ae86abd56 feat - support OPTIONS for health endpoints 2024-06-19 09:55:38 -07:00
Krish Dholakia
ea2f27e472 Merge branch 'main' into litellm_aws_kms_fixes 2024-06-19 09:30:54 -07:00
Krrish Dholakia
aeeaadfaa6 fix(router.py): support adding models across multiple orgs, with 1 model definition 2024-06-18 19:57:10 -07:00
Krrish Dholakia
6fcad5f199 fix(proxy_server.py): track team spend for cached team object
fixes issue where team budgets for jwt tokens weren't asserted
2024-06-18 17:10:12 -07:00
Ishaan Jaff
2037545c32 fix - thread create endpoints 2024-06-18 07:54:47 -07:00
Ishaan Jaff
4e9f16f5ac Merge pull request #4254 from BerriAI/litellm_refactor_logfire
[Fix] Refactor Logfire to use LiteLLM OTEL Class
2024-06-17 19:49:36 -07:00
Krrish Dholakia
986b5ed9c8 fix(_logging.py): add loglevel and timestamp to json logs
Fixes https://github.com/BerriAI/litellm/issues/4248
2024-06-17 18:57:20 -07:00
Krrish Dholakia
ec56ae7c9a fix(proxy/_types.py): allow internal user to access sso routes 2024-06-17 18:34:37 -07:00
Ishaan Jaff
464a6e6256 fix - refactor logfire 2024-06-17 17:21:43 -07:00
John HU
ec5e26a848 fix: strip llm credential before returning 2024-06-17 12:14:40 -07:00
Krrish Dholakia
fa6ddcde3c fix(litellm_logging.py): fix lago callback logic 2024-06-17 09:10:19 -07:00
Ishaan Jaff
b7c5700b54 fix- refactor proxy place internal user endpoints in sep file 2024-06-15 16:39:06 -07:00
Ishaan Jaff
a9649c0860 Merge pull request #4217 from BerriAI/litellm_refactor_proxy_server
[Refactor-Proxy] Make proxy_server.py < 10K lines (move management, key, endpoints to their own files)
2024-06-15 16:27:31 -07:00
Ishaan Jaff
d78595fe1e doc - add comment explaining user_api_key_auth file 2024-06-15 16:08:17 -07:00
Ishaan Jaff
2aa18b665f Merge pull request #4220 from BerriAI/litellm_admin_ui_sign_up_flow
fix - non sso ui sign up flow
2024-06-15 15:55:21 -07:00
Ishaan Jaff
f7c28d9ed1 ui - new build 2024-06-15 15:53:46 -07:00
Ishaan Jaff
f3a7c52f60 fix - non sso ui sign up flow 2024-06-15 15:26:44 -07:00
Krish Dholakia
fa2d8bc794 Merge pull request #4216 from BerriAI/litellm_refactor_logging
refactor(utils.py): Cut down utils.py to <10k lines.
2024-06-15 15:19:42 -07:00
Ishaan Jaff
abb544190a fix - refactor key endpoints 2024-06-15 14:13:32 -07:00
Ishaan Jaff
9b655c9ef7 use directories for importing new endpoints 2024-06-15 13:35:21 -07:00
Ishaan Jaff
0f8dbe5ed4 refactor health endpoints 2024-06-15 12:39:04 -07:00
Ishaan Jaff
2dcc484e5d fix swagger 2024-06-15 12:22:16 -07:00
Ishaan Jaff
b1599c3f40 refactor spend endpoints 2024-06-15 12:17:33 -07:00
Krrish Dholakia
019533d815 fix(utils.py): move 'set_callbacks' to litellm_logging.py 2024-06-15 12:02:30 -07:00
Ishaan Jaff
749af8278b fix test 2024-06-15 11:46:15 -07:00
Ishaan Jaff
897f6bc7ea feat - refactor team endpoints 2024-06-15 11:40:36 -07:00
Krrish Dholakia
9d7f5d503c refactor(utils.py): refactor Logging to it's own class. Cut down utils.py to <10k lines.
Easier debugging

 Reference: https://github.com/BerriAI/litellm/issues/4206
2024-06-15 10:57:20 -07:00
Ishaan Jaff
ed273ef4f0 test - fixes 2024-06-15 10:40:02 -07:00
Ishaan Jaff
4bc2bfb176 fix - proxy refactor user_api_key_auth 2024-06-15 10:33:58 -07:00
Ishaan Jaff
91eafc8827 ui - new build 2024-06-14 20:33:02 -07:00
Ishaan Jaff
8988b2e909 Merge pull request #4209 from BerriAI/litellm_send_email_alerts_budget_exceeded
[Feat] send email alerts when budget exceeded
2024-06-14 20:23:19 -07:00
Ishaan Jaff
f16a9a6d92 fix send emails to team members 2024-06-14 20:11:16 -07:00
Krish Dholakia
9e280ba235 Merge pull request #4205 from BerriAI/litellm_alerting_metadata
fix(slack_alerting.py): allow new 'alerting_metadata' arg
2024-06-14 19:04:30 -07:00