Commit graph

8777 commits

Author SHA1 Message Date
Krrish Dholakia
f588bff69b fix(proxy_server.py): fix spend log update 2024-03-18 20:26:28 -07:00
Krrish Dholakia
8fefe625d9 fix(proxy/utils.py): batch writing updates to db 2024-03-18 16:47:02 -07:00
Krrish Dholakia
077b9c6234 fix(proxy/utils.py): move to batch writing db updates 2024-03-16 22:32:00 -07:00
Krrish Dholakia
710efab0de bump: version 1.31.17 → 1.32.0 2024-03-16 18:50:48 -07:00
Krrish Dholakia
c69ae8efce refactor(main.py): trigger new build 2024-03-16 18:49:54 -07:00
Krrish Dholakia
136a58b84a docs(secret.md): add aws secret manager to docs 2024-03-16 18:47:56 -07:00
Krish Dholakia
e55a8c3570
Merge pull request #2556 from BerriAI/litellm_aws_secret_manager_support
fix(utils.py): initial commit for aws secret manager support
2024-03-16 18:41:58 -07:00
Krrish Dholakia
bc66ef9d5c fix(utils.py): fix aws secret manager + support key_management_settings
fixes the aws secret manager implementation and allows the user to set which keys they want to check thr
ough it
2024-03-16 16:47:50 -07:00
Ishaan Jaff
ac6c69ff89
Merge pull request #2559 from BerriAI/litellm_show_spend_correctly
(fix) admin ui - order spend by date
2024-03-16 16:43:13 -07:00
Ishaan Jaff
446034a3e5 bump: version 1.31.16 → 1.31.17 2024-03-16 16:42:37 -07:00
Ishaan Jaff
e3582d86c6
Merge pull request #2557 from BerriAI/litellm_clean_up_health_readiness
(fix) /health/readiness return success callback names as (str)
2024-03-16 16:38:01 -07:00
Ishaan Jaff
34a26f4d05 (feat) new ui build 2024-03-16 16:26:36 -07:00
Ishaan Jaff
2355e9dc51 (fix) admin ui - order spend by date 2024-03-16 16:15:10 -07:00
Ishaan Jaff
cb4c36b7f6 (fix) /health readiness return callback names 2024-03-16 15:56:07 -07:00
Ishaan Jaff
732ab69d32
Merge pull request #2553 from BerriAI/litellm_improve_health_readiness_perf
(feat) Proxy - improve health readiness perf (93% faster)
2024-03-16 15:38:45 -07:00
Krish Dholakia
3197ebeb7e
Merge pull request #2552 from BerriAI/litellm_end_user_opt_out_db
fix(proxy_server.py): write blocked user list to a db table
2024-03-16 14:38:43 -07:00
Krrish Dholakia
d8956e9255 fix(utils.py): initial commit for aws secret manager support 2024-03-16 14:37:46 -07:00
Krrish Dholakia
26e783ab59 build: fix field name 2024-03-16 14:15:01 -07:00
Ishaan Jaff
389e79d3b2 (fix) improve /health/readiness under high load 2024-03-16 14:14:17 -07:00
Krrish Dholakia
3de766c071 fix(proxy_server.py): fix linting errors 2024-03-16 14:02:36 -07:00
Krrish Dholakia
844d6828c8 fix(proxy_server.py): rename beta end user blocking endpoints
separating end user management from user management
2024-03-16 13:53:10 -07:00
Ishaan Jaff
61f129b9ab (feat) improve health readiness perf 2024-03-16 13:10:04 -07:00
Krrish Dholakia
dd151869a3 fix(blocked_user_list.py): check if end user blocked in db 2024-03-16 13:03:52 -07:00
Krrish Dholakia
ef0002f31c fix(proxy_server.py): write blocked user list to a db table
lets this persist across workers
2024-03-16 12:26:29 -07:00
Ishaan Jaff
9a3f49db7e
Merge pull request #2551 from BerriAI/litellm_use_helm_chart
[FEAT] LiteLLM Helm Chart hosted on ghcr + docs
2024-03-16 12:16:52 -07:00
Ishaan Jaff
27cd012c2d (docs) litellm hel 2024-03-16 12:14:35 -07:00
Ishaan Jaff
c17e721278 (docs) update litellm helm docs 2024-03-16 12:01:38 -07:00
Krish Dholakia
2c2f322d5a
Update proxy_server_config.yaml 2024-03-16 11:16:13 -07:00
Krrish Dholakia
2c2db9ce89 fix(proxy_server.py): bug fix on getting user obj from cache 2024-03-16 11:07:38 -07:00
Ishaan Jaff
4e49ca2588 (fix) helm deploy litellm 2024-03-16 10:55:23 -07:00
Ishaan Jaff
fe200cfb07 (fix) re-include deployment.yaml 2024-03-16 10:51:32 -07:00
Ishaan Jaff
e3523561f8
Merge pull request #2145 from ShaunMaher/update_helm_chart_deployment_2024-02-22
Update helm chart to accomodate recent project changes
2024-03-16 10:50:40 -07:00
Ishaan Jaff
14215ad52a Merge branch 'update_helm_chart_deployment_2024-02-22' of https://github.com/ShaunMaher/litellm into pr/2145 2024-03-16 10:50:10 -07:00
Ishaan Jaff
73a95e0d25 (fix) ghcr_deploy.yaml 2024-03-16 10:48:02 -07:00
Shaun Maher
5e4b0d1f5a Don't fail if there is no existing helm chart to get the version from 2024-03-16 10:47:43 -07:00
Shaun Maher
f52f1f40e6 Remove --run_gunicorn from proxy command line arguments 2024-03-16 10:47:25 -07:00
Shaun Maher
c838b2853c Copy helm chart build and deploy job from ghcr_helm_deploy to ghcr_deploy. 2024-03-16 10:47:16 -07:00
Ishaan Jaff
4436cdc621 (fix) ghcr_deploy.yaml 2024-03-16 10:41:44 -07:00
Ishaan Jaff
5665234b86 (fix) rename chart 2024-03-16 10:40:49 -07:00
Krrish Dholakia
48f96dd563 fix(caching.py): close redis connection pool upon proxy shutdown 2024-03-16 10:39:58 -07:00
ishaan-jaff
a8ad99cf76 (fix) deploy litellm helm 2024-03-16 10:15:38 -07:00
ishaan-jaff
01aa7b3e6e (fix) deploy litellm-helm 2024-03-16 10:10:47 -07:00
ishaan-jaff
54dceea4b0 (fix) releasing litellm helm as "litellm-helm" 2024-03-16 10:06:14 -07:00
ishaan-jaff
919fe14257 (fix) release helm chart as litellm-helm 2024-03-16 10:03:29 -07:00
Krish Dholakia
c1495c0d1c
Merge pull request #2527 from lazyhope/support_anthropic_function_result
Add function call result submission support for Claude 3 models
2024-03-16 09:58:33 -07:00
Krish Dholakia
0368a335e6
Merge branch 'main' into support_anthropic_function_result 2024-03-16 09:58:08 -07:00
ishaan-jaff
5a87ac8047 (feat) publish litellm helm charts 2024-03-16 09:53:41 -07:00
ishaan-jaff
177571bea3 (fix) backoff import 2024-03-16 08:53:06 -07:00
Krrish Dholakia
2d2731c3b5 docs(caching.md): add batch redis requests to docs 2024-03-15 23:01:08 -07:00
Krish Dholakia
f3cf1ec71f
Update proxy_server_config.yaml 2024-03-15 22:40:39 -07:00