Commit graph

9140 commits

Author SHA1 Message Date
Krrish Dholakia
5a2e3d65cb build(spend-logs): separate server for writing spend logs to db 2024-03-28 13:23:22 -07:00
Krrish Dholakia
082f1e4085 fix(proxy_server.py): allow user to pass in spend logs collector url 2024-03-28 09:14:30 -07:00
Krrish Dholakia
1e856443e1 feat(proxy/utils.py): enable updating db in a separate server 2024-03-27 16:02:36 -07:00
Krrish Dholakia
9b7383ac67 fix(utils.py): don't run post-call rules on a coroutine function 2024-03-27 13:16:27 -07:00
Krrish Dholakia
d08da5b05a docs(instructor.md): improve default example 2024-03-27 12:51:05 -07:00
Krrish Dholakia
62a591f90c bump: version 1.34.6 → 1.34.7 2024-03-27 10:15:28 -07:00
Krrish Dholakia
6c34e48180 feat(index.ts): initial commit for proxy edge worker
testing to see if a js worker improves proxy perf (and by how much)
2024-03-27 10:15:20 -07:00
Krish Dholakia
d259c754ef
Merge pull request #2701 from rmann-nflx/main
Updating the default Claude3 max tokens
2024-03-27 10:14:20 -07:00
Krish Dholakia
b6be1ecb37
Merge pull request #2714 from readevalprint/patch-1
Fix #2713 Remove duplicated "blocked" field on LiteLLM_TeamTable
2024-03-27 10:13:56 -07:00
Tim
d939755a73
Remove duplicated "blocked" field on LiteLLM_TeamTable 2024-03-27 17:02:18 +01:00
Krrish Dholakia
90b859ebcb docs(token_auth.md): cleanup docs 2024-03-26 21:42:07 -07:00
Krrish Dholakia
282176c502 docs(token_auth.md): update docs 2024-03-26 21:41:08 -07:00
Krrish Dholakia
ca84e7a8e8 docs(token_auth.md): update jwt auth docs with new info 2024-03-26 21:33:03 -07:00
Krrish Dholakia
1d054c3e71 bump: version 1.34.5 → 1.34.6 2024-03-26 21:19:07 -07:00
Krrish Dholakia
9375b131ee refactor(main.py): trigger new build 2024-03-26 21:18:51 -07:00
Krrish Dholakia
b204f0c01c fix(proxy_cli.py): fix circular import issue 2024-03-26 21:16:41 -07:00
Krish Dholakia
c1f8d346b8
Merge pull request #2706 from BerriAI/litellm_key_llm_guardrails
feat(llm_guard.py): enable key-specific llm guard check
2024-03-26 19:02:11 -07:00
Krish Dholakia
e266142d2b
Merge pull request #2705 from BerriAI/litellm_permissions_table
enable new `/team/disable` endpoint
2024-03-26 18:47:34 -07:00
Krrish Dholakia
4488480188 test(test_llm_guard.py): fix test 2024-03-26 18:37:27 -07:00
Krrish Dholakia
f62f642393 test(test_llm_guard.py): fix test 2024-03-26 18:13:15 -07:00
Krrish Dholakia
5b66cb3864 test(test_exceptions.py): handle api instability 2024-03-26 18:06:49 -07:00
Ishaan Jaff
6d6549c6c8 (fix) kub.yaml 2024-03-26 18:05:55 -07:00
Ishaan Jaff
4d22fe0947 bump: version 1.34.4 → 1.34.5 2024-03-26 18:04:05 -07:00
Krrish Dholakia
bf7cc943fb docs(enterprise.md): update docs to turn on/off llm guard per key 2024-03-26 18:02:44 -07:00
Krrish Dholakia
1046a63521 test(test_llm_guard.py): unit testing for key-level llm guard enabling 2024-03-26 17:55:53 -07:00
Krrish Dholakia
6d418a2920 fix(llm_guard.py): working llm-guard 'key-specific' mode 2024-03-26 17:47:20 -07:00
Krrish Dholakia
e10eb8f6fe feat(llm_guard.py): enable key-specific llm guard check 2024-03-26 17:21:51 -07:00
Krrish Dholakia
bec093675c build(schema.prisma): update schema to enable team blocking 2024-03-26 17:03:32 -07:00
Krrish Dholakia
77472b80eb fix(proxy_server.py): use consistent naming schema - move to /team/block 2024-03-26 16:59:36 -07:00
Krish Dholakia
7eb2c7942c
Merge pull request #2675 from onukura/ollama-embedding
Fix Ollama embedding
2024-03-26 16:08:28 -07:00
Krish Dholakia
9d7aceb06e
Merge pull request #2697 from antoniomdk/fix-database-credentials-leakage
(fix) Remove print statements from append_query_params
2024-03-26 16:07:33 -07:00
Krish Dholakia
0ab708e6f1
Merge pull request #2704 from BerriAI/litellm_jwt_auth_improvements_3
fix(handle_jwt.py): enable team-based jwt-auth access
2024-03-26 16:06:56 -07:00
Krrish Dholakia
4f7ba902d8 feat(proxy_server.py): enable new /team/disable endpoint
reject all requests from this team id, without deleting it.
2024-03-26 15:40:50 -07:00
Krrish Dholakia
ea8f6672c5 test(test_jwt.py): fix test 2024-03-26 15:22:05 -07:00
Krrish Dholakia
7b37f4c05f fix(proxy_server.py): rename proxy roles param to litellm_jwtauth 2024-03-26 15:04:30 -07:00
Krrish Dholakia
4281f1545b fix(utils.py): check if item in list is pydantic object or dict before dereferencing 2024-03-26 14:39:16 -07:00
Krrish Dholakia
752516df1b fix(handle_jwt.py): support public key caching ttl param 2024-03-26 14:32:55 -07:00
Krrish Dholakia
d90f44fe8e fix(proxy_server.py): check if team scope in jwt 2024-03-26 14:01:02 -07:00
Krrish Dholakia
4d7f4550e2 test(test_batch_completions.py): handle anthropic overloaded error 2024-03-26 13:55:03 -07:00
Krrish Dholakia
6b1d2551d1 test(test_batch_completions.py): handle overloaded anthropic error 2024-03-26 13:53:18 -07:00
Krrish Dholakia
3a82ff2ef2 fix(utils.py): don't send subsequent chunks if last chunk sent
prevents multiple empty finish chunks from being sent
2024-03-26 13:49:42 -07:00
Krrish Dholakia
7d38c62717 fix(handle_jwt.py): enable team-based jwt-auth access
Move auth to check on ‘client_id’ not ‘sub
2024-03-26 12:25:38 -07:00
Ishaan Jaff
0f432dfb4b
Merge pull request #2703 from BerriAI/litellm_remove_litellm_telemetry
[Fix] remove litellm telemetry from proxy server
2024-03-26 11:35:18 -07:00
Ishaan Jaff
da503eab18
Merge branch 'main' into litellm_remove_litellm_telemetry 2024-03-26 11:35:02 -07:00
Ishaan Jaff
b6af44c4dc (fix) telemetry = false 2024-03-26 11:23:23 -07:00
Ishaan Jaff
6b4b05b58f (fix) remove litellm.telemetry 2024-03-26 11:21:09 -07:00
Ishaan Jaff
4d81df3d6f (docs) switch of litellm telemetry 2024-03-26 11:19:55 -07:00
Krish Dholakia
f3f56204c5
Update README.md 2024-03-26 10:34:16 -07:00
Krrish Dholakia
b4d0a95cff test(test_router_debug_logs.py): add info statement to log test 2024-03-26 09:54:26 -07:00
Krrish Dholakia
584d187e0e fix(utils.py): check if message is pydantic object or dict before dereferencing 2024-03-26 09:47:44 -07:00