Commit graph

9933 commits

Author SHA1 Message Date
Bram van Meurs
facdc795bb
Fix .dockerignore
Prefix slash does work on macos, but I suspect not on linux.
2024-04-12 11:06:24 +01:00
Krrish Dholakia
775d28a509 docs(token_auth.md): update docs to show org spend tracking 2024-04-11 23:34:34 -07:00
Krish Dholakia
a1cb9a51b9
Merge pull request #2978 from BerriAI/litellm_org_spend_tracking
fix(proxy_server.py): support tracking org spend
2024-04-11 23:19:33 -07:00
Krrish Dholakia
c480b5a008 bump: version 1.35.1 → 1.35.2 2024-04-11 23:16:39 -07:00
Krrish Dholakia
7a3821e0f6 fix(gemini.py): log system prompt in verbose output 2024-04-11 23:15:58 -07:00
Krrish Dholakia
77d6b882b8 fix(vertex_ai.py): check if 'response_mime_type' in generation config before passing it in 2024-04-11 23:10:59 -07:00
Krrish Dholakia
c377ba0755 fix(utils.py): vertex ai exception mapping
fixes check which caused all vertex errors to be ratelimit errors
2024-04-11 23:04:21 -07:00
Krrish Dholakia
f4c7f4f901 fix(proxy_server.py): support tracking org spend
currently works when org set for jwt auth
2024-04-11 23:01:21 -07:00
Krish Dholakia
d89644d46c
Merge pull request #2970 from BerriAI/litellm_keys
fix(handle_jwt.py): User cost tracking via JWT Auth
2024-04-11 21:44:15 -07:00
Krrish Dholakia
3665b890f8 build(proxy_server_config.yaml): cleanup config 2024-04-11 20:20:09 -07:00
Krrish Dholakia
77097f8e7d test(test_jwt.py): add testing to make sure user api key auth returns the expected values 2024-04-11 20:18:55 -07:00
Krrish Dholakia
67b5634417 fix(auth_checks.py): raise error if user doesn't exist in db 2024-04-11 19:55:04 -07:00
Krrish Dholakia
36ff593c02 feat(proxy_server.py): support cost tracking on user id via JWT-Auth
allows admin to track cost for LiteLLM_UserTable via JWT
2024-04-11 18:47:46 -07:00
Ishaan Jaff
8ba140b09e
Merge pull request #2965 from BerriAI/litellm_fix_key_update
fix - delete key from inMemory Cache after /key/update
2024-04-11 18:18:05 -07:00
Krrish Dholakia
e413191493 fix(handle_jwt.py): support firebase public key format
adds support for when the public keys are a json instead of nested inside a json
2024-04-11 18:07:13 -07:00
Krish Dholakia
cd834e9d52
Merge pull request #2964 from Manouchehri/gemini-json-mode-2962
Add JSON mode to Gemini (Vertex AI)
2024-04-11 17:51:27 -07:00
Krrish Dholakia
3b803b09d9 fix(langfuse.py): remove print statements 2024-04-11 17:23:41 -07:00
Ishaan Jaff
beabec620e fix - delete updated keys from cache 2024-04-11 17:21:44 -07:00
Krrish Dholakia
bdfb74f8a5 test(test_openai_endpoints.py): add local test, for proxy concurrency 2024-04-11 17:16:23 -07:00
David Manouchehri
9c55be3e82
(feat) - Bump version for Vertex AI SDK. 2024-04-12 00:03:32 +00:00
David Manouchehri
05350037be
(feat) - Extreme dirty hack for response_mime_type in Vertex AI. 2024-04-12 00:03:31 +00:00
David Manouchehri
d08674bf2f
(feat) - Dirty hack to get response_mime_type working before it's released in the Python SDK. 2024-04-12 00:03:30 +00:00
David Manouchehri
649c3bb0dd
(feat) - Add support for JSON mode in Vertex AI 2024-04-12 00:03:29 +00:00
Ishaan Jaff
6e934cb842 docs fix team based routing 2024-04-11 15:23:25 -07:00
Ishaan Jaff
68e0c93246 fix - better debugging for adding new models 2024-04-11 14:49:00 -07:00
Ishaan Jaff
79451242c8
Merge pull request #2892 from gregnwosu/patch-1
created defaults for response["eval_count"]
2024-04-11 13:40:32 -07:00
Ishaan Jaff
f103f395b5
Merge pull request #2959 from BerriAI/litellm_fix_issue_adding_models_ui
fix - issue when loading models through ui
2024-04-11 13:07:58 -07:00
Ishaan Jaff
fc832f2196 fix - issue when loading models through ui 2024-04-11 13:06:10 -07:00
Ishaan Jaff
b773133160
Merge pull request #2958 from BerriAI/litellm_ui_add_fallback/_ogin
Litellm UI add fallback-login
2024-04-11 11:49:40 -07:00
Ishaan Jaff
5f95260cf5 ui - show fallback login 2024-04-11 11:48:40 -07:00
Ishaan Jaff
f2467ba4e3 fix - show correct fallback login 2024-04-11 11:48:03 -07:00
Ishaan Jaff
0b964ea7ff fix - point to fallback login 2024-04-11 11:41:44 -07:00
Ishaan Jaff
7cb40d3b35 UI - add /fallback/login route 2024-04-11 11:20:41 -07:00
Ishaan Jaff
64904e2ab1
Merge pull request #2956 from BerriAI/litellm_fix_imghdr
fix - stop using imghdr
2024-04-11 09:55:47 -07:00
Ishaan Jaff
9465288e9e migration script 2024-04-11 09:55:14 -07:00
Ishaan Jaff
fb657423ee fix - stop using imghdr 2024-04-11 09:32:42 -07:00
Krrish Dholakia
c597d610f3 bump: version 1.35.0 → 1.35.1 2024-04-11 09:28:26 -07:00
Krrish Dholakia
84d43484c6 fix(router.py): make sure pre call rpm check runs even when model not in model cost map 2024-04-11 09:27:46 -07:00
Ishaan Jaff
240aaf7af8 fix - show api_base in migration script 2024-04-11 09:26:13 -07:00
Ishaan Jaff
69c095b768
Merge pull request #2953 from BerriAI/litellm_fix_sec_issue
[security fix - Low Severity] - disable demo accounts
2024-04-11 08:07:24 -07:00
Ishaan Jaff
96cd038a73 security fix - disable demo accounts 2024-04-11 07:40:34 -07:00
Ishaan Jaff
1c1b0f929f fix - migration script for /model/new 2024-04-11 07:34:00 -07:00
Krish Dholakia
78571babb3
Merge pull request #2830 from onukura/onukura-patch-1
Update README.md
2024-04-11 06:47:53 -07:00
Krrish Dholakia
d999acd20d docs(routing.md): reorder routing strategies 2024-04-10 22:29:24 -07:00
Krrish Dholakia
83a7a9f0b7 docs(routing.md): add calling via proxy tutorial to router docs 2024-04-10 22:24:29 -07:00
Krish Dholakia
6749306239
Merge pull request #2945 from ushuz/hotfix
Fix image generation pre call hook call type
2024-04-10 21:53:00 -07:00
Krrish Dholakia
9f517b2907 docs(routing.md): add async usage based routing to docs 2024-04-10 21:51:36 -07:00
Krrish Dholakia
b8bd7bde1e bump: version 1.34.42 → 1.35.0 2024-04-10 21:45:44 -07:00
Krrish Dholakia
623613203a refactor(main.py): trigger new build
contains fixes for async batch get
2024-04-10 21:45:06 -07:00
Krrish Dholakia
76bd667b12 fix(caching.py): fix async batch redis get request 2024-04-10 21:37:45 -07:00