Commit graph

4673 commits

Author SHA1 Message Date
Ishaan Jaff
23aa7f81b5 fix ProxyException 2025-03-26 15:53:33 -07:00
Ishaan Jaff
ff33ed020c fix auth checks 2025-03-26 15:45:58 -07:00
Ishaan Jaff
8bd2081dec fix get_key_object 2025-03-26 15:41:40 -07:00
Ishaan Jaff
f8caebc54b is_database_connection_error 2025-03-26 14:55:40 -07:00
Ishaan Jaff
044c56c439 Merge branch 'main' into litellm_stability_fixes 2025-03-26 14:41:43 -07:00
Ishaan Jaff
22dfc4dea9 fix user_api_key_auth example config 2025-03-26 08:36:11 -07:00
Krish Dholakia
6fd18651d1
Support litellm.api_base for vertex_ai + gemini/ across completion, embedding, image_generation (#9516)
All checks were successful
Read Version from pyproject.toml / read-version (push) Successful in 19s
Helm unit test / unit-test (push) Successful in 20s
* test(tests): add unit testing for litellm_proxy integration

* fix(cost_calculator.py): fix tracking cost in sdk when calling proxy

* fix(main.py): respect litellm.api_base on `vertex_ai/` and `gemini/` routes

* fix(main.py): consistently support custom api base across gemini + vertexai on embedding + completion

* feat(vertex_ai/): test

* fix: fix linting error

* test: set api base as None before starting loadtest
2025-03-25 23:46:20 -07:00
Ishaan Jaff
b4e745323a add test config 2025-03-25 19:21:51 -07:00
Ishaan Jaff
ce49e27217 fixes for auth checks 2025-03-25 15:44:13 -07:00
Ishaan Jaff
59040167ac fix ProxyErrorTypes 2025-03-25 14:40:11 -07:00
Ishaan Jaff
4c87084ff7 UserAPIKeyAuthExceptionHandler 2025-03-25 14:07:14 -07:00
Krish Dholakia
bd309a28c5
Merge pull request #9512 from BerriAI/litellm_dev_03_24_2025_p3
fix(invoke_handler.py): remove hard coded chunk on streaming usage
2025-03-24 21:21:36 -07:00
Ishaan Jaff
863fe3a4d2 fix import mcp router 2025-03-24 21:08:24 -07:00
Ishaan Jaff
fb3a67ba8d fix code quality 2025-03-24 21:06:17 -07:00
Ishaan Jaff
dcc2edbd4d fix mcp import 2025-03-24 21:02:54 -07:00
Ishaan Jaff
08a4ba1b7e Merge branch 'main' into litellm_exp_mcp_server 2025-03-24 19:03:56 -07:00
Ishaan Jaff
002837f962 fix linting errors 2025-03-24 18:48:43 -07:00
Krrish Dholakia
5089dbfcfb fix(invoke_handler.py): remove hard code 2025-03-24 17:58:26 -07:00
Krrish Dholakia
6a0cf3db50 fix(litellm_logging.py): always log the api base
Fixes issue where api base missing from spend logs due to refactor
2025-03-24 13:45:39 -07:00
Ishaan Jaff
8b8fca1e20 fix mcp type imports 2025-03-24 11:01:29 -07:00
Ishaan Jaff
5017332690 fix pydantic import error 2025-03-24 07:11:48 -07:00
Tyler Hutcherson
7864cd1f76 update redisvl dependency 2025-03-24 08:42:11 -04:00
Ishaan Jaff
f21a0c2da7 Merge branch 'main' into litellm_exp_mcp_server 2025-03-22 18:51:25 -07:00
Krrish Dholakia
790e063044 fix: fix linting error 2025-03-22 17:56:39 -07:00
Krrish Dholakia
59e14fc45c fix(router.py): fix get_model_list to return all wildcard models
enables viewing all wildcard models on `/model/info`
2025-03-22 15:39:23 -07:00
Krrish Dholakia
f859c6ac0f fix(llm_passthrough_endpoints.py): fix raising helpful debug error message 2025-03-22 15:06:16 -07:00
Krrish Dholakia
fe004bc45c build: cleanup unused files 2025-03-22 12:54:11 -07:00
Krrish Dholakia
92d4486a2c fix(llm_passthrough_endpoints.py): raise verbose error if credentials not found on proxy 2025-03-22 11:49:51 -07:00
Krrish Dholakia
06e69a414e fix(vertex_ai/common_utils.py): fix handling constructed url with default vertex config 2025-03-22 11:32:01 -07:00
Krrish Dholakia
b44b3bd36b feat(llm_passthrough_endpoints.py): base case passing for refactored vertex passthrough route 2025-03-22 11:06:52 -07:00
Krrish Dholakia
94d3413335 refactor(llm_passthrough_endpoints.py): refactor vertex passthrough to use common llm passthrough handler.py 2025-03-22 10:42:46 -07:00
Krrish Dholakia
f0d047a0e4 fix: fix linting error 2025-03-21 18:23:58 -07:00
Krrish Dholakia
8b0c75d88f fix: fix linting error 2025-03-21 18:08:00 -07:00
Krrish Dholakia
2d1082f520 fix(proxy/_types.py): handle user_email=None 2025-03-21 17:46:18 -07:00
Krrish Dholakia
6034187aa5 fix: remove unused import 2025-03-21 17:25:57 -07:00
Krrish Dholakia
4b49dab717 fix: remove unused import 2025-03-21 17:22:58 -07:00
Krrish Dholakia
95ef5f1009 refactor(user_api_key_auth.py): move is_route_allowed to inside common_checks
ensures consistent behaviour inside api key + jwt routes
2025-03-21 17:21:07 -07:00
Krrish Dholakia
91cf3fc40d test: initial e2e testing to ensure non admin jwt token cannot create new teams 2025-03-21 16:40:18 -07:00
Ishaan Jaff
fd95499e15 fix naming 2025-03-20 21:57:28 -07:00
Ishaan Jaff
7826c9bd21 add litellm mcp endpoints 2025-03-20 21:12:56 -07:00
Krrish Dholakia
0e0925fccf fix(team_endpoints.py): consistently return 404 if team not found in DB
Fixes response on /team/delete
2025-03-20 20:28:03 -07:00
Krrish Dholakia
532af66bbd feat(pass_through_endpoints.py): return api base on pass-through exception
enables easy debugging on backend api errors
2025-03-20 20:19:52 -07:00
Krrish Dholakia
943e036851 feat(pass_through_endpoints.py): support returning api-base on pass-through endpoints
Make it easier to debug what the api base sent to provider was
2025-03-20 20:11:49 -07:00
Ishaan Jaff
2afa73d584 fix mcp router 2025-03-20 18:05:14 -07:00
Ishaan Jaff
4dec84f883 cleanup 2025-03-20 18:02:02 -07:00
Ishaan Jaff
08d6ea37ef remove stale file 2025-03-20 17:59:19 -07:00
Ishaan Jaff
8909e24efc add mcp routes 2025-03-20 17:58:33 -07:00
Ishaan Jaff
f44a5a86db litellm mcp routes 2025-03-20 17:55:43 -07:00
Ishaan Jaff
dc33cfa074 init global_mcp_tool_registry 2025-03-20 17:53:37 -07:00
Ishaan Jaff
45ee1182ae example mcp tools 2025-03-20 17:53:20 -07:00