Ishaan Jaff
15c04da735
refactor tests
2025-03-26 20:00:10 -07:00
Ishaan Jaff
88ef97b9d1
allow proxy to startup on DB unavailable
2025-03-26 19:50:57 -07:00
Ishaan Jaff
497570b2a6
bug fix - allow pods to startup when DB is unavailable
2025-03-26 19:49:51 -07:00
Ishaan Jaff
7142b0b610
refactor PrismaDBExceptionHandler
2025-03-26 19:22:24 -07:00
Ishaan Jaff
0155b0eba2
Merge pull request #9533 from BerriAI/litellm_stability_fixes
...
[Reliability Fixes] - Gracefully handle exceptions when DB is having an outage
2025-03-26 18:57:38 -07:00
Krish Dholakia
37265c8b1c
Add Daily User Spend Aggregate view - allows UI Usage tab to work > 1m rows ( #9538 )
...
* ci: update github action
* build(schema.prisma): enable daily user spend table
allows storing aggregate view of user's daily spend
* build(schema.prisma): add new daily user spend table
* feat: working daily user spend tracking
maintains an aggregate view for easier querying in high traffic
* setup_google_dns
* ci: update ci yaml
---------
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
2025-03-26 16:36:36 -07:00
Ishaan Jaff
23aa7f81b5
fix ProxyException
2025-03-26 15:53:33 -07:00
Ishaan Jaff
ff33ed020c
fix auth checks
2025-03-26 15:45:58 -07:00
Ishaan Jaff
8bd2081dec
fix get_key_object
2025-03-26 15:41:40 -07:00
Ishaan Jaff
f8caebc54b
is_database_connection_error
2025-03-26 14:55:40 -07:00
Ishaan Jaff
044c56c439
Merge branch 'main' into litellm_stability_fixes
2025-03-26 14:41:43 -07:00
Ishaan Jaff
22dfc4dea9
fix user_api_key_auth example config
2025-03-26 08:36:11 -07:00
Krish Dholakia
6fd18651d1
Support litellm.api_base for vertex_ai + gemini/ across completion, embedding, image_generation ( #9516 )
...
Read Version from pyproject.toml / read-version (push) Successful in 19s
Helm unit test / unit-test (push) Successful in 20s
* test(tests): add unit testing for litellm_proxy integration
* fix(cost_calculator.py): fix tracking cost in sdk when calling proxy
* fix(main.py): respect litellm.api_base on `vertex_ai/` and `gemini/` routes
* fix(main.py): consistently support custom api base across gemini + vertexai on embedding + completion
* feat(vertex_ai/): test
* fix: fix linting error
* test: set api base as None before starting loadtest
2025-03-25 23:46:20 -07:00
Ishaan Jaff
b4e745323a
add test config
2025-03-25 19:21:51 -07:00
Ishaan Jaff
ce49e27217
fixes for auth checks
2025-03-25 15:44:13 -07:00
Ishaan Jaff
59040167ac
fix ProxyErrorTypes
2025-03-25 14:40:11 -07:00
Ishaan Jaff
4c87084ff7
UserAPIKeyAuthExceptionHandler
2025-03-25 14:07:14 -07:00
Krish Dholakia
bd309a28c5
Merge pull request #9512 from BerriAI/litellm_dev_03_24_2025_p3
...
fix(invoke_handler.py): remove hard coded chunk on streaming usage
2025-03-24 21:21:36 -07:00
Ishaan Jaff
863fe3a4d2
fix import mcp router
2025-03-24 21:08:24 -07:00
Ishaan Jaff
fb3a67ba8d
fix code quality
2025-03-24 21:06:17 -07:00
Ishaan Jaff
dcc2edbd4d
fix mcp import
2025-03-24 21:02:54 -07:00
Ishaan Jaff
08a4ba1b7e
Merge branch 'main' into litellm_exp_mcp_server
2025-03-24 19:03:56 -07:00
Ishaan Jaff
002837f962
fix linting errors
2025-03-24 18:48:43 -07:00
Krrish Dholakia
5089dbfcfb
fix(invoke_handler.py): remove hard code
2025-03-24 17:58:26 -07:00
Krrish Dholakia
6a0cf3db50
fix(litellm_logging.py): always log the api base
...
Fixes issue where api base missing from spend logs due to refactor
2025-03-24 13:45:39 -07:00
Ishaan Jaff
8b8fca1e20
fix mcp type imports
2025-03-24 11:01:29 -07:00
Ishaan Jaff
5017332690
fix pydantic import error
2025-03-24 07:11:48 -07:00
Tyler Hutcherson
7864cd1f76
update redisvl dependency
2025-03-24 08:42:11 -04:00
Ishaan Jaff
f21a0c2da7
Merge branch 'main' into litellm_exp_mcp_server
2025-03-22 18:51:25 -07:00
Krrish Dholakia
790e063044
fix: fix linting error
2025-03-22 17:56:39 -07:00
Krrish Dholakia
59e14fc45c
fix(router.py): fix get_model_list to return all wildcard models
...
enables viewing all wildcard models on `/model/info`
2025-03-22 15:39:23 -07:00
Krrish Dholakia
f859c6ac0f
fix(llm_passthrough_endpoints.py): fix raising helpful debug error message
2025-03-22 15:06:16 -07:00
Krrish Dholakia
fe004bc45c
build: cleanup unused files
2025-03-22 12:54:11 -07:00
Krrish Dholakia
92d4486a2c
fix(llm_passthrough_endpoints.py): raise verbose error if credentials not found on proxy
2025-03-22 11:49:51 -07:00
Krrish Dholakia
06e69a414e
fix(vertex_ai/common_utils.py): fix handling constructed url with default vertex config
2025-03-22 11:32:01 -07:00
Krrish Dholakia
b44b3bd36b
feat(llm_passthrough_endpoints.py): base case passing for refactored vertex passthrough route
2025-03-22 11:06:52 -07:00
Krrish Dholakia
94d3413335
refactor(llm_passthrough_endpoints.py): refactor vertex passthrough to use common llm passthrough handler.py
2025-03-22 10:42:46 -07:00
Krrish Dholakia
f0d047a0e4
fix: fix linting error
2025-03-21 18:23:58 -07:00
Krrish Dholakia
8b0c75d88f
fix: fix linting error
2025-03-21 18:08:00 -07:00
Krrish Dholakia
2d1082f520
fix(proxy/_types.py): handle user_email=None
2025-03-21 17:46:18 -07:00
Krrish Dholakia
6034187aa5
fix: remove unused import
2025-03-21 17:25:57 -07:00
Krrish Dholakia
4b49dab717
fix: remove unused import
2025-03-21 17:22:58 -07:00
Krrish Dholakia
95ef5f1009
refactor(user_api_key_auth.py): move is_route_allowed to inside common_checks
...
ensures consistent behaviour inside api key + jwt routes
2025-03-21 17:21:07 -07:00
Krrish Dholakia
91cf3fc40d
test: initial e2e testing to ensure non admin jwt token cannot create new teams
2025-03-21 16:40:18 -07:00
Ishaan Jaff
fd95499e15
fix naming
2025-03-20 21:57:28 -07:00
Ishaan Jaff
7826c9bd21
add litellm mcp endpoints
2025-03-20 21:12:56 -07:00
Krrish Dholakia
0e0925fccf
fix(team_endpoints.py): consistently return 404 if team not found in DB
...
Fixes response on /team/delete
2025-03-20 20:28:03 -07:00
Krrish Dholakia
532af66bbd
feat(pass_through_endpoints.py): return api base on pass-through exception
...
enables easy debugging on backend api errors
2025-03-20 20:19:52 -07:00
Krrish Dholakia
943e036851
feat(pass_through_endpoints.py): support returning api-base on pass-through endpoints
...
Make it easier to debug what the api base sent to provider was
2025-03-20 20:11:49 -07:00
Ishaan Jaff
2afa73d584
fix mcp router
2025-03-20 18:05:14 -07:00
