Krish Dholakia
37265c8b1c
Add Daily User Spend Aggregate view - allows UI Usage tab to work > 1m rows ( #9538 )
...
* ci: update github action
* build(schema.prisma): enable daily user spend table
allows storing aggregate view of user's daily spend
* build(schema.prisma): add new daily user spend table
* feat: working daily user spend tracking
maintains an aggregate view for easier querying in high traffic
* setup_google_dns
* ci: update ci yaml
---------
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
2025-03-26 16:36:36 -07:00
Ishaan Jaff
22dfc4dea9
fix user_api_key_auth example config
2025-03-26 08:36:11 -07:00
Krish Dholakia
6fd18651d1
Support litellm.api_base for vertex_ai + gemini/ across completion, embedding, image_generation ( #9516 )
...
Read Version from pyproject.toml / read-version (push) Successful in 19s
Helm unit test / unit-test (push) Successful in 20s
* test(tests): add unit testing for litellm_proxy integration
* fix(cost_calculator.py): fix tracking cost in sdk when calling proxy
* fix(main.py): respect litellm.api_base on `vertex_ai/` and `gemini/` routes
* fix(main.py): consistently support custom api base across gemini + vertexai on embedding + completion
* feat(vertex_ai/): test
* fix: fix linting error
* test: set api base as None before starting loadtest
2025-03-25 23:46:20 -07:00
Krish Dholakia
bd309a28c5
Merge pull request #9512 from BerriAI/litellm_dev_03_24_2025_p3
...
fix(invoke_handler.py): remove hard coded chunk on streaming usage
2025-03-24 21:21:36 -07:00
Ishaan Jaff
863fe3a4d2
fix import mcp router
2025-03-24 21:08:24 -07:00
Ishaan Jaff
fb3a67ba8d
fix code quality
2025-03-24 21:06:17 -07:00
Ishaan Jaff
dcc2edbd4d
fix mcp import
2025-03-24 21:02:54 -07:00
Ishaan Jaff
08a4ba1b7e
Merge branch 'main' into litellm_exp_mcp_server
2025-03-24 19:03:56 -07:00
Ishaan Jaff
002837f962
fix linting errors
2025-03-24 18:48:43 -07:00
Krrish Dholakia
5089dbfcfb
fix(invoke_handler.py): remove hard code
2025-03-24 17:58:26 -07:00
Krrish Dholakia
6a0cf3db50
fix(litellm_logging.py): always log the api base
...
Fixes issue where api base missing from spend logs due to refactor
2025-03-24 13:45:39 -07:00
Ishaan Jaff
8b8fca1e20
fix mcp type imports
2025-03-24 11:01:29 -07:00
Ishaan Jaff
5017332690
fix pydantic import error
2025-03-24 07:11:48 -07:00
Tyler Hutcherson
7864cd1f76
update redisvl dependency
2025-03-24 08:42:11 -04:00
Ishaan Jaff
f21a0c2da7
Merge branch 'main' into litellm_exp_mcp_server
2025-03-22 18:51:25 -07:00
Krrish Dholakia
790e063044
fix: fix linting error
2025-03-22 17:56:39 -07:00
Krrish Dholakia
59e14fc45c
fix(router.py): fix get_model_list to return all wildcard models
...
enables viewing all wildcard models on `/model/info`
2025-03-22 15:39:23 -07:00
Krrish Dholakia
f859c6ac0f
fix(llm_passthrough_endpoints.py): fix raising helpful debug error message
2025-03-22 15:06:16 -07:00
Krrish Dholakia
fe004bc45c
build: cleanup unused files
2025-03-22 12:54:11 -07:00
Krrish Dholakia
92d4486a2c
fix(llm_passthrough_endpoints.py): raise verbose error if credentials not found on proxy
2025-03-22 11:49:51 -07:00
Krrish Dholakia
06e69a414e
fix(vertex_ai/common_utils.py): fix handling constructed url with default vertex config
2025-03-22 11:32:01 -07:00
Krrish Dholakia
b44b3bd36b
feat(llm_passthrough_endpoints.py): base case passing for refactored vertex passthrough route
2025-03-22 11:06:52 -07:00
Krrish Dholakia
94d3413335
refactor(llm_passthrough_endpoints.py): refactor vertex passthrough to use common llm passthrough handler.py
2025-03-22 10:42:46 -07:00
Krrish Dholakia
f0d047a0e4
fix: fix linting error
2025-03-21 18:23:58 -07:00
Krrish Dholakia
8b0c75d88f
fix: fix linting error
2025-03-21 18:08:00 -07:00
Krrish Dholakia
2d1082f520
fix(proxy/_types.py): handle user_email=None
2025-03-21 17:46:18 -07:00
Krrish Dholakia
6034187aa5
fix: remove unused import
2025-03-21 17:25:57 -07:00
Krrish Dholakia
4b49dab717
fix: remove unused import
2025-03-21 17:22:58 -07:00
Krrish Dholakia
95ef5f1009
refactor(user_api_key_auth.py): move is_route_allowed to inside common_checks
...
ensures consistent behaviour inside api key + jwt routes
2025-03-21 17:21:07 -07:00
Krrish Dholakia
91cf3fc40d
test: initial e2e testing to ensure non admin jwt token cannot create new teams
2025-03-21 16:40:18 -07:00
Ishaan Jaff
fd95499e15
fix naming
2025-03-20 21:57:28 -07:00
Ishaan Jaff
7826c9bd21
add litellm mcp endpoints
2025-03-20 21:12:56 -07:00
Krrish Dholakia
0e0925fccf
fix(team_endpoints.py): consistently return 404 if team not found in DB
...
Fixes response on /team/delete
2025-03-20 20:28:03 -07:00
Krrish Dholakia
532af66bbd
feat(pass_through_endpoints.py): return api base on pass-through exception
...
enables easy debugging on backend api errors
2025-03-20 20:19:52 -07:00
Krrish Dholakia
943e036851
feat(pass_through_endpoints.py): support returning api-base on pass-through endpoints
...
Make it easier to debug what the api base sent to provider was
2025-03-20 20:11:49 -07:00
Ishaan Jaff
2afa73d584
fix mcp router
2025-03-20 18:05:14 -07:00
Ishaan Jaff
4dec84f883
cleanup
2025-03-20 18:02:02 -07:00
Ishaan Jaff
08d6ea37ef
remove stale file
2025-03-20 17:59:19 -07:00
Ishaan Jaff
8909e24efc
add mcp routes
2025-03-20 17:58:33 -07:00
Ishaan Jaff
f44a5a86db
litellm mcp routes
2025-03-20 17:55:43 -07:00
Ishaan Jaff
dc33cfa074
init global_mcp_tool_registry
2025-03-20 17:53:37 -07:00
Ishaan Jaff
45ee1182ae
example mcp tools
2025-03-20 17:53:20 -07:00
Ishaan Jaff
89cc404a57
add mcp tool registry
2025-03-20 17:51:03 -07:00
Ishaan Jaff
5377daeede
add MCPToolRegistry
2025-03-20 17:22:12 -07:00
Ishaan Jaff
9f22cf729a
mock config for MCP tools
2025-03-20 17:16:55 -07:00
Ishaan Jaff
93836fa84a
sample mcp server
2025-03-20 15:37:24 -07:00
Krish Dholakia
7cf7e80c5a
Merge pull request #9395 from BerriAI/litellm_ui_fixes_03_19_2025
...
Read Version from pyproject.toml / read-version (push) Successful in 18s
Helm unit test / unit-test (push) Successful in 21s
fix(internal_user_endpoints.py): re-introduce upsert on user not found
2025-03-19 22:58:32 -07:00
Ishaan Jaff
1bd7443c25
Merge pull request #9384 from BerriAI/litellm_prompt_management_custom
...
[Feat] - Allow building custom prompt management integration
2025-03-19 21:06:41 -07:00
Ishaan Jaff
247e4d09ee
Merge branch 'main' into litellm_fix_ssl_verify
2025-03-19 21:03:06 -07:00
Krrish Dholakia
07b1e6aa1c
fix(internal_user_endpoints.py): re-introduce upsert on user not found
...
Fixes https://github.com/BerriAI/litellm/issues/9243
2025-03-19 19:28:11 -07:00
