Ishaan Jaff
a61925448a
fix import mcp router
2025-03-24 21:08:24 -07:00
Ishaan Jaff
dc899570ce
fix code quality
2025-03-24 21:06:17 -07:00
Ishaan Jaff
a616375b3c
fix mcp import
2025-03-24 21:02:54 -07:00
Ishaan Jaff
f600899ff7
fix linting errors
2025-03-24 18:48:43 -07:00
Ishaan Jaff
d4b53d3fa9
fix mcp type imports
2025-03-24 11:01:29 -07:00
Ishaan Jaff
f133bb07d1
fix pydantic import error
2025-03-24 07:11:48 -07:00
Ishaan Jaff
9760b030e3
fix naming
2025-03-20 21:57:28 -07:00
Ishaan Jaff
616c4db12d
add litellm mcp endpoints
2025-03-20 21:12:56 -07:00
Ishaan Jaff
7a93ec2b94
cleanup
2025-03-20 18:02:02 -07:00
Ishaan Jaff
d9c77da113
remove stale file
2025-03-20 17:59:19 -07:00
Ishaan Jaff
7023e8589a
add mcp routes
2025-03-20 17:58:33 -07:00
Ishaan Jaff
34253195ab
litellm mcp routes
2025-03-20 17:55:43 -07:00
Ishaan Jaff
8e600945c9
add mcp tool registry
2025-03-20 17:51:03 -07:00
Ishaan Jaff
63d454bb8d
add MCPToolRegistry
2025-03-20 17:22:12 -07:00
Ishaan Jaff
d704f357fd
sample mcp server
2025-03-20 15:37:24 -07:00
Krrish Dholakia
60f6e1d379
fix(lowest_tpm_rpm_v2.py): support batch writing increments to redis
2025-03-18 19:09:53 -07:00
Ishaan Jaff
27494ca5e7
ui new build
2025-03-18 11:46:23 -07:00
Ishaan Jaff
9c13b14ae8
ui new build
2025-03-14 21:46:40 -07:00
Ishaan Jaff
b339df0a64
ui new build
2025-03-14 21:29:42 -07:00
Ishaan Jaff
ade528369b
ui new build
2025-03-14 21:23:13 -07:00
Krrish Dholakia
fe148e3dec
feat(proxy_server.py): support retrieving models for a team, if user is a member - via /models?team_id
...
Allows user to see team models on UI when creating a key
2025-03-14 19:34:06 -07:00
Krrish Dholakia
1abce5c47b
build: new ui build
2025-03-14 18:18:03 -07:00
Krrish Dholakia
7d7b57e3b2
style: cleanup credential from leftnav - now in models tab
2025-03-14 10:14:21 -07:00
Ishaan Jaff
3c0bb08d41
ui new build
2025-03-13 21:44:32 -07:00
Krrish Dholakia
e0fbfb5e35
fix(azure/audio_transcriptions.py): support azure cost tracking
...
extract content time and log correctly as duration
2025-03-11 22:25:13 -07:00
Ishaan Jaff
a5634265aa
ui new build
2025-03-11 12:22:12 -07:00
Ishaan Jaff
010b1c8b1e
ui new build
2025-03-10 21:05:00 -07:00
Krish Dholakia
9fc7bd0493
UI - new API Playground for testing LiteLLM translation ( #9073 )
...
* feat: initial commit - enable dev to see translated request
* feat(utils.py): expose new endpoint - `/utils/transform_request` to see the raw request sent by litellm
* feat(transform_request.tsx): allow user to see their transformed request
* refactor(litellm_logging.py): return raw request in 3 parts - api_base, headers, request body
easier to render each individually on UI vs. extracting from combined string
* feat: transform_request.tsx
working e2e raw request viewing
* fix(litellm_logging.py): fix transform viewing for bedrock models
* fix(litellm_logging.py): don't return sensitive headers in raw request headers
prevent accidental leak
* feat(transform_request.tsx): style improvements
2025-03-07 19:39:31 -08:00
Ishaan Jaff
0b6d7f7828
ui new build
2025-03-06 21:22:58 -08:00
Ishaan Jaff
f73c03737f
Revert "ui new build"
...
This reverts commit 94563ab1e7
.
2025-03-04 13:28:54 -08:00
Krrish Dholakia
e2d25f0e18
build: merge litellm_dev_03_01_2025_p2
2025-03-03 23:05:41 -08:00
Ishaan Jaff
bd2231400f
ui new build
2025-03-03 22:21:31 -08:00
Krrish Dholakia
225f5124db
build: merge branch
2025-03-02 08:31:57 -08:00
Ishaan Jaff
7ddf427144
ui new build
2025-03-01 17:52:14 -08:00
Ishaan Jaff
03274e202e
ui new build
2025-02-28 20:12:06 -08:00
Krish Dholakia
6e35f7ae4d
Fix calling claude via invoke route + response_format support for claude on invoke route ( #8908 )
...
* fix(anthropic_claude3_transformation.py): fix amazon anthropic claude 3 tool calling transformation on invoke route
move to using anthropic config as base
* fix(utils.py): expose anthropic config via providerconfigmanager
* fix(llm_http_handler.py): support json mode on async completion calls
* fix(invoke_handler/make_call): support json mode for anthropic called via bedrock invoke
* fix(anthropic/): handle 'response_format: {"type": "text"}` + migrate amazon claude 3 invoke config to inherit from anthropic config
Prevents error when passing in 'response_format: {"type": "text"}
* test: fix test
* fix(utils.py): fix base invoke provider check
* fix(anthropic_claude3_transformation.py): don't pass 'stream' param
* fix: fix linting errors
* fix(converse_transformation.py): handle response_format type=text for converse
2025-02-28 17:56:26 -08:00
Ishaan Jaff
cea52a1e64
ui new build
2025-02-27 20:09:44 -08:00
Krrish Dholakia
6f51f40a3f
build: merge squashed commit
...
Squashed commit of the following:
commit 6678e15381
Author: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Date: Wed Feb 26 09:29:15 2025 -0800
test_prompt_caching
commit bd86e0ac47
Author: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Date: Wed Feb 26 08:57:16 2025 -0800
test_prompt_caching
commit 2fc21ad51e
Author: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Date: Wed Feb 26 08:13:45 2025 -0800
test_aprompt_caching
commit d94cff55ff
Author: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Date: Wed Feb 26 08:13:12 2025 -0800
test_prompt_caching
commit 49c5e7811e
Author: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Date: Wed Feb 26 07:43:53 2025 -0800
ui new build
commit cb8d5e5917
Author: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Date: Wed Feb 26 07:38:56 2025 -0800
(UI) - Create Key flow for existing users (#8844 )
* working create user button
* working create user for a key flow
* allow searching users
* working create user + key
* use clear sections on create key
* better search for users
* fix create key
* ui fix create key button - make it neater / cleaner
* ui fix all keys table
commit 335ba30467
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date: Wed Feb 26 08:53:17 2025 -0800
fix: fix file name
commit b8c5b31a4e
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date: Tue Feb 25 22:54:46 2025 -0800
fix: fix utils
commit ac6e503461
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date: Mon Feb 24 10:43:31 2025 -0800
fix(main.py): fix openai message for assistant msg if role is missing - openai allows this
Fixes https://github.com/BerriAI/litellm/issues/8661
commit de3989dbc5
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date: Mon Feb 24 21:19:25 2025 -0800
fix(get_litellm_params.py): handle no-log being passed in via kwargs
Fixes https://github.com/BerriAI/litellm/issues/8380
2025-02-26 09:39:27 -08:00
Ishaan Jaff
409e9f11ce
ui new build
2025-02-26 07:43:53 -08:00
Ishaan Jaff
65f47e26c0
ui new build
2025-02-25 20:03:03 -08:00
Krish Dholakia
d264fdd621
Litellm dev 02 25 2025 p1 ( #8816 )
...
* build(model_prices_and_context_window.json): add bedrock cross-region inferencing model information
Closes https://github.com/BerriAI/litellm/issues/8801#issuecomment-2683438528
* build(model_prices_and_context_window.json): add claude sonnet `-latest` models to model cost map
Closes https://github.com/BerriAI/litellm/discussions/8770#discussioncomment-12318880
* build(model_prices_and_context_window.json): add remaining anthropic `-latest` models to model cost map
Closes https://github.com/BerriAI/litellm/discussions/8770#discussioncomment-12318880
* test: update test with new model
2025-02-25 15:20:39 -08:00
Ishaan Jaff
cd2b9aa552
ui new build
2025-02-24 23:51:00 -08:00
Ishaan Jaff
9b1a4ff131
ui new build
2025-02-21 19:31:59 -08:00
Ishaan Jaff
7af8c6210c
ui new build
2025-02-20 18:40:21 -08:00
Krrish Dholakia
e58507ae72
build: extract <think>..</think> block for amazon deepseek r1 and put in reasoning_content
2025-02-19 21:10:38 -08:00
Ishaan Jaff
1d9070066a
ui new build
2025-02-19 20:09:51 -08:00
Ishaan Jaff
752e93cbdb
(UI + Proxy) Cache Health Check Page - Cleanup/Improvements ( #8665 )
...
* fixes for redis cache ping serialization
* fix cache ping check
* fix cache health check ui
* working error details on ui
* ui expand / collapse error
* move cache health check to diff file
* fix displaying error from cache health check
* ui allow copying errors
* ui cache health fixes
* show redis details
* clean up cache health page
* ui polish fixes
* fix error handling on cache health page
* fix redis_cache_params on cache ping response
* error handling
* cache health ping response
* fx error response from cache ping
* parsedLitellmParams
* fix cache health check
* fix cache health page
* cache safely handle json dumps issues
* test caching routes
* test_primitive_types
* fix caching routes
* litellm_mapped_tests
* fix pytest-mock
* fix _serialize
* fix linting on safe dumps
* test_default_max_depth
* pip install "pytest-mock==3.12.0"
* litellm_mapped_tests_coverage
* add readme on new litellm test dir
2025-02-19 19:08:50 -08:00
Krish Dholakia
b40ebc0e6d
build: build ui ( #8654 )
2025-02-18 22:56:01 -08:00
Ishaan Jaff
0509324db5
ui new build
2025-02-18 21:26:06 -08:00
Krrish Dholakia
5b84d11597
build: merge commit 1b15568af7
...
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date: Mon Feb 17 21:37:36 2025 -0800
fix(proxy/_types.py): fix linting error
commit dc4d5cffa6
Author: Krrish Dholakia <krrishdholakia@gmail.com>
2025-02-17 21:56:00 -08:00