Commit graph

369 commits

Author SHA1 Message Date
Ishaan Jaff
a61925448a fix import mcp router 2025-03-24 21:08:24 -07:00
Ishaan Jaff
dc899570ce fix code quality 2025-03-24 21:06:17 -07:00
Ishaan Jaff
a616375b3c fix mcp import 2025-03-24 21:02:54 -07:00
Ishaan Jaff
f600899ff7 fix linting errors 2025-03-24 18:48:43 -07:00
Ishaan Jaff
d4b53d3fa9 fix mcp type imports 2025-03-24 11:01:29 -07:00
Ishaan Jaff
f133bb07d1 fix pydantic import error 2025-03-24 07:11:48 -07:00
Ishaan Jaff
9760b030e3 fix naming 2025-03-20 21:57:28 -07:00
Ishaan Jaff
616c4db12d add litellm mcp endpoints 2025-03-20 21:12:56 -07:00
Ishaan Jaff
7a93ec2b94 cleanup 2025-03-20 18:02:02 -07:00
Ishaan Jaff
d9c77da113 remove stale file 2025-03-20 17:59:19 -07:00
Ishaan Jaff
7023e8589a add mcp routes 2025-03-20 17:58:33 -07:00
Ishaan Jaff
34253195ab litellm mcp routes 2025-03-20 17:55:43 -07:00
Ishaan Jaff
8e600945c9 add mcp tool registry 2025-03-20 17:51:03 -07:00
Ishaan Jaff
63d454bb8d add MCPToolRegistry 2025-03-20 17:22:12 -07:00
Ishaan Jaff
d704f357fd sample mcp server 2025-03-20 15:37:24 -07:00
Krrish Dholakia
60f6e1d379 fix(lowest_tpm_rpm_v2.py): support batch writing increments to redis 2025-03-18 19:09:53 -07:00
Ishaan Jaff
27494ca5e7 ui new build 2025-03-18 11:46:23 -07:00
Ishaan Jaff
9c13b14ae8 ui new build 2025-03-14 21:46:40 -07:00
Ishaan Jaff
b339df0a64 ui new build 2025-03-14 21:29:42 -07:00
Ishaan Jaff
ade528369b ui new build 2025-03-14 21:23:13 -07:00
Krrish Dholakia
fe148e3dec feat(proxy_server.py): support retrieving models for a team, if user is a member - via /models?team_id
Allows user to see team models on UI when creating a key
2025-03-14 19:34:06 -07:00
Krrish Dholakia
1abce5c47b build: new ui build 2025-03-14 18:18:03 -07:00
Krrish Dholakia
7d7b57e3b2 style: cleanup credential from leftnav - now in models tab 2025-03-14 10:14:21 -07:00
Ishaan Jaff
3c0bb08d41 ui new build 2025-03-13 21:44:32 -07:00
Krrish Dholakia
e0fbfb5e35 fix(azure/audio_transcriptions.py): support azure cost tracking
extract content time and log correctly as duration
2025-03-11 22:25:13 -07:00
Ishaan Jaff
a5634265aa ui new build 2025-03-11 12:22:12 -07:00
Ishaan Jaff
010b1c8b1e ui new build 2025-03-10 21:05:00 -07:00
Krish Dholakia
9fc7bd0493 UI - new API Playground for testing LiteLLM translation (#9073)
* feat: initial commit - enable dev to see translated request

* feat(utils.py): expose new endpoint - `/utils/transform_request` to see the raw request sent by litellm

* feat(transform_request.tsx): allow user to see their transformed request

* refactor(litellm_logging.py): return raw request in 3 parts - api_base, headers, request body

easier to render each individually on UI vs. extracting from combined string

* feat: transform_request.tsx

working e2e raw request viewing

* fix(litellm_logging.py): fix transform viewing for bedrock models

* fix(litellm_logging.py): don't return sensitive headers in raw request headers

prevent accidental leak

* feat(transform_request.tsx): style improvements
2025-03-07 19:39:31 -08:00
Ishaan Jaff
0b6d7f7828 ui new build 2025-03-06 21:22:58 -08:00
Ishaan Jaff
f73c03737f Revert "ui new build"
This reverts commit 94563ab1e7.
2025-03-04 13:28:54 -08:00
Krrish Dholakia
e2d25f0e18 build: merge litellm_dev_03_01_2025_p2 2025-03-03 23:05:41 -08:00
Ishaan Jaff
bd2231400f ui new build 2025-03-03 22:21:31 -08:00
Krrish Dholakia
225f5124db build: merge branch 2025-03-02 08:31:57 -08:00
Ishaan Jaff
7ddf427144 ui new build 2025-03-01 17:52:14 -08:00
Ishaan Jaff
03274e202e ui new build 2025-02-28 20:12:06 -08:00
Krish Dholakia
6e35f7ae4d Fix calling claude via invoke route + response_format support for claude on invoke route (#8908)
* fix(anthropic_claude3_transformation.py): fix amazon anthropic claude 3 tool calling transformation on invoke route

move to using anthropic config as base

* fix(utils.py): expose anthropic config via providerconfigmanager

* fix(llm_http_handler.py): support json mode on async completion calls

* fix(invoke_handler/make_call): support json mode for anthropic called via bedrock invoke

* fix(anthropic/): handle 'response_format: {"type": "text"}` + migrate amazon claude 3 invoke config to inherit from anthropic config

Prevents error when passing in 'response_format: {"type": "text"}

* test: fix test

* fix(utils.py): fix base invoke provider check

* fix(anthropic_claude3_transformation.py): don't pass 'stream' param

* fix: fix linting errors

* fix(converse_transformation.py): handle response_format type=text for converse
2025-02-28 17:56:26 -08:00
Ishaan Jaff
cea52a1e64 ui new build 2025-02-27 20:09:44 -08:00
Krrish Dholakia
6f51f40a3f build: merge squashed commit
Squashed commit of the following:

commit 6678e15381
Author: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Date:   Wed Feb 26 09:29:15 2025 -0800

    test_prompt_caching

commit bd86e0ac47
Author: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Date:   Wed Feb 26 08:57:16 2025 -0800

    test_prompt_caching

commit 2fc21ad51e
Author: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Date:   Wed Feb 26 08:13:45 2025 -0800

    test_aprompt_caching

commit d94cff55ff
Author: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Date:   Wed Feb 26 08:13:12 2025 -0800

    test_prompt_caching

commit 49c5e7811e
Author: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Date:   Wed Feb 26 07:43:53 2025 -0800

    ui new build

commit cb8d5e5917
Author: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Date:   Wed Feb 26 07:38:56 2025 -0800

    (UI) - Create Key flow for existing users (#8844)

    * working create user button

    * working create user for a key flow

    * allow searching users

    * working create user + key

    * use clear sections on create key

    * better search for users

    * fix create key

    * ui fix create key button - make it neater / cleaner

    * ui fix all keys table

commit 335ba30467
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date:   Wed Feb 26 08:53:17 2025 -0800

    fix: fix file name

commit b8c5b31a4e
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date:   Tue Feb 25 22:54:46 2025 -0800

    fix: fix utils

commit ac6e503461
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date:   Mon Feb 24 10:43:31 2025 -0800

    fix(main.py): fix openai message for assistant msg if role is missing - openai allows this

    Fixes https://github.com/BerriAI/litellm/issues/8661

commit de3989dbc5
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date:   Mon Feb 24 21:19:25 2025 -0800

    fix(get_litellm_params.py): handle no-log being passed in via kwargs

    Fixes https://github.com/BerriAI/litellm/issues/8380
2025-02-26 09:39:27 -08:00
Ishaan Jaff
409e9f11ce ui new build 2025-02-26 07:43:53 -08:00
Ishaan Jaff
65f47e26c0 ui new build 2025-02-25 20:03:03 -08:00
Krish Dholakia
d264fdd621 Litellm dev 02 25 2025 p1 (#8816)
* build(model_prices_and_context_window.json): add bedrock cross-region inferencing model information

Closes https://github.com/BerriAI/litellm/issues/8801#issuecomment-2683438528

* build(model_prices_and_context_window.json): add claude sonnet `-latest` models to model cost map

Closes https://github.com/BerriAI/litellm/discussions/8770#discussioncomment-12318880

* build(model_prices_and_context_window.json): add remaining anthropic `-latest` models to model cost map

Closes https://github.com/BerriAI/litellm/discussions/8770#discussioncomment-12318880

* test: update test with new model
2025-02-25 15:20:39 -08:00
Ishaan Jaff
cd2b9aa552 ui new build 2025-02-24 23:51:00 -08:00
Ishaan Jaff
9b1a4ff131 ui new build 2025-02-21 19:31:59 -08:00
Ishaan Jaff
7af8c6210c ui new build 2025-02-20 18:40:21 -08:00
Krrish Dholakia
e58507ae72 build: extract <think>..</think> block for amazon deepseek r1 and put in reasoning_content 2025-02-19 21:10:38 -08:00
Ishaan Jaff
1d9070066a ui new build 2025-02-19 20:09:51 -08:00
Ishaan Jaff
752e93cbdb (UI + Proxy) Cache Health Check Page - Cleanup/Improvements (#8665)
* fixes for redis cache ping serialization

* fix cache ping check

* fix cache health check ui

* working error details on ui

* ui expand / collapse error

* move cache health check to diff file

* fix displaying error from cache health check

* ui allow copying errors

* ui cache health fixes

* show redis details

* clean up cache health page

* ui polish fixes

* fix error handling on cache health page

* fix redis_cache_params on cache ping response

* error handling

* cache health ping response

* fx error response from cache ping

* parsedLitellmParams

* fix cache health check

* fix cache health page

* cache safely handle json dumps issues

* test caching routes

* test_primitive_types

* fix caching routes

* litellm_mapped_tests

* fix pytest-mock

* fix _serialize

* fix linting on safe dumps

* test_default_max_depth

* pip install "pytest-mock==3.12.0"

* litellm_mapped_tests_coverage

* add readme on new litellm test dir
2025-02-19 19:08:50 -08:00
Krish Dholakia
b40ebc0e6d build: build ui (#8654) 2025-02-18 22:56:01 -08:00
Ishaan Jaff
0509324db5 ui new build 2025-02-18 21:26:06 -08:00
Krrish Dholakia
5b84d11597 build: merge commit 1b15568af7
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date:   Mon Feb 17 21:37:36 2025 -0800

    fix(proxy/_types.py): fix linting error

commit dc4d5cffa6
Author: Krrish Dholakia <krrishdholakia@gmail.com>
2025-02-17 21:56:00 -08:00