phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 03:34:10 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
21516 commits 2497 branches 897 tags 550 MiB
Commit graph

3407 commits

Author SHA1 Message Date
Ishaan Jaff
543072fb03 doc fix 2025-04-18 19:57:03 -07:00
Ishaan Jaff
b4a1ca40d5 add info on litellm release 2025-04-18 19:56:29 -07:00
Ishaan Jaff
7c495f3122 [Feat] Support for all litellm providers on Responses API (works with Codex) - Anthropic, Bedrock API, VertexAI, Ollama (#10132) 
* transform request

* basic handler for LiteLLMCompletionTransformationHandler

* complete transform litellm to responses api

* fixes to test

* fix stream=True

* fix streaming iterator

* fixes for transformation

* fixes for anthropic codex support

* fix pass response_api_optional_params

* test anthropic responses api tools

* update responses types

* working codex with litellm

* add session handler

* fixes streaming iterator

* fix handler

* add litellm codex example

* fix code quality

* test fix

* docs litellm codex

* litellm codexdoc

* docs openai codex with litellm

* docs litellm openai codex

* litellm codex

* linting fixes for transforming responses API

* fix import error

* fix responses api test

* add sync iterator support for responses api
 2025-04-18 19:53:59 -07:00
Ishaan Jaff
7136703148 docs azure responses API 2025-04-17 18:47:44 -07:00
Krrish Dholakia
72c820e8c8 docs(vertex_ai.md): document new vertex passthrough route 2025-04-16 22:25:16 -07:00
dependabot[bot]
e1d73f4d3c build(deps): bump http-proxy-middleware in /docs/my-website (#10064) 
Bumps [http-proxy-middleware](https://github.com/chimurai/http-proxy-middleware) from 2.0.7 to 2.0.9.
- [Release notes](https://github.com/chimurai/http-proxy-middleware/releases)
- [Changelog](https://github.com/chimurai/http-proxy-middleware/blob/v2.0.9/CHANGELOG.md)
- [Commits](https://github.com/chimurai/http-proxy-middleware/compare/v2.0.7...v2.0.9)

---
updated-dependencies:
- dependency-name: http-proxy-middleware
  dependency-version: 2.0.9
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-04-16 09:55:44 -07:00
Ishaan Jaff
377043ae3a [Docs] Auto prompt caching (#10044) 
* docs prompt cache controls

* doc fix auto prompt caching
 2025-04-15 22:29:47 -07:00
Marc Abramowitz
7fa265e081 Fix typo: Entrata -> Entra in code (#9922) 
* Fix typo: Entrata -> Entra

* Fix a few more
 2025-04-15 17:31:18 -07:00
Joakim Lorentz
f5c9ac20ab chore(docs): Update logging.md (#10006) 
Fixes a missing slash in OTEL_ENDPOINT example
 2025-04-15 16:34:55 -07:00
Krrish Dholakia
ff5e8960b8 fix(config_settings.md): cleanup 2025-04-15 13:41:22 -07:00
Krrish Dholakia
44b47e03a9 docs(cohere.md): add cohere cost tracking support to docs 2025-04-14 23:46:58 -07:00
Eoous
7594b59978 env for litellm.modify_params (#9964) 2025-04-14 22:33:56 -07:00
Krish Dholakia
3031fff297 Add /vllm/* and /mistral/* passthrough endpoints (adds support for Mistral OCR via passthrough) 
* feat(llm_passthrough_endpoints.py): support mistral passthrough

Closes https://github.com/BerriAI/litellm/issues/9051

* feat(llm_passthrough_endpoints.py): initial commit for adding vllm passthrough route

* feat(vllm/common_utils.py): add new vllm model info route

make it possible to use vllm passthrough route via factory function

* fix(llm_passthrough_endpoints.py): add all methods to vllm passthrough route

* fix: fix linting error

* fix: fix linting error

* fix: fix ruff check

* fix(proxy/_types.py): add new passthrough routes

* docs(config_settings.md): add mistral env vars to docs
 2025-04-14 22:06:33 -07:00
Krish Dholakia
5fcdf4becf Fix azure tenant id check from env var + response_format check on api_version 2025+ (#9993) 
* fix(azure/common_utils.py): check for azure tenant id, client id, client secret in env var

Fixes https://github.com/BerriAI/litellm/issues/9598#issuecomment-2801966027

* fix(azure/gpt_transformation.py): fix passing response_format to azure when api year = 2025

Fixes https://github.com/BerriAI/litellm/issues/9703

* test: monkeypatch azure api version in test

* test: update testing

* test: fix test

* test: update test

* docs(config_settings.md): document env vars
 2025-04-14 22:02:35 -07:00
Marc Klingen
5badc831f0 chore: ordering of logging & observability docs (#9994) 2025-04-14 16:49:04 -07:00
Ishaan Jaff
dd2ad5b537 docs fix 2025-04-12 21:20:54 -07:00
Krrish Dholakia
4824c7a70d docs: cleanup 2025-04-12 19:52:19 -07:00
Krrish Dholakia
bdc679c3c7 docs: refactor order 2025-04-12 19:23:07 -07:00
Krrish Dholakia
be3cba010d docs(index.md): update changelog with realtime api cost tracking details 2025-04-12 19:15:40 -07:00
Krrish Dholakia
3e601d34bb docs(litellm_managed_files.md): cleanup doc 2025-04-12 18:24:52 -07:00
Ishaan Jaff
f1b9ecdf87 stable release note fixes (#9954) 
* docs fix

* docs metrics

* docs fix release notes

* docs 1.66.0-stable
 2025-04-12 17:26:38 -07:00
Ishaan Jaff
1707446a73 [Docs] v1.66.0-stable fixes (#9953) 
* add categories for spend tracking improvements

* xai reasoning usage

* docs tag management

* docs tag based routing

* [Beta] Routing based

* docs tag based routing

* docs tag routing

* docs enterprise web search
 2025-04-12 16:57:25 -07:00
Ishaan Jaff
7696e938dc [v1.66.0-stable] Release notes (#9952) 
* release notes

* docs release notes

* docs fix release notes

* docs clean up

* docs clean up

* release notes

* docs sso tag management
 2025-04-12 15:32:52 -07:00
Krish Dholakia
6ee29fa285 Litellm managed files docs (#9948) 
* docs(files_endpoints.md): add doc on litellm managed files

* refactor: separate litellm managed file docs from `/files` docs

clearer

* docs(litellm_managed_files.md): add architecture diagram explaining managed files
 2025-04-12 13:02:33 -07:00
dependabot[bot]
00c47a91e4 build(deps): bump @babel/runtime in /docs/my-website (#9934) 
Bumps [@babel/runtime](https://github.com/babel/babel/tree/HEAD/packages/babel-runtime) from 7.26.0 to 7.27.0.
- [Release notes](https://github.com/babel/babel/releases)
- [Changelog](https://github.com/babel/babel/blob/main/CHANGELOG.md)
- [Commits](https://github.com/babel/babel/commits/v7.27.0/packages/babel-runtime)

---
updated-dependencies:
- dependency-name: "@babel/runtime"
  dependency-version: 7.27.0
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-04-12 07:45:53 -07:00
Ishaan Jaff
c0ee868c62 [Feat] Add reasoning_effort support for xai/grok-3-mini-beta model family (#9932) 
* add BaseReasoningEffortTests

* BaseReasoningLLMTests

* fix test rename

* docs update thinking / reasoning content docs
 2025-04-11 19:17:09 -07:00
Ishaan Jaff
f7dfa264bb [Feat] Add litellm.supports_reasoning() util to track if an llm supports reasoning (#9923) 
* add supports_reasoning for xai models

* add "supports_reasoning": true for o1 series models

* add supports_reasoning util

* add litellm.supports_reasoning

* add supports reasoning for claude 3-7 models

* add deepseek as supports reasoning

* test_supports_reasoning

* add supports reasoning to model group info

* add supports_reasoning

* docs supports reasoning

* fix supports_reasoning test

* "supports_reasoning": false,

* fix test

* supports_reasoning
 2025-04-11 17:56:04 -07:00
Ishaan Jaff
180e1bf4af [Feat - PR1] Add xAI grok-3 models to LiteLLM (#9920) 
* add xai/grok-3-mini-beta, xai/grok-3-beta

* add grok-3-fast-latest models

* supports_response_schema

* fix pricing

* docs xai
 2025-04-11 15:12:12 -07:00
Marc Abramowitz
d1581f79aa Fix typo: Entrata -> Entra in docs (#9921) 2025-04-11 15:08:57 -07:00
Ishaan Jaff
a451fc7cad docs clean up 2025-04-10 21:35:08 -07:00
Ishaan Jaff
5aa0aded3e docs msft SSO 2025-04-10 20:33:14 -07:00
Ishaan Jaff
5e83144b24 docs MSFT sso 2025-04-10 20:30:52 -07:00
Ishaan Jaff
aab25fb825 docs self serve msft SSO 2025-04-10 20:25:43 -07:00
Ishaan Jaff
4f70965d06 docs msft default team settings 2025-04-10 20:22:46 -07:00
Ishaan Jaff
b4b6c1e06d docs msft_default_settings 2025-04-10 20:21:14 -07:00
Ishaan Jaff
17f7d04908 update docs 2025-04-10 20:18:54 -07:00
Ishaan Jaff
4295a8817d [Docs] Tutorial using MSFT auto team assignment with LiteLLM (#9898) 
* add default_team_params as a config.yaml setting

* create_litellm_team_from_sso_group

* test_default_team_params

* test_create_team_without_default_params

* docs default team settings

* docs msft entra id tutorial

* commit litellm docs msft group assignment

* litellm MSFT sso

* member, team assignment on litellm

* docs msft auto assignment

* bug fix default team setting

* docs litellm default team settings

* test_default_team_params
 2025-04-10 20:07:55 -07:00
Ishaan Jaff
557a2ca102 [Feat SSO] - Allow admins to set default_team_params to have default params for when litellm SSO creates default teams (#9895) 
* add default_team_params as a config.yaml setting

* create_litellm_team_from_sso_group

* test_default_team_params

* test_create_team_without_default_params

* docs default team settings
 2025-04-10 16:58:28 -07:00
Krish Dholakia
e1eb5e32c1 fix(cost_calculator.py): handle custom pricing at deployment level fo… (#9855) 
* fix(cost_calculator.py): handle custom pricing at deployment level for router

* test: add unit tests

* fix(router.py): show custom pricing on UI

check correct model str

* fix: fix linting error

* docs(custom_pricing.md): clarify custom pricing for proxy

Fixes https://github.com/BerriAI/litellm/issues/8573#issuecomment-2790420740

* test: update code qa test

* fix: cleanup traceback

* fix: handle litellm param custom pricing

* test: update test

* fix(cost_calculator.py): add router model id to list of potential model names

* fix(cost_calculator.py): fix router model id check

* fix: router.py - maintain older model registry approach

* fix: fix ruff check

* fix(router.py): router get deployment info

add custom values to mapped dict

* test: update test

* fix(utils.py): update only if value is non-null

* test: add unit test
 2025-04-09 22:13:10 -07:00
Ishaan Jaff
47d05ab563 docs Microsoft Entra ID SSO group assignment 2025-04-09 21:07:47 -07:00
Ishaan Jaff
1d9ec118dd [SSO] Connect LiteLLM to Azure Entra ID Enterprise Application (#9872) 
* refactor SSO handler

* render sso JWT on ui

* docs debug sso

* fix sso login flow use await

* fix ui sso debug JWT

* test ui sso

* remove redis vl

* fix redisvl==0.5.1

* fix ml dtypes

* fix redisvl

* fix redis vl

* fix debug_sso_callback

* fix linting error

* fix redis semantic caching dep

* working graph api assignment

* test msft sso handler openid

* testing for msft group assignment

* fix debug graph api sso flow

* fix linting errors

* add_user_to_teams_from_sso_response

* ui sso fix team assignments

* linting fix _get_group_ids_from_graph_api_response

* add MicrosoftServicePrincipalTeam

* create_litellm_teams_from_service_principal_team_ids

* create_litellm_teams_from_service_principal_team_ids

* docs MICROSOFT_SERVICE_PRINCIPAL_ID

* fix linting errors
 2025-04-09 20:26:59 -07:00
Krrish Dholakia
f5d8eb686c fix: transform_request.tsx 
don't hardcode to localhost
 2025-04-09 17:50:13 -07:00
Krrish Dholakia
3b9eac8170 Revert "docs: initial commit adding api playground to docs" 
This reverts commit 9d68008152.
 2025-04-09 17:50:13 -07:00
Krrish Dholakia
433c49e3bd docs: initial commit adding api playground to docs 
makes it easy to see how litellm transforms your request
 2025-04-09 17:50:13 -07:00
Ishaan Jaff
3484100aed [Feat SSO] Debug route - allow admins to debug SSO JWT fields (#9835) 
* refactor SSO handler

* render sso JWT on ui

* docs debug sso

* fix sso login flow use await

* fix ui sso debug JWT

* test ui sso

* remove redis vl

* fix redisvl==0.5.1

* fix ml dtypes

* fix redisvl

* fix redis vl

* fix debug_sso_callback

* fix linting error

* fix redis semantic caching dep
 2025-04-09 15:29:35 -07:00
qvalentin
b5881462d8 feat: add enterpriseWebSearch tool for vertex-ai (#9856) 2025-04-09 13:17:48 -07:00
Krrish Dholakia
122768ca59 docs(gemini.md): show how to call google search via litellm 
Addresses https://github.com/BerriAI/litellm/issues/361#issuecomment-2787497217
 2025-04-08 16:41:24 -07:00
Krrish Dholakia
fcb0d45930 docs: fix doc 2025-04-07 07:21:00 -07:00
Krrish Dholakia
aee43eaabf docs: cleanup 2025-04-06 14:42:35 -07:00
Krrish Dholakia
36273d740c docs: cleanup 2025-04-06 14:39:28 -07:00