Commit graph

3423 commits

Author SHA1 Message Date
Ishaan Jaff
df01337bd8 docs litellm mcp 2025-03-29 22:28:03 -07:00
Ishaan Jaff
cc80370e0c docs mcp litellm 2025-03-29 21:59:58 -07:00
Ishaan Jaff
366f3a901c docs mcp 2025-03-29 21:46:18 -07:00
Ishaan Jaff
db12adb3db docs mcp tools 2025-03-29 20:42:14 -07:00
Ishaan Jaff
2238a5585b doc fix mcp 2025-03-29 20:35:53 -07:00
Ishaan Jaff
8c2f1c6142 docs 1.65.0-stable 2025-03-29 20:03:05 -07:00
Ishaan Jaff
7673293c9f docs update stable release 2025-03-29 20:01:00 -07:00
Ishaan Jaff
9b187d89f2 add litellm model name on SLP 2025-03-29 19:55:41 -07:00
Ishaan Jaff
1f10d985fb docs updates release notes 2025-03-29 19:51:38 -07:00
Ishaan Jaff
e9b743e3c6 docs release notes 2025-03-29 19:50:13 -07:00
Ishaan Jaff
f3b72858e8 docs release notes 2025-03-29 19:08:23 -07:00
Ishaan Jaff
d04cc6c81e docs release notes 2025-03-29 19:03:55 -07:00
Ishaan Jaff
46e5ebe3c7 docs add mcp graphic to stable release notes 2025-03-29 19:00:26 -07:00
Ishaan Jaff
22f9a93e25 docs stable release notes 2025-03-29 18:21:42 -07:00
Ishaan Jaff
cb83584c0e add Complete Git Diff 2025-03-29 18:09:54 -07:00
Ishaan Jaff
8ea6caeff0 docs fix release notes 2025-03-29 18:06:36 -07:00
Tan Yong Sheng
abf06013ec
update docs for openwebui (#9636) 2025-03-29 17:40:27 -07:00
Krish Dholakia
1604f87663
install prisma migration files - connects litellm proxy to litellm's prisma migration files (#9637)
* build(README.md): initial commit adding a separate folder for additional proxy files. Meant to reduce size of core package

* build(litellm-proxy-extras/): new pip package for storing migration files

allows litellm proxy to use migration files, without adding them to core repo

* build(litellm-proxy-extras/): cleanup pyproject.toml

* build: move prisma migration files inside new proxy extras package

* build(run_migration.py): update script to write to correct folder

* build(proxy_cli.py): load in migration files from litellm-proxy-extras

Closes https://github.com/BerriAI/litellm/issues/9558

* build: add MIT license to litellm-proxy-extras

* test: update test

* fix: fix schema

* bump: version 0.1.0 → 0.1.1

* build(publish-proxy-extras.sh): add script for publishing new proxy-extras version

* build(liccheck.ini): add litellm-proxy-extras to authorized packages

* fix(litellm-proxy-extras/utils.py): move prisma migrate logic inside extra proxy pkg

easier since migrations folder already there

* build(pre-commit-config.yaml): add litellm_proxy_extras to ci tests

* docs(config_settings.md): document new env var

* build(pyproject.toml): bump relevant files when litellm-proxy-extras version changed

* build(pre-commit-config.yaml): run poetry check on litellm-proxy-extras as well
2025-03-29 15:27:09 -07:00
Krrish Dholakia
2fcfabd66f docs(bedrock.md): clarify version on docs 2025-03-29 00:31:35 -07:00
Krrish Dholakia
cac60d5091 docs(bedrock.md): add latency optimized inference to docs 2025-03-29 00:31:06 -07:00
Krish Dholakia
5ac61a7572
Add bedrock latency optimized inference support (#9623)
* fix(converse_transformation.py): add performanceConfig param support on bedrock

Closes https://github.com/BerriAI/litellm/issues/7606

* fix(converse_transformation.py): refactor to use more flexible single getter for params which are separate config blocks

* test(test_main.py): add e2e mock test for bedrock performance config

* build(model_prices_and_context_window.json): add versioned multimodal embedding

* refactor(multimodal_embeddings/): migrate to config pattern

* feat(vertex_ai/multimodalembeddings): calculate usage for multimodal embedding calls

Enables cost calculation for multimodal embeddings

* feat(vertex_ai/multimodalembeddings): get usage object for embedding calls

ensures accurate cost tracking for vertexai multimodal embedding calls

* fix(embedding_handler.py): remove unused imports

* fix: fix linting errors

* fix: handle response api usage calculation

* test(test_vertex_ai_multimodal_embedding_transformation.py): update tests

* test: mark flaky test

* feat(vertex_ai/multimodal_embeddings/transformation.py): support text+image+video input

* docs(vertex.md): document sending text + image to vertex multimodal embeddings

* test: remove incorrect file

* fix(multimodal_embeddings/transformation.py): fix linting error

* style: remove unused import
2025-03-29 00:23:09 -07:00
Shixian Sheng
74917c7a6f
Merge branch 'BerriAI:main' into main 2025-03-28 06:44:51 -04:00
Krish Dholakia
ccbac691e5
Support discovering gemini, anthropic, xai models by calling their /v1/model endpoint (#9530)
* fix: initial commit for adding provider model discovery to gemini

* feat(gemini/): add model discovery for gemini/ route

* docs(set_keys.md): update docs to show you can check available gemini models as well

* feat(anthropic/): add model discovery for anthropic api key

* feat(xai/): add model discovery for XAI

enables checking what models an xai key can call

* ci: bump ci config yml

* fix(topaz/common_utils.py): fix linting error

* fix: fix linting error for python38
2025-03-27 22:50:48 -07:00
Shixian Sheng
101cc24486
Merge branch 'BerriAI:main' into main 2025-03-27 20:52:06 -04:00
Krrish Dholakia
f1f40eba3f docs(index.md): document new team model flow
All checks were successful
Helm unit test / unit-test (push) Successful in 18s
Read Version from pyproject.toml / read-version (push) Successful in 22s
2025-03-27 12:14:29 -07:00
Gabriel Loiseau
ca098d1bf9
Fix typo gemini.md 2025-03-27 14:53:02 +01:00
Krrish Dholakia
3ca34a181c docs(openai.md): add gpt-4o-transcribe to docs
All checks were successful
Read Version from pyproject.toml / read-version (push) Successful in 17s
Helm unit test / unit-test (push) Successful in 19s
2025-03-26 23:23:35 -07:00
Ishaan Jaff
05c38049fe docs prod.md 2025-03-26 21:04:36 -07:00
Ishaan Jaff
0155b0eba2
Merge pull request #9533 from BerriAI/litellm_stability_fixes
[Reliability Fixes] - Gracefully handle exceptions when DB is having an outage
2025-03-26 18:57:38 -07:00
Ishaan Jaff
485aa87e65 allow_requests_on_db_unavailable 2025-03-26 18:48:18 -07:00
Ishaan Jaff
763f853a9f docs fix 2025-03-26 18:32:58 -07:00
Ishaan Jaff
b7f4abd13a
Merge pull request #9542 from BerriAI/litellm_fix_vertex_ai_ft_models
[Feature]: Support for Fine-Tuned Vertex AI LLMs
2025-03-26 16:19:41 -07:00
Ishaan Jaff
82faa49668 doc fix Fine-tuned Models 2025-03-26 14:09:27 -07:00
Ishaan Jaff
28ab8fdccc docs vertex ft model 2025-03-26 14:08:19 -07:00
Ishaan Jaff
e24a601897 docs verte ft models 2025-03-26 14:03:42 -07:00
Ishaan Jaff
82016eba0a docs vertex ft models 2025-03-26 13:55:38 -07:00
Shixian Sheng
54e83ac8a8
Update all_caches.md 2025-03-26 15:29:58 -04:00
Ishaan Jaff
12eb77d02d docs litellm vertex ai ft models 2025-03-26 12:24:49 -07:00
Krish Dholakia
801ecb6517
Nova Canvas complete image generation tasks (#9177) (#9525)
All checks were successful
Read Version from pyproject.toml / read-version (push) Successful in 17s
Helm unit test / unit-test (push) Successful in 22s
* Nova Canvas complete image generation tasks (#9177)

* add initial support for Amazon Nova Canvas model

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* adjust name to AmazonNovaCanvas and map function variables to config

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* tighten model name check

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* fix quality mapping

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* add premium quality in config

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* support all Amazon Nova Canvas tasks

* remove unused import

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* add tests for image generation tasks and fix payload

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* add missing util file

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* update model prices backup file

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* remove image tasks other than text->image

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* add color guided generation task for Nova Canvas

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* fix merge

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* add nova canvas image generation documentation

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* add nova canvas unit tests

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

---------

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>

* ci(config.yml): bump ci config

* test: fix test

---------

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
Co-authored-by: omrishiv <327609+omrishiv@users.noreply.github.com>
2025-03-26 11:28:20 -07:00
Krrish Dholakia
e0880734d9 docs(config_settings.md): cleanup docs 2025-03-25 23:11:45 -07:00
Krrish Dholakia
e8c4cd8c1a docs: cleanup docs
All checks were successful
Read Version from pyproject.toml / read-version (push) Successful in 14s
Helm unit test / unit-test (push) Successful in 21s
2025-03-25 12:25:42 -07:00
Krrish Dholakia
1a58e8bfe5 docs(admin_ui_sso.md): add logout url 2025-03-25 12:25:16 -07:00
Krrish Dholakia
ff61ce6751 docs: update release note with patch 2025-03-25 10:17:34 -07:00
Ishaan Jaff
da16cef4ba Expose MCP tools 2025-03-24 21:36:02 -07:00
Ishaan Jaff
18dfb70023 mcp docs, exposing tools now live 2025-03-24 21:35:29 -07:00
Ishaan Jaff
08a4ba1b7e Merge branch 'main' into litellm_exp_mcp_server 2025-03-24 19:03:56 -07:00
Tyler Hutcherson
7864cd1f76 update redisvl dependency 2025-03-24 08:42:11 -04:00
Krrish Dholakia
43e4e9e972 docs: cleanup 2025-03-22 20:31:54 -07:00
Krrish Dholakia
b363b72a19 docs: cleanup 2025-03-22 20:30:58 -07:00
Krrish Dholakia
dc3192c588 docs: cleanup docs 2025-03-22 20:29:02 -07:00