Commit graph

19792 commits

Author SHA1 Message Date
Ishaan Jaff
34694d3057 ui new build 2025-03-10 12:32:18 -07:00
Ishaan Jaff
e64b8a8baa ui linting fix 2025-03-10 12:31:32 -07:00
Ishaan Jaff
d0cda56c99 ui linting fixes #2 2025-03-10 12:31:27 -07:00
Ishaan Jaff
24a8dfd540 ui fix linting errors 2025-03-10 12:31:22 -07:00
Ishaan Jaff
629ce6c19a fix linting error 2025-03-10 12:31:13 -07:00
Ishaan Jaff
51f074682f show eu api base on openai + text 2025-03-10 10:40:48 -07:00
Ishaan Jaff
6d537aec48 OpenAI_Text 2025-03-10 10:36:50 -07:00
Ishaan Jaff
666690c31c fix atext_completion 2025-03-10 10:18:03 -07:00
Ishaan Jaff
60d3cb10bc openweb tutorial 2025-03-10 08:10:07 -07:00
Krrish Dholakia
0fa3ec98ab bump: version 1.63.4 → 1.63.5
All checks were successful
Read Version from pyproject.toml / read-version (push) Successful in 38s
2025-03-09 20:47:51 -07:00
Krrish Dholakia
574f5056c8 fix(utils.py): fix linting error 2025-03-09 20:47:12 -07:00
Krish Dholakia
f899b828cf
Support openrouter reasoning_content on streaming (#9094)
* feat(convert_dict_to_response.py): support openrouter format of reasoning content

* fix(transformation.py): fix openrouter streaming with reasoning content

Fixes https://github.com/BerriAI/litellm/issues/8193#issuecomment-270892962

* fix: fix type error
2025-03-09 20:03:59 -07:00
5aaee9
42b7921ca1
fix: perplexity return both delta and message cause OpenWebUI repect text (#9081) 2025-03-09 19:46:31 -07:00
Krish Dholakia
65ef65d360
feat: prioritize api_key over tenant_id for more Azure AD token provi… (#8701)
* feat: prioritize api_key over tenant_id for more Azure AD token provider (#8318)

* fix: prioritize api_key over tenant_id for Azure AD token provider

* test: Add test for Azure AD token provider in router

* fix: fix linting error

---------

Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>
2025-03-09 18:59:37 -07:00
Krish Dholakia
e00d4fb18c
Litellm dev 03 08 2025 p3 (#9089)
* feat(ollama_chat.py): pass down http client to ollama_chat

enables easier testing

* fix(factory.py): fix passing images to ollama's `/api/generate` endpoint

Fixes https://github.com/BerriAI/litellm/issues/6683

* fix(factory.py): fix ollama pt to handle templating correctly
2025-03-09 18:20:56 -07:00
Krrish Dholakia
93273723cd docs(index.md): add git diff to release notes
All checks were successful
Read Version from pyproject.toml / read-version (push) Successful in 42s
2025-03-08 19:14:56 -08:00
Krrish Dholakia
ac3e57a501 docs: add images to release notes 2025-03-08 17:39:24 -08:00
Ishaan Jaff
b6eee01381 Revert "experimental - track anthropic messages as mode"
This reverts commit 22b3862e0d.
2025-03-08 17:38:24 -08:00
Ishaan Jaff
22b3862e0d experimental - track anthropic messages as mode 2025-03-08 17:33:35 -08:00
Ishaan Jaff
83062b892b fix test_list_key_helper_team_filtering 2025-03-08 17:21:32 -08:00
Krrish Dholakia
de0467b8e6 docs: cleanup 2025-03-08 16:43:42 -08:00
Krrish Dholakia
b0ae49a53d docs(index.md): cleanup 2025-03-08 16:37:01 -08:00
Krrish Dholakia
4e5893ef65 docs(index.md): cleanup 2025-03-08 16:36:36 -08:00
Ishaan Jaff
6e3b21775f test_cost_azure_openai_prompt_caching 2025-03-08 16:19:28 -08:00
Krish Dholakia
09d0144711
New stable release notes (#9085)
* docs: stable release notes

* docs: additional doc improvements

* docs(anthropic_unified.md): add doc on unified anthropic endpoint

* docs: update docs
2025-03-08 16:19:07 -08:00
Ishaan Jaff
b41311bb21
(UI) - Fix show correct count of internal user keys on Users Page (#9082)
* get_user_key_counts

* fix get_user_key_counts

* fix get_user_key_counts

* test_get_users_filters_dashboard_keys

* remove unused func
2025-03-08 16:13:18 -08:00
Ishaan Jaff
73df319f4e
(Clean up) - Allow switching off storing Error Logs in DB (#9084)
* fix - cleanup, dont store ErrorLogs in 2 tables

* async_post_call_failure_hook

* docs disable error logs

* disable_error_logs
2025-03-08 16:12:03 -08:00
Ishaan Jaff
a7f6a95dd9
(UI) - Fix, Allow Filter Keys by Team Alias, Key Alias and Org (#9083)
* working team, key, org filters

* fix size of filter

* all keys filter

* 1 file for filter logic

* remove key alias check
2025-03-08 15:58:29 -08:00
Krish Dholakia
4330ef8e81
Fix batches api cost tracking + Log batch models in spend logs / standard logging payload (#9077)
All checks were successful
Read Version from pyproject.toml / read-version (push) Successful in 42s
* feat(batches/): fix batch cost calculation - ensure it's accurate

use the correct cost value - prev. defaulting to non-batch cost

* feat(batch_utils.py): log batch models to spend logs + standard logging payload

makes it easy to understand how cost was calculated

* fix: fix stored payload for test

* test: fix test
2025-03-08 11:47:25 -08:00
Teja Vishwanadha
8c049dfffc
support bytes.IO for audio transcription (#9071) 2025-03-08 08:47:15 -08:00
Ishaan Jaff
b5ad968e8a
(UI) - Minor improvements to logs page (#9076)
All checks were successful
Read Version from pyproject.toml / read-version (push) Successful in 16s
* logs - make sure all cols have max width

* fix missing data message

* fix toggle handle responsive logs
2025-03-07 21:38:45 -08:00
Ishaan Jaff
e2d612efd9
Bug fix - String data: stripped from entire content in streamed Gemini responses (#9070)
* _strip_sse_data_from_chunk

* use _strip_sse_data_from_chunk

* use _strip_sse_data_from_chunk

* use _strip_sse_data_from_chunk

* _strip_sse_data_from_chunk

* test_strip_sse_data_from_chunk

* _strip_sse_data_from_chunk

* testing

* _strip_sse_data_from_chunk
2025-03-07 21:06:39 -08:00
Krrish Dholakia
2163d5c3e9 fix(transform_request.tsx): allow dev to file translation error 2025-03-07 19:43:49 -08:00
Krish Dholakia
0e3caf92b9
UI - new API Playground for testing LiteLLM translation (#9073)
* feat: initial commit - enable dev to see translated request

* feat(utils.py): expose new endpoint - `/utils/transform_request` to see the raw request sent by litellm

* feat(transform_request.tsx): allow user to see their transformed request

* refactor(litellm_logging.py): return raw request in 3 parts - api_base, headers, request body

easier to render each individually on UI vs. extracting from combined string

* feat: transform_request.tsx

working e2e raw request viewing

* fix(litellm_logging.py): fix transform viewing for bedrock models

* fix(litellm_logging.py): don't return sensitive headers in raw request headers

prevent accidental leak

* feat(transform_request.tsx): style improvements
2025-03-07 19:39:31 -08:00
Ishaan Jaff
1cf6f53a6c
(UI) - Allow adding Cerebras, Sambanova, Perplexity, Fireworks, Openrouter, TogetherAI Models on Admin UI (#9069)
All checks were successful
Read Version from pyproject.toml / read-version (push) Successful in 17s
* allow adding cerebras on litellm ui

* add perplexity

* add openrouter, fireworks, together
2025-03-07 17:01:53 -08:00
Ishaan Jaff
b5eeafdd72
(Docs) OpenWeb x LiteLLM Docker compose + Instructions on spend tracking + logging (#9059)
* docs improve open web ui litellm doc

* docs openweb show teams + keys

* docs open web ui litellm
2025-03-07 17:01:39 -08:00
Ishaan Jaff
e753f61231
fix logs page selected log (#9061) 2025-03-07 17:01:11 -08:00
Ishaan Jaff
0e7fd162f4
(UI) - Keys Page - Show 100 Keys Per Page, Use full height, increase width of key alias (#9064)
* show 100 keys + increase height of keys

* fix key_alias

* litellm show key alias full width
2025-03-07 15:43:10 -08:00
Krrish Dholakia
36f3276d8c docs: update docs
All checks were successful
Read Version from pyproject.toml / read-version (push) Successful in 16s
2025-03-07 11:00:12 -08:00
Minh Duc
d3ececfc20
Mark several Claude models as being able to accept PDF inputs (#9054) 2025-03-07 10:05:57 -08:00
Jascha Beste
ecef36d02c
docs: Add project page for pgai (#8576)
* docs: Add project page for pgai

* Add pgai to sidebar.js
2025-03-07 08:08:01 -08:00
Ishaan Jaff
7f70bdd99b
(Feat) - add pricing for eu.amazon.nova models (#9056)
* add pricing for eu.amazon.nova models

* fix typo in key management endpoints.py
2025-03-07 07:06:17 -08:00
Krrish Dholakia
995fc001e0 docs(release_cycle.md): add stable tag info to release cycle
All checks were successful
Read Version from pyproject.toml / read-version (push) Successful in 16s
2025-03-06 23:22:45 -08:00
Krrish Dholakia
754b699b07 docs: add doc for rotating master key 2025-03-06 23:22:01 -08:00
Krrish Dholakia
a0746a6da9 bump: version 1.63.3 → 1.63.4 2025-03-06 23:14:35 -08:00
Krish Dholakia
5591354309
Support master key rotations (#9041)
* feat(key_management_endpoints.py): adding support for rotating master key

* feat(key_management_endpoints.py): support decryption-re-encryption of models in db, when master key rotated

* fix(user_api_key_auth.py): raise valid token is None error earlier

enables easier debugging with api key hash in error message

* feat(key_management_endpoints.py): rotate any env vars

* fix(key_management_endpoints.py): uncomment check

* fix: fix linting error
2025-03-06 23:13:30 -08:00
Krish Dholakia
52de1949ef
build(model_prices_and_context_window.json): update azure o1 mini pricing (#9046) 2025-03-06 22:28:06 -08:00
Krish Dholakia
274147bc5e
fix(team_endpoints.py): ensure 404 raised when team not found (#9038)
* fix(team_endpoints.py): ensure 404 raised when team not found

* fix(key_management_endpoints.py): fix adding tags to key when metadata is empty

* fix(key_management_endpoints.py): refactor set metadata field to use common function across keys + teams

reduces scope for errors + easier testing

* fix: fix linting error
2025-03-06 22:04:36 -08:00
Ishaan Jaff
6dc83135ab bump: version 1.63.2 → 1.63.3 2025-03-06 21:23:25 -08:00
Ishaan Jaff
0fed8bcefd ui new build 2025-03-06 21:22:58 -08:00