Commit graph

4483 commits

Author SHA1 Message Date
Krrish Dholakia
d024a5d703 feat(credential_accessor.py): fix upserting new credentials via accessor 2025-03-12 19:03:37 -07:00
Ishaan Jaff
ae3e117395 get_custom_headers 2025-03-12 18:57:41 -07:00
Ishaan Jaff
ee8908faaa fix response api handling 2025-03-12 18:49:17 -07:00
Ishaan Jaff
1913bfbd15 fix async_moderation_hook 2025-03-12 18:45:54 -07:00
Ishaan Jaff
197af46bec fix linting 2025-03-12 18:44:51 -07:00
Ishaan Jaff
e608a5ba4c fix linting error 2025-03-12 18:42:42 -07:00
Ishaan Jaff
168ade935e LITELLM_METADATA_ROUTES 2025-03-12 18:20:07 -07:00
Ishaan Jaff
ecaad0bff0 _handle_llm_api_exception 2025-03-12 17:47:11 -07:00
Ishaan Jaff
f3afd02316 fix responses_api 2025-03-12 17:39:07 -07:00
Krrish Dholakia
6ccb6c529c feat: initial commit adding support for credentials on proxy ui 2025-03-12 17:28:18 -07:00
Ishaan Jaff
606e3d960c working responses_api 2025-03-12 17:26:12 -07:00
Ishaan Jaff
4aa588d203 use correct get custom headers 2025-03-12 17:16:51 -07:00
Ishaan Jaff
584338fb82 add responses_api 2025-03-12 17:08:16 -07:00
Ishaan Jaff
055a4fa2d5 use ProxyBaseLLMRequestProcessing 2025-03-12 16:54:33 -07:00
Krrish Dholakia
1e385d61d2 build(model_prices_and_context_window.json): add azure eu/us data zone pricing 2025-03-12 16:04:04 -07:00
Krish Dholakia
103b3cb574 Merge branch 'main' into litellm_dev_03_10_2025_p3 2025-03-12 14:56:01 -07:00
Krrish Dholakia
0b4bf49553 fix(pass_through_endpoints.py): fix linting error 2025-03-12 12:00:05 -07:00
Ishaan Jaff
61786503a8 Merge pull request #8019 from sfarthin/stevefarthing/bing-search-pass-thru
Bing Search Pass Thru
2025-03-12 07:30:29 -07:00
Krrish Dholakia
91949be3bd docs(bedrock.md): add amazon nova to docs 2025-03-11 23:13:28 -07:00
Krrish Dholakia
e0fbfb5e35 fix(azure/audio_transcriptions.py): support azure cost tracking
extract content time and log correctly as duration
2025-03-11 22:25:13 -07:00
Krrish Dholakia
c784b8b74c fix(internal_user_endpoints.py): allow internal user to query their own info, without knowing their id
make it easy to debug when admin endpoints don't work as expected
2025-03-11 20:24:51 -07:00
Ishaan Jaff
a5634265aa ui new build 2025-03-11 12:22:12 -07:00
Steve Farthing
198f1765bb Merge branch 'stevefarthing/bing-search-pass-thru' of github.com:sfarthin/litellm into stevefarthing/bing-search-pass-thru
# Conflicts:
#	litellm/proxy/pass_through_endpoints/pass_through_endpoints.py
2025-03-11 08:15:23 -04:00
Steve Farthing
b79b126597 Merge branch 'main' into stevefarthing/bing-search-pass-thru 2025-03-11 08:06:56 -04:00
Steve Farthing
227ae4d8b3 Feedback 2025-03-11 08:01:31 -04:00
Steve Farthing
f8b35d16f1 Bing Search Pass Thru 2025-03-11 08:01:31 -04:00
Krish Dholakia
1dce61b8c9 Merge pull request #9109 from BerriAI/litellm_dev_03_10_2025_p1_v2
Return `code`, `param` and `type` on openai bad request error
2025-03-10 22:38:16 -07:00
Krish Dholakia
b4921a37a0 Merge pull request #9047 from BerriAI/litellm_dev_03_06_2025_p4
feat(handle_jwt.py): support multiple jwt url's
2025-03-10 22:37:35 -07:00
Krrish Dholakia
3040fde008 fix: fix test 2025-03-10 21:46:05 -07:00
Krrish Dholakia
e58c18611f fix: fix linting error 2025-03-10 21:22:00 -07:00
Ishaan Jaff
010b1c8b1e ui new build 2025-03-10 21:05:00 -07:00
Krrish Dholakia
b14b8d37df feat(credential_endpoints/endpoints.py): don't return credentials on get
prevent leakage
2025-03-10 20:11:38 -07:00
Ishaan Jaff
5300d39feb can_team_access_model 2025-03-10 20:03:19 -07:00
Krrish Dholakia
a87f822c50 feat: working e2e credential management - support reusing existing credentials 2025-03-10 19:29:24 -07:00
Ishaan Jaff
27cb1c8e1f test_can_team_access_model fix 2025-03-10 19:09:50 -07:00
Ishaan Jaff
5588b1ba81 Merge branch 'main' into litellm_fix_team_model_access_checks 2025-03-10 19:05:11 -07:00
Krrish Dholakia
2fddb59c23 feat: complete crud endpoints for credential management on proxy 2025-03-10 18:46:35 -07:00
Krish Dholakia
581e6a7576 Merge branch 'main' into litellm_dev_03_06_2025_p4 2025-03-10 18:41:10 -07:00
Krrish Dholakia
994d438720 fix(endpoints.py): encrypt credentials before storing in db 2025-03-10 18:37:59 -07:00
Krrish Dholakia
6647e962a1 feat(endpoints.py): support writing credentials to db 2025-03-10 18:27:43 -07:00
Krrish Dholakia
e6d9aa051e feat(endpoints.py): initial set of crud endpoints for reusable credentials on proxy 2025-03-10 17:48:02 -07:00
Krrish Dholakia
e518e3558b feat(credential_accessor.py): support loading in credentials from credential_list
Resolves https://github.com/BerriAI/litellm/issues/9114
2025-03-10 17:15:58 -07:00
Krrish Dholakia
236e68910c feat(proxy_server.py): move credential list to being a top-level param 2025-03-10 17:04:05 -07:00
Krrish Dholakia
1e89fdec99 fix(router.py): comment out azure/openai client init - not necessary 2025-03-10 16:47:43 -07:00
Krrish Dholakia
c71af5b92e feat(proxy_server.py): check code before defaulting to status code 2025-03-10 15:34:06 -07:00
Krish Dholakia
91b41204fb Litellm dev 03 08 2025 p3 (#9089)
* feat(ollama_chat.py): pass down http client to ollama_chat

enables easier testing

* fix(factory.py): fix passing images to ollama's `/api/generate` endpoint

Fixes https://github.com/BerriAI/litellm/issues/6683

* fix(factory.py): fix ollama pt to handle templating correctly
2025-03-09 18:20:56 -07:00
Ishaan Jaff
117a1e1226 (UI) - Fix show correct count of internal user keys on Users Page (#9082)
* get_user_key_counts

* fix get_user_key_counts

* fix get_user_key_counts

* test_get_users_filters_dashboard_keys

* remove unused func
2025-03-08 16:13:18 -08:00
Ishaan Jaff
0462ab14d8 (Clean up) - Allow switching off storing Error Logs in DB (#9084)
* fix - cleanup, dont store ErrorLogs in 2 tables

* async_post_call_failure_hook

* docs disable error logs

* disable_error_logs
2025-03-08 16:12:03 -08:00
Krish Dholakia
44c9eef64f Fix batches api cost tracking + Log batch models in spend logs / standard logging payload (#9077)
* feat(batches/): fix batch cost calculation - ensure it's accurate

use the correct cost value - prev. defaulting to non-batch cost

* feat(batch_utils.py): log batch models to spend logs + standard logging payload

makes it easy to understand how cost was calculated

* fix: fix stored payload for test

* test: fix test
2025-03-08 11:47:25 -08:00
Krish Dholakia
9fc7bd0493 UI - new API Playground for testing LiteLLM translation (#9073)
* feat: initial commit - enable dev to see translated request

* feat(utils.py): expose new endpoint - `/utils/transform_request` to see the raw request sent by litellm

* feat(transform_request.tsx): allow user to see their transformed request

* refactor(litellm_logging.py): return raw request in 3 parts - api_base, headers, request body

easier to render each individually on UI vs. extracting from combined string

* feat: transform_request.tsx

working e2e raw request viewing

* fix(litellm_logging.py): fix transform viewing for bedrock models

* fix(litellm_logging.py): don't return sensitive headers in raw request headers

prevent accidental leak

* feat(transform_request.tsx): style improvements
2025-03-07 19:39:31 -08:00