Commit graph

16623 commits

Author SHA1 Message Date
Ishaan Jaff
a6a4b944ad user api key auth rpm_limit_per_model 2024-08-16 18:22:35 -07:00
Krrish Dholakia
d991e1320c docs(langfuse_integration.md): add disable logging for specific calls to docs 2024-08-16 17:36:13 -07:00
Krish Dholakia
6cf8c47366
Merge pull request #5255 from BerriAI/litellm_fix_token_counter
fix(utils.py): fix get_image_dimensions to handle more image types
2024-08-16 17:27:27 -07:00
Krrish Dholakia
7fce6b0163 fix(health_check.py): return 'missing mode' error message, if error with health check, and mode is missing 2024-08-16 17:24:29 -07:00
Ishaan Jaff
51da6ab64e fix databricks streaming test 2024-08-16 16:56:08 -07:00
Krrish Dholakia
a92dcdd2d6 fix(litellm_logging.py): fix price information logging to s3 2024-08-16 16:42:38 -07:00
Krrish Dholakia
178139f18d feat(litellm_logging.py): support logging model price information to s3 logs 2024-08-16 16:21:34 -07:00
Ishaan Jaff
5d1fcc545b fix predictions image generation response 2024-08-16 15:06:12 -07:00
Ishaan Jaff
31f9453618 skip InternalServerError on vertex test 2024-08-16 14:51:51 -07:00
Ishaan Jaff
cff01b2de3
Merge pull request #5243 from BerriAI/litellm_add_bedrock_traces_in_response
[Feat] Add bedrock Guardrail `traces ` in response when trace=enabled
2024-08-16 14:49:20 -07:00
Ishaan Jaff
84925264d8 docs oauth2 2024-08-16 14:03:56 -07:00
Ishaan Jaff
3d06b51e4e docs correct link to oauth 2.0 2024-08-16 14:02:58 -07:00
Ishaan Jaff
c5e5bd20ac
Merge pull request #5252 from BerriAI/litellm_allow_auth_oauth_2
[Feat-Proxy] Add Oauth 2.0 Support
2024-08-16 14:01:06 -07:00
Ishaan Jaff
ac833f415d docs oauh 2.0 enterprise feature 2024-08-16 14:00:24 -07:00
Ishaan Jaff
0d41e2972b docs on oauth 2.0 2024-08-16 13:55:28 -07:00
Ishaan Jaff
cd28b6607e add debugging for oauth2.0 2024-08-16 13:40:32 -07:00
Ishaan Jaff
d4b33cf87c allow using oauth2 checks for logging into proxy 2024-08-16 13:36:29 -07:00
David Manouchehri
bef8568cb3
(oidc): Improve docs for unofficial provider. 2024-08-16 20:30:41 +00:00
Ishaan Jaff
0c0b835c3f add init commit for oauth 2 checks 2024-08-16 13:30:22 -07:00
David Manouchehri
11668c31c1
(oidc): Add support for loading tokens via a file, environment variable, and from a file path set in an env var. 2024-08-16 20:13:07 +00:00
Ishaan Jaff
9c3124c5a7 ui new build 2024-08-16 12:53:23 -07:00
Ishaan Jaff
bd7bf7f6b0 fix endpoint name on router 2024-08-16 12:46:43 -07:00
Ishaan Jaff
f92cabbceb
Merge pull request #5250 from BerriAI/docs_sagemaker_docs
[Docs] Sagemaker add example on using with LiteLLM Proxy and temperature=0
2024-08-16 12:43:02 -07:00
Ishaan Jaff
dcd8ff44df docs add example on setting temp=0 for sagemaker 2024-08-16 12:04:35 -07:00
Krrish Dholakia
7129e93992 fix(utils.py): fix get_image_dimensions to handle more image types
Fixes https://github.com/BerriAI/litellm/issues/5205
2024-08-16 12:00:04 -07:00
Ishaan Jaff
63b4e11bfd docs sagemaker - add example using with proxy 2024-08-16 11:47:13 -07:00
Ishaan Jaff
7f39f9f97d docs cleanup 2024-08-16 11:38:53 -07:00
Ishaan Jaff
740d1fdb1c add provider_specific_fields to GenericStreamingChunk 2024-08-16 11:38:22 -07:00
Ishaan Jaff
9851fa7b1b return traces in bedrock guardrails when enabled 2024-08-16 11:35:43 -07:00
Krrish Dholakia
cbdaecb5a8 fix(__init__.py): fix models_by_provider to include cohere_chat models
Fixes https://github.com/BerriAI/litellm/issues/5201
2024-08-16 11:33:23 -07:00
Krrish Dholakia
61f4b71ef7 refactor: replace .error() with .exception() logging for better debugging on sentry 2024-08-16 09:22:47 -07:00
Ishaan Jaff
89ba7b3e11 pass trace through for bedrock guardrails 2024-08-16 09:10:56 -07:00
Ishaan Jaff
3d7e3d65d0
Merge pull request #5135 from BerriAI/dependabot/pip/aiohttp-3.10.2
build(deps): bump aiohttp from 3.9.4 to 3.10.2
2024-08-16 09:07:02 -07:00
Ishaan Jaff
374a46d924
Merge pull request #5173 from gitravin/rn/sagemaker-zero-temp
Allow zero temperature for Sagemaker models based on config
2024-08-16 08:45:44 -07:00
Ishaan Jaff
026c7194f8 add provider_specific_fields to GenericStreamingChunk 2024-08-16 08:44:29 -07:00
Paul Lang
b0d13f42ed Merge remote-tracking branch 'origin/main' into fix_anthropic_tool_streaming_index 2024-08-16 09:26:04 -04:00
Krrish Dholakia
1510daba4f bump: version 1.43.15 → 1.43.16 2024-08-15 23:04:30 -07:00
Krish Dholakia
6c3f37f8b4
Merge pull request #5235 from BerriAI/litellm_fix_s3_logs
fix(s3.py): fix s3 logging payload to have valid json values
2024-08-15 23:00:18 -07:00
Krish Dholakia
1dbc9b8a2e
Merge pull request #5215 from BerriAI/litellm_pass_through_endpoints_api
CRUD Endpoints for Pass-Through endpoints
2024-08-15 22:39:39 -07:00
Krish Dholakia
b3d15ace89
Merge branch 'main' into litellm_pass_through_endpoints_api 2024-08-15 22:39:19 -07:00
Krrish Dholakia
6fc6df134f feat(ui): for adding pass-through endpoints 2024-08-15 21:58:11 -07:00
Ishaan Jaff
a614c9f525 fix sagemaker old used test 2024-08-15 21:55:27 -07:00
Krrish Dholakia
589da45c24 feat(pass_through_endpoints.py): initial working CRUD endpoints for /pass_through_endoints 2024-08-15 21:23:26 -07:00
Ishaan Jaff
eb9e5af1a3 fix test sagemaker config test 2024-08-15 21:18:18 -07:00
Ishaan Jaff
9546268aa5
Merge pull request #5238 from BerriAI/litellm_fix_use_prompt_caching_proxy
fix using anthropic prompt caching on proxy
2024-08-15 20:14:23 -07:00
Ishaan Jaff
6cb3675a06 fix using prompt caching on proxy 2024-08-15 20:12:11 -07:00
Ishaan Jaff
42c2290a77 bump: version 1.43.14 → 1.43.15 2024-08-15 19:53:51 -07:00
Ishaan Jaff
33ccf064eb bump: version 1.43.13 → 1.43.14 2024-08-15 19:53:51 -07:00
Ishaan Jaff
f7dec5be25
Merge pull request #5237 from BerriAI/litellm_make_sagemaker_async_v2
[Feat] Make Sagemaker Async
2024-08-15 19:50:45 -07:00
Ishaan Jaff
e1839c8da2 allow index to not exist in sagemaker chunks 2024-08-15 19:45:59 -07:00