Commit graph

15937 commits

Author SHA1 Message Date
Ishaan Jaff
2eea29ecb3 fix get_request_route 2024-08-05 15:17:15 -07:00
Ishaan Jaff
533ffd6020 test proxy server routes 2024-08-05 15:17:15 -07:00
Ishaan Jaff
35dde9d2a8 use get_request_route 2024-08-05 15:17:15 -07:00
Ishaan Jaff
5c3afc3aba add get_request_route 2024-08-05 15:17:15 -07:00
Krrish Dholakia
936640948d fix: bump default allowed_fails + reduce default db pool limit
Fixes issues with running proxy server in production
2024-08-05 15:07:46 -07:00
Krrish Dholakia
aef25d5d00 fix: cleanup test 2024-08-05 11:23:49 -07:00
Krrish Dholakia
a9fdfb5a99 fix(init.py): rename feature_flag 2024-08-05 11:23:20 -07:00
Krrish Dholakia
3c4c78a71f feat(caching.py): enable caching on provider-specific optional params
Closes https://github.com/BerriAI/litellm/issues/5049
2024-08-05 11:18:59 -07:00
Ishaan Jaff
e978c6b056
Merge pull request #4142 from BerriAI/litellm_ui_on_server_root_url
[FIX] allow setting UI BASE path
2024-08-05 11:17:55 -07:00
Ishaan Jaff
35792ccc1f fix test fine tuning api azure 2024-08-05 11:08:13 -07:00
Ishaan Jaff
bf28b893d8
Merge pull request #5050 from BerriAI/litellm_use_base_path
[Proxy-Fix] Requests that are incorrectly flagged as admin-only paths
2024-08-05 11:04:39 -07:00
Ishaan Jaff
6d2063d1cb fix get_request_route 2024-08-05 10:33:40 -07:00
Ishaan Jaff
948e513fec test proxy server routes 2024-08-05 10:14:23 -07:00
Ishaan Jaff
aa7174c270 use get_request_route 2024-08-05 10:13:47 -07:00
Ishaan Jaff
13f01ed57f add get_request_route 2024-08-05 10:12:34 -07:00
Krrish Dholakia
cd94c3adc1 fix(types/router.py): remove model_info pydantic field
Fixes https://github.com/BerriAI/litellm/issues/5042
2024-08-05 09:58:44 -07:00
Krrish Dholakia
8fa39b058d docs(azure.md): cleanup docs 2024-08-05 09:38:45 -07:00
Krrish Dholakia
0230889ec4 docs: cleanup docs
Fixes https://github.com/BerriAI/litellm/issues/5043
2024-08-05 09:38:21 -07:00
Krrish Dholakia
3fee0b1dc5 fix(ollama_chat.py): fix passing auth headers to ollama
Fixes https://github.com/BerriAI/litellm/issues/5046
2024-08-05 09:33:09 -07:00
Krrish Dholakia
e0c986c000 build(model_prices_and_context_window.json): update gpt-4o-mini max_output_tokens
Fixes https://github.com/BerriAI/litellm/issues/5045
2024-08-05 09:30:18 -07:00
Ishaan Jaff
e3119cef38 add sample spec to model cost map 2024-08-05 09:27:26 -07:00
Ishaan Jaff
0214ff5fe0
Merge pull request #5047 from BerriAI/litellm_log_request_response_gcs
[Feat-Proxy] Log request/response on GCS
2024-08-05 09:05:56 -07:00
Ishaan Jaff
9314341b9e docs show fields logged on gcs bucket 2024-08-05 08:58:54 -07:00
Krrish Dholakia
f610fba58f fix(user_api_key_auth.py): handle older user_role's
Fixes issue where older user_role's (e.g. app_user) weren't being recognized. + Adds testing for it
2024-08-05 08:57:06 -07:00
Ishaan Jaff
a6e4fdf502 test gcs bucket 2024-08-05 08:56:10 -07:00
Ishaan Jaff
a4eb32f4f3 fix linting errors 2024-08-05 08:54:04 -07:00
Ishaan Jaff
8eb73381d6 simplify GCS payload 2024-08-05 08:48:23 -07:00
Ishaan Jaff
377272a152 add ALL_LITELLM_RESPONSE_TYPES 2024-08-05 08:41:13 -07:00
Ishaan Jaff
566d51767f use util convert_litellm_response_object_to_dict 2024-08-05 08:40:19 -07:00
Krrish Dholakia
51211dc2a6 docs(gemini.md): add json mode, response schema, supported openai params to gemini docs 2024-08-05 08:11:07 -07:00
Krrish Dholakia
aab09f5b86 feat(vertex_httpx.py): Support gemini 'response_schema' param
Fixes https://github.com/BerriAI/litellm/pull/3366#issuecomment-2269183338
2024-08-05 07:56:44 -07:00
Krrish Dholakia
1c747f3ad3 bump: version 1.42.12 → 1.43.0 2024-08-03 22:01:50 -07:00
Krish Dholakia
574bb614b9
Merge pull request #5040 from BerriAI/litellm_anthropic_api_streaming
feat(anthropic_adapter.py): support streaming requests for `/v1/messages` endpoint
2024-08-03 21:16:58 -07:00
Krish Dholakia
bca71019ad
Merge branch 'main' into litellm_anthropic_api_streaming 2024-08-03 21:16:50 -07:00
Krrish Dholakia
d4796d6369 docs(sidebar.js): cleanup 2024-08-03 20:57:43 -07:00
Krrish Dholakia
f5b93fa80d fix(anthropic_adapter.py): fix sync streaming 2024-08-03 20:52:29 -07:00
Krish Dholakia
c5fe467cdd
Merge pull request #5025 from jcheng5/streaming-tools-anthropic
Handle bedrock tool calling in stream_chunk_builder
2024-08-03 20:31:05 -07:00
Krish Dholakia
bd227f7b57
Merge pull request #5036 from BerriAI/litellm_loadbalancing_test
feat(router.py): add flag for mock testing loadbalancing for rate limit errors
2024-08-03 20:30:01 -07:00
Krish Dholakia
9ba8e3047f
Merge branch 'main' into litellm_loadbalancing_test 2024-08-03 20:29:54 -07:00
Krrish Dholakia
23cad65256 test: fix test 2024-08-03 20:28:11 -07:00
Krrish Dholakia
ac6c39c283 feat(anthropic_adapter.py): support streaming requests for /v1/messages endpoint
Fixes https://github.com/BerriAI/litellm/issues/5011
2024-08-03 20:16:19 -07:00
Ishaan Jaff
22bc70633e docs add when to use litellm 2024-08-03 19:10:16 -07:00
Ishaan Jaff
93b0d23997 fix fine tune api tests 2024-08-03 19:02:11 -07:00
Ishaan Jaff
7fae2aa394 ci/cd run again 2024-08-03 18:48:10 -07:00
Ishaan Jaff
009697425d fix fine tuning tests 2024-08-03 18:34:26 -07:00
Ishaan Jaff
1c1631222c fix test test_aimage_generation_vertex_ai 2024-08-03 18:32:52 -07:00
Ishaan Jaff
b6cf433ed9 bump: version 1.42.11 → 1.42.12 2024-08-03 18:12:53 -07:00
Ishaan Jaff
bbd11e61bf
Merge pull request #5037 from BerriAI/litellm_support_native_vertex_endpoint
[Feat] support all native vertex ai endpoints - Gemini API, Embeddings API, Imagen API, Batch prediction API, Tuning API, CountTokens API
2024-08-03 18:12:03 -07:00
Ishaan Jaff
e73eb19678 docs default vertex 2024-08-03 18:09:48 -07:00
Ishaan Jaff
3a94aac343 docs - fix merge conflicts 2024-08-03 17:59:46 -07:00