Commit graph

9993 commits

Author SHA1 Message Date
Ishaan Jaff
da848696e3
Merge pull request #5059 from BerriAI/litelm_log_otel_args
OTEL - Log DB queries / functions on OTEL
2024-08-05 20:51:11 -07:00
Krrish Dholakia
e9df81ac19 test(test_key_generate_prisma.py): cleanup test 2024-08-05 20:29:53 -07:00
Ishaan Jaff
f55a0d98f3 otel log failures 2024-08-05 20:23:02 -07:00
Ishaan Jaff
6e4098fa26 otel log service errors 2024-08-05 20:21:26 -07:00
Ishaan Jaff
bec0350127 otel fix async_service_failure_hook 2024-08-05 20:18:40 -07:00
Ishaan Jaff
107c468d05 run ci/cd again 2024-08-05 20:04:19 -07:00
Ishaan Jaff
8d91112726 log event_metadata on otel 2024-08-05 20:03:34 -07:00
Ishaan Jaff
05a2a4462e otel log event_metadata 2024-08-05 20:01:58 -07:00
Ishaan Jaff
09105277cd use otel callbacks 2024-08-05 20:00:06 -07:00
Ishaan Jaff
8dcea009b8 log event_metadata on otel service loggers 2024-08-05 19:58:55 -07:00
Krrish Dholakia
5c6dcd6029 test: improve debugging for test 2024-08-05 19:41:08 -07:00
Ishaan Jaff
4538eb848f run ci/cd again 2024-08-05 16:52:45 -07:00
Ishaan Jaff
2e8a2548e1 build ui on custom path 2024-08-05 16:47:46 -07:00
Ishaan Jaff
3b8fc93091 set PROXY_BASE_URL when server root path set 2024-08-05 16:47:46 -07:00
Ishaan Jaff
775ef8a786 fix get_request_route 2024-08-05 16:47:46 -07:00
Ishaan Jaff
68f245c964 add get_request_route 2024-08-05 16:47:45 -07:00
Ishaan Jaff
28a37c0069 fix test fine tuning api azure 2024-08-05 15:17:15 -07:00
Ishaan Jaff
2eea29ecb3 fix get_request_route 2024-08-05 15:17:15 -07:00
Ishaan Jaff
533ffd6020 test proxy server routes 2024-08-05 15:17:15 -07:00
Ishaan Jaff
35dde9d2a8 use get_request_route 2024-08-05 15:17:15 -07:00
Ishaan Jaff
5c3afc3aba add get_request_route 2024-08-05 15:17:15 -07:00
Krrish Dholakia
aef25d5d00 fix: cleanup test 2024-08-05 11:23:49 -07:00
Krrish Dholakia
a9fdfb5a99 fix(init.py): rename feature_flag 2024-08-05 11:23:20 -07:00
Krrish Dholakia
3c4c78a71f feat(caching.py): enable caching on provider-specific optional params
Closes https://github.com/BerriAI/litellm/issues/5049
2024-08-05 11:18:59 -07:00
Krrish Dholakia
cd94c3adc1 fix(types/router.py): remove model_info pydantic field
Fixes https://github.com/BerriAI/litellm/issues/5042
2024-08-05 09:58:44 -07:00
Krrish Dholakia
3fee0b1dc5 fix(ollama_chat.py): fix passing auth headers to ollama
Fixes https://github.com/BerriAI/litellm/issues/5046
2024-08-05 09:33:09 -07:00
Krrish Dholakia
e0c986c000 build(model_prices_and_context_window.json): update gpt-4o-mini max_output_tokens
Fixes https://github.com/BerriAI/litellm/issues/5045
2024-08-05 09:30:18 -07:00
Ishaan Jaff
e3119cef38 add sample spec to model cost map 2024-08-05 09:27:26 -07:00
Ishaan Jaff
0214ff5fe0
Merge pull request #5047 from BerriAI/litellm_log_request_response_gcs
[Feat-Proxy] Log request/response on GCS
2024-08-05 09:05:56 -07:00
Krrish Dholakia
f610fba58f fix(user_api_key_auth.py): handle older user_role's
Fixes issue where older user_role's (e.g. app_user) weren't being recognized. + Adds testing for it
2024-08-05 08:57:06 -07:00
Ishaan Jaff
a6e4fdf502 test gcs bucket 2024-08-05 08:56:10 -07:00
Ishaan Jaff
a4eb32f4f3 fix linting errors 2024-08-05 08:54:04 -07:00
Ishaan Jaff
8eb73381d6 simplify GCS payload 2024-08-05 08:48:23 -07:00
Ishaan Jaff
377272a152 add ALL_LITELLM_RESPONSE_TYPES 2024-08-05 08:41:13 -07:00
Ishaan Jaff
566d51767f use util convert_litellm_response_object_to_dict 2024-08-05 08:40:19 -07:00
Krrish Dholakia
aab09f5b86 feat(vertex_httpx.py): Support gemini 'response_schema' param
Fixes https://github.com/BerriAI/litellm/pull/3366#issuecomment-2269183338
2024-08-05 07:56:44 -07:00
Krish Dholakia
bca71019ad
Merge branch 'main' into litellm_anthropic_api_streaming 2024-08-03 21:16:50 -07:00
Krrish Dholakia
f5b93fa80d fix(anthropic_adapter.py): fix sync streaming 2024-08-03 20:52:29 -07:00
Krish Dholakia
c5fe467cdd
Merge pull request #5025 from jcheng5/streaming-tools-anthropic
Handle bedrock tool calling in stream_chunk_builder
2024-08-03 20:31:05 -07:00
Krish Dholakia
9ba8e3047f
Merge branch 'main' into litellm_loadbalancing_test 2024-08-03 20:29:54 -07:00
Krrish Dholakia
23cad65256 test: fix test 2024-08-03 20:28:11 -07:00
Krrish Dholakia
ac6c39c283 feat(anthropic_adapter.py): support streaming requests for /v1/messages endpoint
Fixes https://github.com/BerriAI/litellm/issues/5011
2024-08-03 20:16:19 -07:00
Ishaan Jaff
93b0d23997 fix fine tune api tests 2024-08-03 19:02:11 -07:00
Ishaan Jaff
7fae2aa394 ci/cd run again 2024-08-03 18:48:10 -07:00
Ishaan Jaff
009697425d fix fine tuning tests 2024-08-03 18:34:26 -07:00
Ishaan Jaff
1c1631222c fix test test_aimage_generation_vertex_ai 2024-08-03 18:32:52 -07:00
Ishaan Jaff
e73eb19678 docs default vertex 2024-08-03 18:09:48 -07:00
Ishaan Jaff
bef5a8b61f
Merge branch 'main' into litellm_support_native_vertex_endpoint 2024-08-03 17:47:35 -07:00
Ishaan Jaff
c8438715af add vertex ai countTokens endpoint 2024-08-03 17:34:10 -07:00
Ishaan Jaff
2d5c57e545 add vertex embeddings endpoints 2024-08-03 17:26:49 -07:00