Commit graph

3109 commits

Author SHA1 Message Date
Ishaan Jaff
da848696e3
Merge pull request #5059 from BerriAI/litelm_log_otel_args
OTEL - Log DB queries / functions on OTEL
2024-08-05 20:51:11 -07:00
Ishaan Jaff
bec0350127 otel fix async_service_failure_hook 2024-08-05 20:18:40 -07:00
Ishaan Jaff
09105277cd use otel callbacks 2024-08-05 20:00:06 -07:00
Ishaan Jaff
8dcea009b8 log event_metadata on otel service loggers 2024-08-05 19:58:55 -07:00
Krrish Dholakia
5c6dcd6029 test: improve debugging for test 2024-08-05 19:41:08 -07:00
Ishaan Jaff
091449e81b build ui on custom path 2024-08-05 16:34:37 -07:00
Ishaan Jaff
900e89c0ad set PROXY_BASE_URL when server root path set 2024-08-05 15:48:44 -07:00
Ishaan Jaff
6d2063d1cb fix get_request_route 2024-08-05 10:33:40 -07:00
Ishaan Jaff
aa7174c270 use get_request_route 2024-08-05 10:13:47 -07:00
Ishaan Jaff
13f01ed57f add get_request_route 2024-08-05 10:12:34 -07:00
Krrish Dholakia
f610fba58f fix(user_api_key_auth.py): handle older user_role's
Fixes issue where older user_role's (e.g. app_user) weren't being recognized. + Adds testing for it
2024-08-05 08:57:06 -07:00
Krish Dholakia
bca71019ad
Merge branch 'main' into litellm_anthropic_api_streaming 2024-08-03 21:16:50 -07:00
Krish Dholakia
9ba8e3047f
Merge branch 'main' into litellm_loadbalancing_test 2024-08-03 20:29:54 -07:00
Krrish Dholakia
ac6c39c283 feat(anthropic_adapter.py): support streaming requests for /v1/messages endpoint
Fixes https://github.com/BerriAI/litellm/issues/5011
2024-08-03 20:16:19 -07:00
Ishaan Jaff
e73eb19678 docs default vertex 2024-08-03 18:09:48 -07:00
Ishaan Jaff
c8438715af add vertex ai countTokens endpoint 2024-08-03 17:34:10 -07:00
Ishaan Jaff
2d5c57e545 add vertex embeddings endpoints 2024-08-03 17:26:49 -07:00
Ishaan Jaff
c98733863a add vertex generateContent 2024-08-03 17:17:54 -07:00
Ishaan Jaff
8051781af0 working code for vertex ai routes 2024-08-03 16:56:33 -07:00
Ishaan Jaff
64c008045f use native endpoints 2024-08-03 16:52:43 -07:00
Ishaan Jaff
af04bbecca set native vertex endpoints 2024-08-03 16:52:03 -07:00
Krrish Dholakia
6b8806b45f feat(router.py): add flag for mock testing loadbalancing for rate limit errors 2024-08-03 12:34:11 -07:00
Ishaan Jaff
19474c3f0f support v1/projects/tuningJobs 2024-08-03 11:46:39 -07:00
Ishaan Jaff
9dffe23108
Merge pull request #5030 from BerriAI/litellm_add_vertex_ft_proxy
[Feat] Add support for Vertex AI Fine tuning on LiteLLM Proxy
2024-08-03 08:29:11 -07:00
Ishaan Jaff
7fe46ac0ce add vertex example on config.yaml 2024-08-03 08:26:59 -07:00
Ishaan Jaff
4fc27e87c5 add vertex ai ft on proxy 2024-08-02 18:26:36 -07:00
Krrish Dholakia
5d96ff6694 fix(utils.py): handle scenario where model="azure/*" and custom_llm_provider="azure"
Fixes https://github.com/BerriAI/litellm/issues/4912
2024-08-02 17:48:53 -07:00
Krrish Dholakia
186e5f55e8 fix(user_api_key_auth.py): fix linting errors 2024-08-02 16:34:32 -07:00
Krrish Dholakia
1080c7014e build(ui): allow admin_viewer to view teams tab
Allows admin viewe role to see available teams on proxy ui
2024-08-02 16:19:40 -07:00
Krrish Dholakia
f506eb341b feat(litellm_logging.py): log exception response headers to langfuse 2024-08-01 18:07:47 -07:00
Ishaan Jaff
6c899ced28 init gcs using gcs_bucket 2024-08-01 18:07:38 -07:00
Ishaan Jaff
3ff07dfb14 use itellm.forward_traceparent_to_llm_provider 2024-08-01 18:07:38 -07:00
Ishaan Jaff
e32c1f4c9b ui new build 2024-08-01 18:07:38 -07:00
Krrish Dholakia
10b571ca42 fix(litellm_logging.py): use 1 cost calc function across response headers + logging integrations
Ensures consistent cost calculation when azure base models are used
2024-08-01 10:26:59 -07:00
Krrish Dholakia
d02d3d9712 build(model_prices_and_context_window.json): add azure gpt-4o-mini regional + global standard pricing to model cost map 2024-08-01 09:44:40 -07:00
Krrish Dholakia
d8a8cd2961 feat(ui): add ability to enable traceloop + langsmith via ui 2024-07-31 21:40:29 -07:00
Krrish Dholakia
d914aa558d feat(ui): add braintrust logging to ui 2024-07-31 21:15:19 -07:00
Krrish Dholakia
e1696bf426 fix(_types.py): fix finetuning endpoints 2024-07-31 19:07:37 -07:00
Ishaan Jaff
d833c69acb
Merge pull request #4987 from BerriAI/litellm_add_ft_endpoints
[Feat-Proxy] Add List fine-tuning jobs
2024-07-31 16:49:59 -07:00
Ishaan Jaff
cd3a01c03f fix fine tuning endpoint postion on swagger 2024-07-31 16:46:58 -07:00
Ishaan Jaff
9759fabe8f enforce ft endpoints as premium feature 2024-07-31 16:43:54 -07:00
Ishaan Jaff
bd15d0f4ca fix mark fine tuning endpoints as enteprrise 2024-07-31 16:41:14 -07:00
Ishaan Jaff
424a70c331 fix routes order 2024-07-31 16:36:50 -07:00
Ishaan Jaff
02e552e8f8 fix linting errors 2024-07-31 16:30:08 -07:00
Ishaan Jaff
e626f5c7d6 fix POST files 2024-07-31 16:27:59 -07:00
Ishaan Jaff
ddc74dbccc fix reading files/ft config 2024-07-31 16:23:36 -07:00
Ishaan Jaff
a6e62da9fb fix cancel ft job route 2024-07-31 16:19:15 -07:00
Ishaan Jaff
7d06b77fd9 add ft jobs in list of allowed routes 2024-07-31 16:19:00 -07:00
Ishaan Jaff
5f1070e47f add cancel endpoint 2024-07-31 16:12:36 -07:00
Ishaan Jaff
9b6231810b add GET fine_tuning/jobs 2024-07-31 15:58:35 -07:00