Commit graph

3087 commits

Author SHA1 Message Date
Krrish Dholakia
ac6c39c283 feat(anthropic_adapter.py): support streaming requests for /v1/messages endpoint
Fixes https://github.com/BerriAI/litellm/issues/5011
2024-08-03 20:16:19 -07:00
Ishaan Jaff
9dffe23108
Merge pull request #5030 from BerriAI/litellm_add_vertex_ft_proxy
[Feat] Add support for Vertex AI Fine tuning on LiteLLM Proxy
2024-08-03 08:29:11 -07:00
Ishaan Jaff
7fe46ac0ce add vertex example on config.yaml 2024-08-03 08:26:59 -07:00
Ishaan Jaff
4fc27e87c5 add vertex ai ft on proxy 2024-08-02 18:26:36 -07:00
Krrish Dholakia
5d96ff6694 fix(utils.py): handle scenario where model="azure/*" and custom_llm_provider="azure"
Fixes https://github.com/BerriAI/litellm/issues/4912
2024-08-02 17:48:53 -07:00
Krrish Dholakia
186e5f55e8 fix(user_api_key_auth.py): fix linting errors 2024-08-02 16:34:32 -07:00
Krrish Dholakia
1080c7014e build(ui): allow admin_viewer to view teams tab
Allows admin viewe role to see available teams on proxy ui
2024-08-02 16:19:40 -07:00
Krrish Dholakia
f506eb341b feat(litellm_logging.py): log exception response headers to langfuse 2024-08-01 18:07:47 -07:00
Ishaan Jaff
6c899ced28 init gcs using gcs_bucket 2024-08-01 18:07:38 -07:00
Ishaan Jaff
3ff07dfb14 use itellm.forward_traceparent_to_llm_provider 2024-08-01 18:07:38 -07:00
Ishaan Jaff
e32c1f4c9b ui new build 2024-08-01 18:07:38 -07:00
Krrish Dholakia
10b571ca42 fix(litellm_logging.py): use 1 cost calc function across response headers + logging integrations
Ensures consistent cost calculation when azure base models are used
2024-08-01 10:26:59 -07:00
Krrish Dholakia
d02d3d9712 build(model_prices_and_context_window.json): add azure gpt-4o-mini regional + global standard pricing to model cost map 2024-08-01 09:44:40 -07:00
Krrish Dholakia
d8a8cd2961 feat(ui): add ability to enable traceloop + langsmith via ui 2024-07-31 21:40:29 -07:00
Krrish Dholakia
d914aa558d feat(ui): add braintrust logging to ui 2024-07-31 21:15:19 -07:00
Krrish Dholakia
e1696bf426 fix(_types.py): fix finetuning endpoints 2024-07-31 19:07:37 -07:00
Ishaan Jaff
d833c69acb
Merge pull request #4987 from BerriAI/litellm_add_ft_endpoints
[Feat-Proxy] Add List fine-tuning jobs
2024-07-31 16:49:59 -07:00
Ishaan Jaff
cd3a01c03f fix fine tuning endpoint postion on swagger 2024-07-31 16:46:58 -07:00
Ishaan Jaff
9759fabe8f enforce ft endpoints as premium feature 2024-07-31 16:43:54 -07:00
Ishaan Jaff
bd15d0f4ca fix mark fine tuning endpoints as enteprrise 2024-07-31 16:41:14 -07:00
Ishaan Jaff
424a70c331 fix routes order 2024-07-31 16:36:50 -07:00
Ishaan Jaff
02e552e8f8 fix linting errors 2024-07-31 16:30:08 -07:00
Ishaan Jaff
e626f5c7d6 fix POST files 2024-07-31 16:27:59 -07:00
Ishaan Jaff
ddc74dbccc fix reading files/ft config 2024-07-31 16:23:36 -07:00
Ishaan Jaff
a6e62da9fb fix cancel ft job route 2024-07-31 16:19:15 -07:00
Ishaan Jaff
7d06b77fd9 add ft jobs in list of allowed routes 2024-07-31 16:19:00 -07:00
Ishaan Jaff
5f1070e47f add cancel endpoint 2024-07-31 16:12:36 -07:00
Ishaan Jaff
9b6231810b add GET fine_tuning/jobs 2024-07-31 15:58:35 -07:00
Ishaan Jaff
287b09cff6 add test for ft endpoints on azure 2024-07-31 15:30:26 -07:00
Ishaan Jaff
c8dfc95e90 add examples on config 2024-07-31 15:29:06 -07:00
Ishaan Jaff
2371df9ded allow setting files config 2024-07-31 15:28:41 -07:00
Krrish Dholakia
6202f9bbb0 fix(http_handler.py): correctly re-raise timeout exception 2024-07-31 14:51:28 -07:00
Ishaan Jaff
2cf10a621e add /fine_tuning/jobs routes 2024-07-31 13:50:51 -07:00
Ishaan Jaff
e4c73036fc validation for passing config file 2024-07-31 13:32:18 -07:00
Ishaan Jaff
bd7b485d09 read ft config 2024-07-31 13:31:00 -07:00
Ishaan Jaff
9d90f174a7 fix endpoint to create fine tuning jobs 2024-07-31 12:44:01 -07:00
Ishaan Jaff
ef5aeb17a1 fix pydantic obj for FT endpoints 2024-07-31 12:41:39 -07:00
Ishaan Jaff
415611b7f2 feat add POST /v1/fine_tuning/jobs 2024-07-31 11:57:52 -07:00
Krish Dholakia
22ff4a1e95
Merge pull request #4979 from BerriAI/litellm_cost_calc_fix
fix(utils.py): fix model registeration to model cost map
2024-07-30 20:32:58 -07:00
Ishaan Jaff
9d0e196687 fix test proxy routes 2024-07-30 19:53:36 -07:00
Krrish Dholakia
b77edc59ed fix(user_api_key_cache): fix check to not raise error if team object is missing 2024-07-30 18:25:04 -07:00
Krrish Dholakia
46634af06f fix(utils.py): fix model registeration to model cost map
Fixes https://github.com/BerriAI/litellm/issues/4972
2024-07-30 18:15:00 -07:00
Krrish Dholakia
142f4fefd0 fix(auth_checks.py): fix redis usage for team cached objects 2024-07-30 17:30:00 -07:00
Ishaan Jaff
6b17e84204
Merge pull request #4975 from BerriAI/ui_switch_off_console_logs_in_prod
Proxy Admin UI - switch off console logs in production mode
2024-07-30 13:34:59 -07:00
Ishaan Jaff
d5593a9106 ui new build 2024-07-30 13:33:34 -07:00
Ishaan Jaff
e0d0d45e87
Merge pull request #4973 from BerriAI/litellm_return_code_as_str
[Fix-Proxy] ProxyException code as str - Make OpenAI Compatible
2024-07-30 13:27:33 -07:00
Ishaan Jaff
66211b42db fix linting errors 2024-07-30 12:51:39 -07:00
Ishaan Jaff
e7b78a3337 add docs on status code from exceptions 2024-07-30 12:38:33 -07:00
Ishaan Jaff
74c4e3def8 return ProxyException code as str 2024-07-30 12:35:46 -07:00
Ishaan Jaff
563d59a305 test batches endpoint on proxy 2024-07-30 09:46:30 -07:00