Commit graph

3143 commits

Author SHA1 Message Date
Ishaan Jaff
01cd07fa75 add vertex embeddings endpoints 2024-08-03 17:26:49 -07:00
Ishaan Jaff
beb7f1b2c6 add vertex generateContent 2024-08-03 17:17:54 -07:00
Ishaan Jaff
a293bebdb1 working code for vertex ai routes 2024-08-03 16:56:33 -07:00
Ishaan Jaff
568fd8aa63 use native endpoints 2024-08-03 16:52:43 -07:00
Ishaan Jaff
c206a9c2d7 set native vertex endpoints 2024-08-03 16:52:03 -07:00
Krrish Dholakia
b0d2727bbf feat(router.py): add flag for mock testing loadbalancing for rate limit errors 2024-08-03 12:34:11 -07:00
Ishaan Jaff
08d7b0f5c9 support v1/projects/tuningJobs 2024-08-03 11:46:39 -07:00
Ishaan Jaff
e07a38cca4 Merge pull request #5030 from BerriAI/litellm_add_vertex_ft_proxy
[Feat] Add support for Vertex AI Fine tuning on LiteLLM Proxy
2024-08-03 08:29:11 -07:00
Ishaan Jaff
eb59eecedf add vertex example on config.yaml 2024-08-03 08:26:59 -07:00
Ishaan Jaff
b2d4ab04a7 add vertex ai ft on proxy 2024-08-02 18:26:36 -07:00
Krrish Dholakia
e6bc7e938a fix(utils.py): handle scenario where model="azure/*" and custom_llm_provider="azure"
Fixes https://github.com/BerriAI/litellm/issues/4912
2024-08-02 17:48:53 -07:00
Krrish Dholakia
996763af1e fix(user_api_key_auth.py): fix linting errors 2024-08-02 16:34:32 -07:00
Krrish Dholakia
cbad9e7502 build(ui): allow admin_viewer to view teams tab
Allows admin viewe role to see available teams on proxy ui
2024-08-02 16:19:40 -07:00
Krrish Dholakia
857ec4af18 feat(litellm_logging.py): log exception response headers to langfuse 2024-08-01 18:07:47 -07:00
Ishaan Jaff
1a8d27299b init gcs using gcs_bucket 2024-08-01 18:07:38 -07:00
Ishaan Jaff
31fba8c462 use itellm.forward_traceparent_to_llm_provider 2024-08-01 18:07:38 -07:00
Ishaan Jaff
54e0b75295 ui new build 2024-08-01 18:07:38 -07:00
Krrish Dholakia
08541d056c fix(litellm_logging.py): use 1 cost calc function across response headers + logging integrations
Ensures consistent cost calculation when azure base models are used
2024-08-01 10:26:59 -07:00
Krrish Dholakia
b9d12ea2ec build(model_prices_and_context_window.json): add azure gpt-4o-mini regional + global standard pricing to model cost map 2024-08-01 09:44:40 -07:00
Krrish Dholakia
e60bec92ac feat(ui): add ability to enable traceloop + langsmith via ui 2024-07-31 21:40:29 -07:00
Krrish Dholakia
c5e38b3bec feat(ui): add braintrust logging to ui 2024-07-31 21:15:19 -07:00
Krrish Dholakia
c9efe0bb14 fix(_types.py): fix finetuning endpoints 2024-07-31 19:07:37 -07:00
Ishaan Jaff
4f21ce2873 Merge pull request #4987 from BerriAI/litellm_add_ft_endpoints
[Feat-Proxy] Add List fine-tuning jobs
2024-07-31 16:49:59 -07:00
Ishaan Jaff
f90f3f28fb fix fine tuning endpoint postion on swagger 2024-07-31 16:46:58 -07:00
Ishaan Jaff
dce1853f8c enforce ft endpoints as premium feature 2024-07-31 16:43:54 -07:00
Ishaan Jaff
844d5c3ae0 fix mark fine tuning endpoints as enteprrise 2024-07-31 16:41:14 -07:00
Ishaan Jaff
8a266a0493 fix routes order 2024-07-31 16:36:50 -07:00
Ishaan Jaff
af0e3ac23a fix linting errors 2024-07-31 16:30:08 -07:00
Ishaan Jaff
b1196c6afa fix POST files 2024-07-31 16:27:59 -07:00
Ishaan Jaff
098e1eb8ad fix reading files/ft config 2024-07-31 16:23:36 -07:00
Ishaan Jaff
6d88f4f31b fix cancel ft job route 2024-07-31 16:19:15 -07:00
Ishaan Jaff
577fbcd770 add ft jobs in list of allowed routes 2024-07-31 16:19:00 -07:00
Ishaan Jaff
30b339739d add cancel endpoint 2024-07-31 16:12:36 -07:00
Ishaan Jaff
956a082215 add GET fine_tuning/jobs 2024-07-31 15:58:35 -07:00
Ishaan Jaff
7cded198c2 add test for ft endpoints on azure 2024-07-31 15:30:26 -07:00
Ishaan Jaff
91c787a77b add examples on config 2024-07-31 15:29:06 -07:00
Ishaan Jaff
d7c0e0c471 allow setting files config 2024-07-31 15:28:41 -07:00
Krrish Dholakia
368af6975a fix(http_handler.py): correctly re-raise timeout exception 2024-07-31 14:51:28 -07:00
Ishaan Jaff
647f436c51 add /fine_tuning/jobs routes 2024-07-31 13:50:51 -07:00
Ishaan Jaff
47cbd62347 validation for passing config file 2024-07-31 13:32:18 -07:00
Ishaan Jaff
967d18d03d read ft config 2024-07-31 13:31:00 -07:00
Ishaan Jaff
2a87aa0463 fix endpoint to create fine tuning jobs 2024-07-31 12:44:01 -07:00
Ishaan Jaff
b630ff6286 fix pydantic obj for FT endpoints 2024-07-31 12:41:39 -07:00
Ishaan Jaff
8e6b30ceea feat add POST /v1/fine_tuning/jobs 2024-07-31 11:57:52 -07:00
Krish Dholakia
b6e67163c9 Merge pull request #4979 from BerriAI/litellm_cost_calc_fix
fix(utils.py): fix model registeration to model cost map
2024-07-30 20:32:58 -07:00
Ishaan Jaff
6cc5b4aa4e fix test proxy routes 2024-07-30 19:53:36 -07:00
Krrish Dholakia
f76a4bab49 fix(user_api_key_cache): fix check to not raise error if team object is missing 2024-07-30 18:25:04 -07:00
Krrish Dholakia
0bcfdafc58 fix(utils.py): fix model registeration to model cost map
Fixes https://github.com/BerriAI/litellm/issues/4972
2024-07-30 18:15:00 -07:00
Krrish Dholakia
1915adfc2d fix(auth_checks.py): fix redis usage for team cached objects 2024-07-30 17:30:00 -07:00
Ishaan Jaff
67bce867f6 Merge pull request #4975 from BerriAI/ui_switch_off_console_logs_in_prod
Proxy Admin UI - switch off console logs in production mode
2024-07-30 13:34:59 -07:00