phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 03:34:10 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
17201 commits 2497 branches 897 tags 550 MiB
Commit graph

3502 commits

Author SHA1 Message Date
Ishaan Jaff
15f1ead87f allow pass through routes as LLM API routes 2024-08-30 16:08:44 -07:00
Ishaan Jaff
f303f8daa8 Merge pull request #5450 from BerriAI/litellm_load_config_from_gcs 
[Feat-Proxy] Load config.yaml from GCS Bucket
 2024-08-30 12:08:54 -07:00
Ishaan Jaff
1b9aa7b357 vertex forward all headers from vertex 2024-08-30 11:05:23 -07:00
Ishaan Jaff
c60125d7be add gcs bucket base 2024-08-30 10:41:39 -07:00
Ishaan Jaff
ce1a0a93b5 use helper to get_config_file_contents_from_gcs 2024-08-30 10:26:42 -07:00
Ishaan Jaff
67a8907b1e Merge pull request #5438 from BerriAI/litellm_show_error_types_swagger 
[Feat-Proxy] Show all exceptioons types on swagger for LiteLLM Proxy
 2024-08-30 07:21:23 -07:00
Krish Dholakia
321b0961b5 fix: Minor LiteLLM Fixes + Improvements (29/08/2024) (#5436) 
* fix(model_checks.py): support returning wildcard models on `/v1/models`

Fixes https://github.com/BerriAI/litellm/issues/4903

* fix(bedrock_httpx.py): support calling bedrock via api_base

Closes https://github.com/BerriAI/litellm/pull/4587

* fix(litellm_logging.py): only leave last 4 char of gemini key unmasked

Fixes https://github.com/BerriAI/litellm/issues/5433

* feat(router.py): support setting 'weight' param for models on router

Closes https://github.com/BerriAI/litellm/issues/5410

* test(test_bedrock_completion.py): add unit test for custom api base

* fix(model_checks.py): handle no "/" in model
 2024-08-29 22:40:25 -07:00
Ishaan Jaff
378182cba2 show all error types on swagger 2024-08-29 18:50:41 -07:00
Ishaan Jaff
606013846e Merge branch 'main' into litellm_add_tag_control_team 2024-08-29 17:34:40 -07:00
Ishaan Jaff
56b3301f7f Merge branch 'main' into litellm_fwd_vtx_sdk_headers 2024-08-29 17:24:31 -07:00
Ishaan Jaff
3480dd8ab7 fix indentation 2024-08-29 17:01:23 -07:00
Ishaan Jaff
c30fd9a775 fix auth checks for provider routes 2024-08-29 16:40:46 -07:00
Ishaan Jaff
63393a10ec add test for vertex sdk foward headers 2024-08-29 15:50:54 -07:00
Ishaan Jaff
6491e461d6 vertex add vertex endpoints 2024-08-29 15:49:25 -07:00
Krrish Dholakia
7934af6c74 docs(docker_quick_start.md): add new quick start doc for litellm proxy 2024-08-29 15:35:39 -07:00
Ishaan Jaff
c6c3981ffa fix team based tag routing 2024-08-29 14:37:44 -07:00
Ishaan Jaff
9f9d43df44 enable_tag_filtering 2024-08-29 14:14:46 -07:00
Ishaan Jaff
8a677bffa4 add test_chat_completion_with_no_tags 2024-08-29 13:54:11 -07:00
Ishaan Jaff
6d57b5f803 define tags on model list 2024-08-29 13:06:39 -07:00
Ishaan Jaff
bc06920f04 add_team_based_tags_to_metadata 2024-08-29 13:06:03 -07:00
Ishaan Jaff
3bed17fc95 add set / update tags for a team 2024-08-29 13:05:00 -07:00
Ishaan Jaff
080ecb9f4a allow settings tags per team 2024-08-29 13:03:49 -07:00
Krish Dholakia
9327326100 Merge pull request #5414 from BerriAI/litellm_main_staging 
fixes: minor litellm fixes
 2024-08-28 22:01:01 -07:00
Krrish Dholakia
fd26e7b335 fix(team_endpoints.py): update to include the budget in the response 2024-08-28 21:58:41 -07:00
Krrish Dholakia
a8ea301bbe feat(team_endpoints.py): return team member budgets in /team/info call 
Fixes https://github.com/BerriAI/litellm/issues/5390
 2024-08-28 19:14:01 -07:00
Krish Dholakia
0e0db9a5af Merge branch 'main' into litellm_main_staging 2024-08-28 18:05:27 -07:00
Krrish Dholakia
6e4f0a95da fix(router.py): fix cooldown check 2024-08-28 16:38:42 -07:00
Ishaan Jaff
a27cf9960b Merge pull request #5420 from BerriAI/litellm_add_oauth2_mapping 
[Feat-Proxy] Add hook for oauth2 proxy headers
 2024-08-28 16:34:26 -07:00
Ishaan Jaff
51b6bbbdd3 Merge branch 'main' into litellm_add_request_body_safety_checks 2024-08-28 16:14:46 -07:00
Ishaan Jaff
f2c0e4d31e add hook for oauth2 proxy 2024-08-28 15:51:20 -07:00
Ishaan Jaff
f0ba94000d Merge pull request #5409 from BerriAI/litellm_ui_budgets 
[UI] Allow editing budget duration
 2024-08-28 14:43:57 -07:00
Ishaan Jaff
b8c092d430 new ui build 2024-08-28 14:43:33 -07:00
Ishaan Jaff
86d4504c7b fix checking request body 2024-08-28 14:10:09 -07:00
Ishaan Jaff
51d20628cd add checks for safe request body 2024-08-28 14:07:53 -07:00
Ishaan Jaff
5ff7e33dd8 add check for is_request_body_safe 2024-08-28 13:40:14 -07:00
Krrish Dholakia
ea3fe34105 fix(key_management_endpoints.py): expose 'key' param, for setting your own key value 2024-08-28 12:27:32 -07:00
Krrish Dholakia
276609f297 fix(rds_iam_token.py): support common aws env var's - AWS_ROLE_ARN, AWS_WEB_IDENTITY_TOKEN_FILE 2024-08-28 12:18:45 -07:00
Krrish Dholakia
cc2e1e1c43 fix(rds_iam_token.py): fix boto3 client init for rds 2024-08-28 12:15:57 -07:00
Krrish Dholakia
74081d31f6 fix(proxy/utils.py): fix model dump to exclude none values 2024-08-28 12:02:44 -07:00
Krrish Dholakia
b4c726d3e3 build(model_prices_and_context_window.json): add bedrock mistral small 2024-08-28 10:12:16 -07:00
Ishaan Jaff
d4db993130 add /rerank test 2024-08-27 17:50:37 -07:00
Ishaan Jaff
df4f1458e6 feat - add rerank on proxy 2024-08-27 17:36:40 -07:00
Ishaan Jaff
001882c14e Merge pull request #5392 from BerriAI/litellm_add_native_cohere_rerank 
[Feat] Add cohere rerank and together ai rerank
 2024-08-27 17:29:37 -07:00
Ishaan Jaff
359a003ac8 v0 add rerank on litellm proxy 2024-08-27 17:28:39 -07:00
Krrish Dholakia
d3105d8576 test(test_proxy_exception_mapping): loosen assert 2024-08-27 16:14:30 -07:00
Krrish Dholakia
722ccba323 fix(bedrock_httpx.py): support 'Auth' header as extra_header 
Fixes https://github.com/BerriAI/litellm/issues/5389#issuecomment-2313677977
 2024-08-27 16:08:54 -07:00
Krrish Dholakia
07dd3c640b perf(sagemaker.py): asyncify hf prompt template check 
leads to 189% improvement in RPS @ 100 users
 2024-08-27 07:37:06 -07:00
Ishaan Jaff
d682d5ed95 fix created_at and updated_at not existing error 2024-08-26 21:04:39 -07:00
Ishaan Jaff
ffb752d878 fix entrypoint 2024-08-26 20:32:23 -07:00
Ishaan Jaff
8059b6a7c3 ui new build 2024-08-26 19:01:35 -07:00