phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity
16952 commits 1603 branches 645 tags 320 MiB
Commit graph

16952 commits

This branch
This branch
All branches
Author SHA1 Message Date
Ishaan Jaff
d9769c393e ui new build 2024-08-24 16:45:53 -07:00
Ishaan Jaff
20840eaad3 fix linting errors when adding a new team member 2024-08-24 16:38:43 -07:00
Ishaan Jaff
0ad5f58930
Merge pull request #5357 from BerriAI/ui_allow_setting_tpm_rpm_per_model 
[Feat] Admin UI - allow setting tpm / rpm per model
 2024-08-24 16:28:08 -07:00
Ishaan Jaff
c99914d18e
Merge pull request #5356 from BerriAI/ui_allow_setting_rpm_tpm_on_ui 
Feat - ui allow setting tpm / rpm limits on keys on ui
 2024-08-24 16:27:58 -07:00
Ishaan Jaff
11187920ec
Merge pull request #5352 from BerriAI/litellm_allow_setting_caching_mode 
[Feat-Caching] allow setting caching mode to default off
 2024-08-24 16:27:45 -07:00
Ishaan Jaff
35740da03d
Merge pull request #5354 from BerriAI/vertex_allow_auth 
[Feat-Vertex] Support using  workload identity federation
 2024-08-24 16:27:29 -07:00
Ishaan Jaff
e8b9fbf9f9 fix allow setting per model tpm rpm limits 2024-08-24 15:34:25 -07:00
Ishaan Jaff
98d1113e89 ui allow setting tpm / rpm limits on ui 2024-08-24 12:42:39 -07:00
Ishaan Jaff
16b1302702
Merge pull request #5350 from BerriAI/ui_show_user_id_on_table 
Admin UI - show user_id on Key Table
 2024-08-24 10:52:47 -07:00
Ishaan Jaff
f597fab798
Merge pull request #5349 from BerriAI/dependabot/npm_and_yarn/ui/micromatch-4.0.8 
build(deps): bump micromatch from 4.0.5 to 4.0.8 in /ui
 2024-08-24 10:52:38 -07:00
Ishaan Jaff
eb620a8b6b
Merge pull request #5353 from BerriAI/litellm_fix_pip_nacl_error 
[Fix] pip litellm proxy - No module named 'nacl'
 2024-08-24 10:52:20 -07:00
Ishaan Jaff
3228125215 feat use identity_pool for vertex 2024-08-24 10:51:46 -07:00
Krrish Dholakia
5a2c9d5121 test(test_router.py): add test to ensure error is correctly re-raised 2024-08-24 10:08:14 -07:00
Krrish Dholakia
0b06a76cf9 fix(router.py): don't cooldown on apiconnectionerrors 
Fixes issue where model would be in cooldown due to api connection errors
 2024-08-24 09:53:05 -07:00
Ishaan Jaff
ac6f15ae2c fix pynacl error 2024-08-24 09:48:45 -07:00
Ishaan Jaff
74f0e60962 fix set Caching Default Off 2024-08-24 09:43:39 -07:00
Ishaan Jaff
feb354d3bc fix should_use_cache 2024-08-24 09:37:41 -07:00
Krrish Dholakia
8782ee444d feat(team_endpoints.py): expose 2 new fields - updated_users and updated_team_memberships, on /team/member_add 
Fixes https://github.com/BerriAI/litellm/issues/5345#issuecomment-2307863265

Helps user see the stored budget per team member
 2024-08-24 09:22:16 -07:00
Ishaan Jaff
01adc45f0f test caching default on /off 2024-08-24 09:06:59 -07:00
Ishaan Jaff
3c1da2e823 feat - allow setting cache mode 2024-08-24 09:03:59 -07:00
Krrish Dholakia
8c5ff150f6 fix(huggingface_restapi.py): fix tests 2024-08-23 21:40:27 -07:00
Krrish Dholakia
0c26b36d9d docs(input.md): update docs on together ai response_format params support 2024-08-23 21:34:18 -07:00
Krrish Dholakia
6d2ae5a0d8 fix(utils.py): support passing response_format for together ai calls 2024-08-23 21:31:59 -07:00
Krrish Dholakia
74a85fac0e docs(aws_sagemaker.md): cleanup sagemaker messages api docs 2024-08-23 21:17:16 -07:00
Krish Dholakia
cd61ddc610
Merge pull request #5343 from BerriAI/litellm_sagemaker_chat 
feat(sagemaker.py): add sagemaker messages api support
 2024-08-23 21:00:00 -07:00
Ishaan Jaff
f618eb0a67 fix show user_id on table 2024-08-23 20:54:44 -07:00
Krrish Dholakia
30ec166556 test(test_sagemaker.py): fix test 2024-08-23 20:49:01 -07:00
Krish Dholakia
f458f565af
Merge pull request #5292 from OgnjenFrancuski/main 
Update SSL verification
 2024-08-23 20:42:35 -07:00
Krrish Dholakia
ac9a1e65ab fix(proxy_server.py): fix post /v1/batches endpoint 
Fixes https://github.com/BerriAI/litellm/issues/5279#issuecomment-2307919820
 2024-08-23 20:38:00 -07:00
dependabot[bot]
7f8a8279ea
build(deps): bump micromatch from 4.0.5 to 4.0.8 in /ui 
Bumps [micromatch](https://github.com/micromatch/micromatch) from 4.0.5 to 4.0.8.
- [Release notes](https://github.com/micromatch/micromatch/releases)
- [Changelog](https://github.com/micromatch/micromatch/blob/4.0.8/CHANGELOG.md)
- [Commits](https://github.com/micromatch/micromatch/compare/4.0.5...4.0.8)

---
updated-dependencies:
- dependency-name: micromatch
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-08-24 01:31:29 +00:00
Ishaan Jaff
2c60d98e34 bump: version 1.44.4 → 1.44.5 2024-08-23 18:30:34 -07:00
Ishaan Jaff
2116046b91
Merge pull request #5346 from BerriAI/litellm_Add_vertex_text_to_speech 
[Feat-LiteLLM] Add Vertex AI - Text to speech support
 2024-08-23 18:29:53 -07:00
Ishaan Jaff
a7bcc0e88e docs tts 2024-08-23 18:29:36 -07:00
Ishaan Jaff
80e95b4ccf add mock testing for vertex tts 2024-08-23 18:18:37 -07:00
Ishaan Jaff
8fada93fff docs on using vertex tts 2024-08-23 17:57:49 -07:00
Ishaan Jaff
225ff8432d test vertex ai text to speech 2024-08-23 16:06:39 -07:00
Krrish Dholakia
ab28e55b76 fix(proxy_server.py): support env vars for controlling global max parallel request retry/timeouts 
fixes issue where litellm module level settings weren't working for global retries, due to time of init
 2024-08-23 16:06:08 -07:00
Ishaan Jaff
755a0514f6 fix linting 2024-08-23 16:05:31 -07:00
Ishaan Jaff
82c3357454 add example using tts on vertex ai 2024-08-23 16:04:51 -07:00
Ishaan Jaff
5c3a1484c3 docs text to speech 2024-08-23 15:50:03 -07:00
Ishaan Jaff
c3987745fe fix linting errors 2024-08-23 15:44:31 -07:00
Ishaan Jaff
49b25db516 init comit for vtx text to speech 2024-08-23 15:40:52 -07:00
Ishaan Jaff
960a141884 add test_audio_speech_litellm_vertex 2024-08-23 15:36:42 -07:00
Krrish Dholakia
3007f0344d fix(utils.py): only filter additional properties if gemini/vertex ai 2024-08-23 14:22:59 -07:00
Ishaan Jaff
92e5cd113d
Merge pull request #5342 from BerriAI/litellm_add_custom_guardrails 
[Feat-Proxy] Add Custom Guardrails
 2024-08-23 12:11:31 -07:00
Ishaan Jaff
918e4fcfe5 feat add test for custom guardrails 2024-08-23 12:01:43 -07:00
Ishaan Jaff
5895f0c615 fix custom guardrail test 2024-08-23 11:58:20 -07:00
Ishaan Jaff
1b1e0f2d77 init custom guardrail class 2024-08-23 10:54:42 -07:00
Krrish Dholakia
3f116b25a9 feat(sagemaker.py): add sagemaker messages api support 
Closes https://github.com/BerriAI/litellm/issues/2641

 Closes https://github.com/BerriAI/litellm/pull/5178
 2024-08-23 10:31:35 -07:00
Ishaan Jaff
7d30188f84 custom_callbacks 2024-08-23 09:52:52 -07:00