Commit graph

9 commits

Author SHA1 Message Date
Krish Dholakia
dec53961f7 LiteLLM Minor Fixes and Improvements (11/09/2024) (#5634)
* fix(caching.py): set ttl for async_increment cache

fixes issue where ttl for redis client was not being set on increment_cache

Fixes https://github.com/BerriAI/litellm/issues/5609

* fix(caching.py): fix increment cache w/ ttl for sync increment cache on redis

Fixes https://github.com/BerriAI/litellm/issues/5609

* fix(router.py): support adding retry policy + allowed fails policy via config.yaml

* fix(router.py): don't cooldown single deployments

No point, as there's no other deployment to loadbalance with.

* fix(user_api_key_auth.py): support setting allowed email domains on jwt tokens

Closes https://github.com/BerriAI/litellm/issues/5605

* docs(token_auth.md): add user upsert + allowed email domain to jwt auth docs

* fix(litellm_pre_call_utils.py): fix dynamic key logging when team id is set

Fixes issue where key logging would not be set if team metadata was not none

* fix(secret_managers/main.py): load environment variables correctly

Fixes issue where os.environ/ was not being loaded correctly

* test(test_router.py): fix test

* feat(spend_tracking_utils.py): support logging additional usage params - e.g. prompt caching values for deepseek

* test: fix tests

* test: fix test

* test: fix test

* test: fix test

* test: fix test
2024-09-11 22:36:06 -07:00
hughcrt
89cee153eb add tests 2024-06-13 15:10:24 -03:00
Vince Loewe
11f02db55b Lunary: Fix tool calling 2024-05-03 17:42:50 +01:00
Krrish Dholakia
7eff73c4e4 ci(config.yml): add lunary to circle ci 2024-03-29 22:09:21 -07:00
Vince Loewe
ca59516ff0 fix streaming 2024-02-29 13:23:51 -08:00
Vince Loewe
95f748ce91 remove auto install 2024-02-29 12:33:07 -08:00
Vince Loewe
499fa36aa3 support templates 2024-02-28 22:18:39 -08:00
Vince Loewe
91f77fa7a6 fix timestamps and user 2024-02-27 22:30:32 -08:00
Vince Loewe
c8a0a38c2a feat: LLMonitor is now Lunary 2024-02-27 22:07:13 -08:00