phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 11:43:54 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
9753 commits 2497 branches 897 tags 550 MiB
Commit graph

1079 commits

Author SHA1 Message Date
Krrish Dholakia
e37c97607b fix(proxy_server.py): fix linting errors 2024-03-16 14:02:36 -07:00
Krrish Dholakia
928ea59fac fix(proxy_server.py): rename beta end user blocking endpoints 
separating end user management from user management
 2024-03-16 13:53:10 -07:00
Ishaan Jaff
f6418b9b34 (feat) improve health readiness perf 2024-03-16 13:10:04 -07:00
Krrish Dholakia
be33918438 fix(blocked_user_list.py): check if end user blocked in db 2024-03-16 13:03:52 -07:00
Krrish Dholakia
588b252cab fix(proxy_server.py): write blocked user list to a db table 
lets this persist across workers
 2024-03-16 12:26:29 -07:00
Krrish Dholakia
8ebf4a62dc fix(proxy_server.py): bug fix on getting user obj from cache 2024-03-16 11:07:38 -07:00
Krrish Dholakia
27de1089a6 fix(caching.py): close redis connection pool upon proxy shutdown 2024-03-16 10:39:58 -07:00
ishaan-jaff
27368f9500 (fix) backoff import 2024-03-16 08:53:06 -07:00
ishaan-jaff
f71ea87cf1 (fix) errant print saying "Error importing .." msg 2024-03-15 21:47:52 -07:00
Krish Dholakia
8e6e7f880d Merge pull request #2542 from BerriAI/litellm_redis_perf_improvements 
89% Caching improvement - Async Redis completion calls + batch redis GET requests for a given key + call type
 2024-03-15 18:58:36 -07:00
ishaan-jaff
37be2ba569 (fix) fix error message raised on passing invalid tokens 2024-03-15 14:50:34 -07:00
Krrish Dholakia
8d1c60bfdc feat(batch_redis_get.py): batch redis GET requests for a given key + call type 
reduces the number of GET requests we're making in high-throughput scenarios
 2024-03-15 14:40:11 -07:00
Ishaan Jaff
607292596b Merge pull request #2524 from BerriAI/litellm_fix_update_user 
(fix) - update user error
 2024-03-15 08:51:45 -07:00
ishaan-jaff
2893d289a0 (fix) error cli users see when importing enterprise folder 2024-03-15 08:10:45 -07:00
ishaan-jaff
084fdf5cb9 (fix) - update user error 2024-03-14 19:50:26 -07:00
ishaan-jaff
fe182d2115 (temp) test build without using argon2 2024-03-14 18:53:16 -07:00
Krrish Dholakia
8d4b7b60bf fix(caching.py): fix print statements 2024-03-14 12:58:34 -07:00
Krrish Dholakia
0f1ff55a64 fix(proxy_server.py): improve error message on ui login error 2024-03-14 10:02:41 -07:00
ishaan-jaff
c8fbadeec2 (fix) importing PromptInjectionDetection 2024-03-13 21:24:37 -07:00
Krish Dholakia
8436507616 Merge pull request #2506 from BerriAI/litellm_update_db_perf_improvements 
fix(proxy_server.py): move to using UPDATE + SET for track_cost_callback
 2024-03-13 20:55:40 -07:00
Krrish Dholakia
3232feb123 fix(proxy_server.py): fix key caching logic 2024-03-13 19:10:24 -07:00
Krrish Dholakia
8f6af575e7 fix(proxy_server.py): maintain support for model specific budgets 2024-03-13 17:04:51 -07:00
Krrish Dholakia
1a6154ec74 fix(proxy_server.py): move to using UPDATE + SET for track_cost_callback 2024-03-13 16:13:37 -07:00
Ishaan Jaff
94553ca0b0 Merge pull request #2501 from BerriAI/litellm_fix_using_enterprise_docker 
(fix) using enterprise folder on litellm Docker
 2024-03-13 14:26:21 -07:00
Ishaan Jaff
a7a74047a9 Merge pull request #2493 from BerriAI/litellm_return_429_no_models_available 
[Proxy] return 429 when no models available
 2024-03-13 13:33:43 -07:00
Krish Dholakia
42b3577fd0 Merge pull request #2498 from BerriAI/litellm_prompt_injection_detection 
feat(prompt_injection_detection.py): support simple heuristic similarity check for prompt injection attacks
 2024-03-13 12:28:19 -07:00
ishaan-jaff
ede01e9c8e (fix) using enterprise folder on litellm 2024-03-13 12:16:58 -07:00
Krrish Dholakia
5769bd22c3 feat(prompt_injection_detection.py): support simple heuristic similarity check for prompt injection attacks 2024-03-13 10:32:21 -07:00
ishaan-jaff
2d75daa6ab (fix) issue with using litellm enterprise license 2024-03-13 10:30:31 -07:00
ishaan-jaff
95aa0f0353 (fix) errors fro litellm proxy 2024-03-13 08:05:32 -07:00
ishaan-jaff
9914710d6b (fix) return 429 error 2024-03-13 08:03:28 -07:00
Krish Dholakia
1f4f7d96a1 Merge pull request #2382 from BerriAI/litellm_cost_tracking_fix 
fix(proxy_server.py): support cost tracking if general_settings is none
 2024-03-12 19:15:23 -07:00
Krrish Dholakia
0510a0f4d4 fix(proxy_server.py): cache master key check 2024-03-12 15:15:33 -07:00
ishaan-jaff
b59e472fcd (fix) patch dynamoDB tea_model_alias bug 2024-03-12 11:17:12 -07:00
Krrish Dholakia
60219254a9 fix(proxy_server.py): fix /user/info for non-existent user id 2024-03-12 11:05:41 -07:00
Krrish Dholakia
5b5d3b10df test(test_key_generate_prisma.py): fix test to only let admin delete a key 2024-03-11 14:18:01 -07:00
Krrish Dholakia
366aaf744e fix(proxy_server.py): bug fix 2024-03-11 13:54:58 -07:00
Krrish Dholakia
1dcaba83d2 fix(proxy_server.py): prevent user from deleting non-user owned keys when they use ui 2024-03-11 12:13:30 -07:00
Krrish Dholakia
4b67e2ce10 fix(proxy_server.py): fix argon import 2024-03-11 11:33:34 -07:00
Krish Dholakia
774ceb741c Merge pull request #2426 from BerriAI/litellm_whisper_cost_tracking 
feat: add cost tracking + caching for `/audio/transcription` calls
 2024-03-09 19:12:06 -08:00
Krish Dholakia
ba9d96e65e Merge branch 'main' into litellm_faster_api_key_checking 2024-03-09 18:45:03 -08:00
Krrish Dholakia
ca496a8892 fix(proxy_server.py): check if master key is str before hashing 2024-03-09 16:51:11 -08:00
Krrish Dholakia
eda9f2ba81 fix(proxy_server.py): fix argon exceptions 2024-03-09 16:16:40 -08:00
Krrish Dholakia
b2ce963498 feat: add cost tracking + caching for transcription calls 2024-03-09 15:43:38 -08:00
Krish Dholakia
f461352908 Merge branch 'main' into litellm_load_balancing_transcription_endpoints 2024-03-08 23:08:47 -08:00
Krrish Dholakia
f9233fa5b9 fix(proxy_server.py): fix argon cfi checking 2024-03-08 22:01:44 -08:00
Ishaan Jaff
0f19e35f22 Merge pull request #2408 from BerriAI/litellm_no_store_reqs 
[FEAT-liteLLM Proxy] Incognito Requests -  Don't log anything
 2024-03-08 21:11:43 -08:00
Krrish Dholakia
93615682fe feat(proxy_server.py): working /audio/transcription endpoint 2024-03-08 18:20:27 -08:00
ishaan-jaff
8b5d255bee (fix) proxy setting success callbacks 2024-03-08 16:27:53 -08:00
Krrish Dholakia
8c6a4df3d4 fix(proxy_server.py): fix tagging of endpoints 2024-03-08 14:29:31 -08:00