phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 19:24:27 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
16726 commits 2490 branches 894 tags 548 MiB
Commit graph

3392 commits

Author SHA1 Message Date
Ishaan Jaff
00832bb8f2 fix email health checks 2024-08-06 15:59:26 -07:00
Ishaan Jaff
6a46899521 add debug statements on docker 2024-08-06 15:29:49 -07:00
Krrish Dholakia
b4ffa4e43c feat(lakera_ai.py): support lakera custom thresholds + custom api base 
Allows user to configure thresholds to trigger prompt injection rejections
 2024-08-06 15:21:45 -07:00
Krish Dholakia
78f1ad7e35 Merge pull request #5071 from BerriAI/litellm_auth_restricted_domains 
feat(proxy_server.py): allow restricting allowed email domains for UI
 2024-08-06 14:18:57 -07:00
Krrish Dholakia
5ffadd631d feat(proxy_server.py): allow restricting allowed email domains for the UI 2024-08-06 12:53:03 -07:00
Ishaan Jaff
662a9b1d7e Merge pull request #5062 from BerriAI/litellm_forward_headers 
[Fix-Proxy] allow forwarding headers from request
 2024-08-06 12:34:25 -07:00
Krrish Dholakia
2ec7cb4153 fix(utils.py): fix types 2024-08-06 12:23:22 -07:00
Ishaan Jaff
32e531eb07 init pass through endpoints 2024-08-06 12:04:04 -07:00
Krrish Dholakia
ff28823025 fix(encrypt_decrypt_utils.py): add helper line, explaining why there might be a key decryption error 2024-08-06 11:35:40 -07:00
Ishaan Jaff
4656f7981d use helper to forward headers from request 2024-08-06 11:34:10 -07:00
Ishaan Jaff
d3d13e40be use prints 2024-08-06 11:07:12 -07:00
Krish Dholakia
350e4b3830 Merge pull request #5057 from BerriAI/litellm_rds_iam_auth 
feat(proxy_cli.py): support iam-based auth to rds
 2024-08-06 10:44:33 -07:00
Krrish Dholakia
3a3381387f feat(utils.py): check env var for api base for openai-compatible endpoints 
Closes https://github.com/BerriAI/litellm/issues/5066
 2024-08-06 08:32:44 -07:00
Ishaan Jaff
e8f4ee56ad forward headers from request 2024-08-05 21:45:44 -07:00
Krrish Dholakia
99f728b1e5 fix(rds_iam_token.py): support sts based auth 2024-08-05 21:01:17 -07:00
Ishaan Jaff
51f5c2d08f use safe init_verbose_loggers 2024-08-05 20:56:48 -07:00
Krrish Dholakia
4fd583af43 fix(user_api_key_auth.py): fix _get_user_role 2024-08-05 20:54:27 -07:00
Krish Dholakia
9191afd48b Merge pull request #5052 from BerriAI/litellm_stability_fixes 
fix: bump default allowed_fails + reduce default db pool limit
 2024-08-05 20:54:23 -07:00
Ishaan Jaff
4c4cc1ba23 Merge pull request #5058 from BerriAI/litellm_add_debug_statements_connecting_prisma 
Fix - add debug statements when connecting to prisma DB
 2024-08-05 20:53:55 -07:00
Ishaan Jaff
5dc04d8479 Merge pull request #5059 from BerriAI/litelm_log_otel_args 
OTEL - Log DB queries / functions on OTEL
 2024-08-05 20:51:11 -07:00
Ishaan Jaff
bf72b7e567 otel fix async_service_failure_hook 2024-08-05 20:18:40 -07:00
Ishaan Jaff
3905825609 use otel callbacks 2024-08-05 20:00:06 -07:00
Ishaan Jaff
b80629b828 log event_metadata on otel service loggers 2024-08-05 19:58:55 -07:00
Krrish Dholakia
4ba576724c test: improve debugging for test 2024-08-05 19:41:08 -07:00
Ishaan Jaff
8ad43780cf add debugging utils to print when connecting to prisma 2024-08-05 19:19:28 -07:00
Ishaan Jaff
6fd1685106 add debug statements when connected to prisma db 2024-08-05 19:13:46 -07:00
Krrish Dholakia
24e20718e4 feat(proxy_cli.py): support iam-based auth to rds 
Initial pr for iam-based auth support for rds
 2024-08-05 17:35:48 -07:00
Ishaan Jaff
357ca893f8 build ui on custom path 2024-08-05 16:34:37 -07:00
Ishaan Jaff
e6f4d7a81d set PROXY_BASE_URL when server root path set 2024-08-05 15:48:44 -07:00
Krrish Dholakia
b5e22bde06 fix: bump default allowed_fails + reduce default db pool limit 
Fixes issues with running proxy server in production
 2024-08-05 15:07:46 -07:00
Ishaan Jaff
3d8befa655 fix get_request_route 2024-08-05 10:33:40 -07:00
Ishaan Jaff
7c7c8fe102 use get_request_route 2024-08-05 10:13:47 -07:00
Ishaan Jaff
9abe55fa86 add get_request_route 2024-08-05 10:12:34 -07:00
Krrish Dholakia
8fea55ffd7 fix(user_api_key_auth.py): handle older user_role's 
Fixes issue where older user_role's (e.g. app_user) weren't being recognized. + Adds testing for it
 2024-08-05 08:57:06 -07:00
Krish Dholakia
88a2428ee6 Merge branch 'main' into litellm_anthropic_api_streaming 2024-08-03 21:16:50 -07:00
Krish Dholakia
3b79ff2ea6 Merge branch 'main' into litellm_loadbalancing_test 2024-08-03 20:29:54 -07:00
Krrish Dholakia
5810708c71 feat(anthropic_adapter.py): support streaming requests for /v1/messages endpoint 
Fixes https://github.com/BerriAI/litellm/issues/5011
 2024-08-03 20:16:19 -07:00
Ishaan Jaff
5afb55576e docs default vertex 2024-08-03 18:09:48 -07:00
Ishaan Jaff
e6e539fc4a add vertex ai countTokens endpoint 2024-08-03 17:34:10 -07:00
Ishaan Jaff
01cd07fa75 add vertex embeddings endpoints 2024-08-03 17:26:49 -07:00
Ishaan Jaff
beb7f1b2c6 add vertex generateContent 2024-08-03 17:17:54 -07:00
Ishaan Jaff
a293bebdb1 working code for vertex ai routes 2024-08-03 16:56:33 -07:00
Ishaan Jaff
568fd8aa63 use native endpoints 2024-08-03 16:52:43 -07:00
Ishaan Jaff
c206a9c2d7 set native vertex endpoints 2024-08-03 16:52:03 -07:00
Krrish Dholakia
b0d2727bbf feat(router.py): add flag for mock testing loadbalancing for rate limit errors 2024-08-03 12:34:11 -07:00
Ishaan Jaff
08d7b0f5c9 support v1/projects/tuningJobs 2024-08-03 11:46:39 -07:00
Ishaan Jaff
e07a38cca4 Merge pull request #5030 from BerriAI/litellm_add_vertex_ft_proxy 
[Feat] Add support for Vertex AI Fine tuning on LiteLLM Proxy
 2024-08-03 08:29:11 -07:00
Ishaan Jaff
eb59eecedf add vertex example on config.yaml 2024-08-03 08:26:59 -07:00
Ishaan Jaff
b2d4ab04a7 add vertex ai ft on proxy 2024-08-02 18:26:36 -07:00
Krrish Dholakia
e6bc7e938a fix(utils.py): handle scenario where model="azure/*" and custom_llm_provider="azure" 
Fixes https://github.com/BerriAI/litellm/issues/4912
 2024-08-02 17:48:53 -07:00