Commit graph

3682 commits

Author SHA1 Message Date
Krish Dholakia
ce415a243d
Merge branch 'main' into litellm_no_store_cache_control 2024-01-30 21:44:57 -08:00
Krish Dholakia
67bb11836a
Merge pull request #1696 from BerriAI/litellm_proxy_cold_start_Time
fix(proxy_server.py): speed up proxy startup time
2024-01-30 21:34:45 -08:00
Krrish Dholakia
de223d0059 build(schema.prisma): update prisma schema with allowed_cache_controls param 2024-01-30 21:17:01 -08:00
Krrish Dholakia
a07f3ec2d4 fix(router.py): remove wrapping of router.completion() let clients handle this 2024-01-30 21:12:41 -08:00
Krrish Dholakia
f9acad87dc feat(proxy_server.py): enable cache controls per key + no-store cache flag 2024-01-30 20:46:50 -08:00
Krrish Dholakia
a27858c5c8 fix(_types.py): support datetime as a type for expires field 2024-01-30 18:58:54 -08:00
ishaan-jaff
069976daed (fix) install python-multipart if missing 2024-01-30 18:19:49 -08:00
ishaan-jaff
9780589173 (fix) dependencies in /sso/key/generate 2024-01-30 18:13:53 -08:00
ishaan-jaff
8daabe16f4 (feat) allow users to use UI without SSO 2024-01-30 17:00:40 -08:00
ishaan-jaff
f966cce26a (feat) add litellm login to proxy 2024-01-30 16:47:12 -08:00
Krrish Dholakia
2019347f0d fix(proxy_server.py): speed up proxy startup time 2024-01-30 16:17:23 -08:00
Krish Dholakia
21450b9a73
Merge pull request #1693 from BerriAI/litellm_cache_controls_for_keys
Fixes for model cost check and streaming
2024-01-30 15:52:41 -08:00
Krrish Dholakia
37de964da4 fix(ollama_chat.py): fix the way optional params are passed in 2024-01-30 15:48:48 -08:00
Ishaan Jaff
fd0a360d61
Merge pull request #1691 from BerriAI/litellm_proxy_sso_login
[Feat] LiteLLM Proxy: MSFT SSO Login
2024-01-30 15:44:02 -08:00
Krrish Dholakia
60cc3d6b30 fix(utils.py): fix streaming delta content being none edge-case 2024-01-30 15:35:23 -08:00
Krrish Dholakia
b01f31c41f fix(utils.py): check if delta is none 2024-01-30 15:34:38 -08:00
ishaan-jaff
7ecfb5c368 (chore) cleanup proxy server 2024-01-30 15:20:40 -08:00
ishaan-jaff
49a16662bf (feat) working sso - google, msft 2024-01-30 15:18:50 -08:00
ishaan-jaff
8a36670693 (feat) oauth msft + google 2024-01-30 15:02:15 -08:00
Krish Dholakia
8ef7e9ad20
Merge pull request #1690 from BerriAI/litellm_custom_pricing_fix
fix(main.py): register both model name and model name with provider
2024-01-30 13:56:38 -08:00
Krrish Dholakia
bbe71c8375 fix(test_parallel_request_limiter): increase time limit for waiting for success logging event to happen 2024-01-30 13:26:17 -08:00
Krrish Dholakia
d170e6e83a fix(utils.py): fix custom model with provider to also support time based pricing 2024-01-30 13:00:43 -08:00
Krrish Dholakia
aa0de83083 fix(main.py): register both model name and model name with provider 2024-01-30 12:47:46 -08:00
Ishaan Jaff
dd9c78819a
Merge pull request #1689 from BerriAI/litellm_set_organization_on_config.yaml
[Feat] Set OpenAI organization for litellm.completion, Proxy Config
2024-01-30 11:47:42 -08:00
ishaan-jaff
e011c4a989 (fix) use OpenAI organization in ahealth_check 2024-01-30 11:45:22 -08:00
ishaan-jaff
cf4b1afa52 (feat) set organization on litellm.completion 2024-01-30 10:56:36 -08:00
ishaan-jaff
ae4e273db7 (feat) OpenAI set organization 2024-01-30 10:54:56 -08:00
ishaan-jaff
7fe8fff5d8 (router) set organization OpenAI 2024-01-30 10:54:05 -08:00
ishaan-jaff
66c484f9d1 (test) setting organization as litellm_param 2024-01-30 10:52:50 -08:00
ishaan-jaff
8fdff3beec (test) setting organization on litellm.completion 2024-01-30 10:36:10 -08:00
Ishaan Jaff
2686ec0f9f
Merge pull request #1685 from BerriAI/litellm_bedrock_emb_input
[Fix] Graceful rejection of token input for AWS Embeddings API
2024-01-30 10:32:14 -08:00
Krish Dholakia
c53ad878b3
Merge pull request #1657 from eslamkarim/patch-1
Change quota project to the correct project being used for the call
2024-01-30 08:40:09 -08:00
ishaan-jaff
f941c57688 (fix) use isinstance to check types 2024-01-30 08:31:21 -08:00
ishaan-jaff
b9a117fa1d (feat) Bedrock embedding - raise correct exception BadRequest 2024-01-30 08:14:35 -08:00
ishaan-jaff
6488de36c4 (test) bedrock input validation - exceptions 2024-01-30 08:12:43 -08:00
Krrish Dholakia
03961bb8c6 fix(factory.py): fix mistral prompt template - doesn't support <<sys>> tokens 2024-01-30 07:42:59 -08:00
Krish Dholakia
5d78ec97a7
Merge pull request #1675 from BerriAI/litellm_optional_gunicorn
build(proxy_cli.py): make running gunicorn an optional cli arg
2024-01-30 07:32:43 -08:00
ishaan-jaff
36f1e4196f (ci/cd) run again 2024-01-29 21:09:13 -08:00
ishaan-jaff
fd6b0ff42e (ci/cd) run again 2024-01-29 21:03:42 -08:00
ishaan-jaff
a4175c8c0d (test) fix 2024-01-29 18:46:27 -08:00
ishaan-jaff
1b9e992fef (ci/cd) run again 2024-01-29 18:24:39 -08:00
ishaan-jaff
cbf6441732 (test) fix test_completion_invalid_param_cohere 2024-01-29 17:03:58 -08:00
ishaan-jaff
e2a7910113 (test) dynamoDB backwards compat 2024-01-29 16:53:27 -08:00
ishaan-jaff
96c9fd3f02 (fix) patch -For DynamoDB Backwards Compatibility 2024-01-29 16:52:31 -08:00
Krrish Dholakia
8e9197b5b4 build(proxy_cli.py): make running gunicorn an optional cli arg
when running proxy locally, running with uvicorn is much better for debugging
2024-01-29 15:32:34 -08:00
ishaan-jaff
67e8a0115d (feat) proxy return version in /health/readiness 2024-01-29 15:28:08 -08:00
Ishaan Jaff
a9e215b2cc
Merge pull request #1669 from BerriAI/litellm_feat_admin_ui_imp
[UI] Improve LiteLLM admin UI
2024-01-29 14:50:58 -08:00
ishaan-jaff
ceeaa70349 (test) using default key generate params 2024-01-29 14:46:36 -08:00
ishaan-jaff
0ccec8711c (docs) config.yaml 2024-01-29 14:38:32 -08:00
ishaan-jaff
21db161373 (docs) config.yaml 2024-01-29 14:35:45 -08:00