Commit graph

12493 commits

Author SHA1 Message Date
Krish Dholakia
edf296fb5b
Update README.md 2024-06-01 16:53:06 -07:00
Krrish Dholakia
93c9ea160d fix(openai.py): fix client caching logic 2024-06-01 16:45:56 -07:00
Krish Dholakia
63fb3a95be
Merge pull request #3961 from BerriAI/litellm_docker_compose_start
Litellm docker compose start
2024-06-01 16:28:28 -07:00
Krrish Dholakia
ce4ba80fd4 build(docker-compose.yml): load local .env in docker compose quick start 2024-06-01 16:27:07 -07:00
Krrish Dholakia
2245ee1cc8 test(test_scheduler.py): fix testing 2024-06-01 16:21:02 -07:00
Krrish Dholakia
9b4a19b3aa build(docker-compose.yml): startup docker compose with postgres 2024-06-01 16:18:12 -07:00
Krrish Dholakia
7715267989 fix(router.py): simplify scheduler
move the scheduler poll queuing logic into the router class, making it easier to use
2024-06-01 16:09:57 -07:00
Krish Dholakia
27087f60c2
Merge pull request #3959 from BerriAI/litellm_support_verify_ssl_false
fix(http_handler.py): support verify_ssl=False when using httpx client
2024-06-01 15:30:15 -07:00
Krrish Dholakia
d7160eb3ea fix(test_scheduler.py): fix test 2024-06-01 15:11:13 -07:00
Krrish Dholakia
a16a1c407a fix(http_handler.py): allow setting ca bundle path 2024-06-01 14:48:53 -07:00
Krrish Dholakia
f75c15d6cd fix(proxy_server.py): security fix - fix sql injection attack on global spend logs 2024-06-01 14:16:41 -07:00
Krrish Dholakia
f1ce7bb300 fix(http_handler.py): add bool check for os.getenv verif ssl value 2024-06-01 14:07:41 -07:00
Krish Dholakia
1ec2ba186f
Create main.yml
Create a workflow to deploy dev releases
2024-06-01 14:02:35 -07:00
Krrish Dholakia
22a0c400dd fix(http_handler.py): support verify_ssl=False when using httpx client 2024-06-01 13:56:45 -07:00
Krrish Dholakia
3b94993ddc bump: version 1.39.6 → 1.40.0 2024-06-01 11:31:24 -07:00
Krrish Dholakia
c6559753c7 fix(test_scheduler.py): fix test 2024-06-01 11:30:26 -07:00
Krrish Dholakia
a0fb301b18 docs(assistants.md): add assistants api to docs 2024-06-01 10:30:07 -07:00
Ishaan Jaff
d83b4a00d3
Merge pull request #3956 from BerriAI/litellm_cache_openai_clients
[FEAT] Perf improvements - litellm.completion / litellm.acompletion - Cache OpenAI client
2024-06-01 09:46:42 -07:00
Ishaan Jaff
47dd52c566 fix used hashed api key 2024-06-01 09:24:16 -07:00
Krrish Dholakia
5cce31ae61 docs(enterprise.md): update enterprise docs with public model hub and custom email branding information 2024-06-01 09:01:05 -07:00
Ishaan Jaff
47337c172e fix - in memory client cache 2024-06-01 08:58:22 -07:00
Krish Dholakia
8375e9621c
Merge pull request #3954 from BerriAI/litellm_simple_request_prioritization
feat(scheduler.py): add request prioritization scheduler
2024-05-31 23:29:09 -07:00
Krrish Dholakia
183dd81087 fix(router.py): fix should_retry logic 2024-05-31 23:27:43 -07:00
Krrish Dholakia
04f42d7e63 docs(enterprise.md): update docs 2024-05-31 22:07:48 -07:00
Krrish Dholakia
be0d473bb3 docs(proxy_server.py): add link to customize swagger docs on base url 2024-05-31 22:06:25 -07:00
Krrish Dholakia
381247a095 fix(router.py): fix param 2024-05-31 21:52:23 -07:00
Ishaan Jaff
a034a550c5 ui - new build 2024-05-31 21:49:16 -07:00
Ishaan Jaff
cd5ec30ff1 ui - mention sso on invite links 2024-05-31 21:47:17 -07:00
Krish Dholakia
e7ff3adc26
Merge pull request #3944 from BerriAI/litellm_fix_parallel_streaming
fix: fix streaming with httpx client
2024-05-31 21:42:37 -07:00
Krish Dholakia
989665c7dc
Delete litellm/proxy/_experimental/out/404/index.html 2024-05-31 21:42:15 -07:00
Krish Dholakia
8df912cfa2
Delete litellm/proxy/_experimental/out/model_hub/index.html 2024-05-31 21:42:00 -07:00
Krrish Dholakia
7523f803d2 fix(utils.py): support get_max_tokens() call with same model_name as completion
Closes https://github.com/BerriAI/litellm/issues/3921
2024-05-31 21:37:51 -07:00
Ishaan Jaff
1c16904566 fix cache openai client for embeddings, text, speech 2024-05-31 21:35:03 -07:00
Krrish Dholakia
e49325b234 fix(router.py): fix cooldown logic for usage-based-routing-v2 pre-call-checks 2024-05-31 21:32:01 -07:00
Ishaan Jaff
cedeb10a08 fix - linting error 2024-05-31 21:24:14 -07:00
Ishaan Jaff
6feeff1f31 feat - cache openai clients 2024-05-31 21:22:06 -07:00
Krrish Dholakia
f3c37f487a fix(proxy_server.py): fix naming conflict 2024-05-31 19:41:53 -07:00
Krrish Dholakia
f8d4be710e docs(scheduler.md): add request prioritization to docs 2024-05-31 19:35:47 -07:00
Ishaan Jaff
b8df5d1a01 (ci/cd) run again 2024-05-31 19:05:51 -07:00
Krrish Dholakia
79287a7584 feat(scheduler.py): add request prioritization scheduler
allow user to set priority for a request
2024-05-31 18:51:13 -07:00
Ishaan Jaff
8021400477 bump: version 1.39.5 → 1.39.6 2024-05-31 18:47:22 -07:00
Ishaan Jaff
ffa16a2f6a fix include request_typ in key_generate requests 2024-05-31 18:46:59 -07:00
Krish Dholakia
8f87da4b20
Merge pull request #3939 from pharindoko/main
fix(bedrock): convert botocore credentials when role is assumed
2024-05-31 18:46:15 -07:00
Krish Dholakia
fbeb9d7ea7
Merge pull request #3935 from BerriAI/litellm_cache_vertex_clients
[Fix] Cache Vertex AI clients - Perf improvement
2024-05-31 18:44:10 -07:00
Krish Dholakia
08bae3185a
Merge pull request #3936 from BerriAI/litellm_assistants_api_proxy
feat(proxy_server.py): add assistants api endpoints to proxy server
2024-05-31 18:43:22 -07:00
Ishaan Jaff
8ba37f8ebe ui - new build 2024-05-31 18:38:02 -07:00
Ishaan Jaff
78c31face5
Merge pull request #3953 from BerriAI/litellm_ui_allow_users_to_sign_in_with_links
UI  - allow users to sign in with with email/password
2024-05-31 18:36:30 -07:00
Ishaan Jaff
7bda701b5d
Merge pull request #3952 from BerriAI/litellm_ui_invite_for_spend_viewer
[Feat] Admin UI - invite users to view spend
2024-05-31 18:36:14 -07:00
Ishaan Jaff
6623c1e017
Merge branch 'main' into litellm_ui_invite_for_spend_viewer 2024-05-31 18:36:07 -07:00
Ishaan Jaff
9243be6042 feat - allow sign in with user email and password 2024-05-31 18:34:01 -07:00