Commit graph

5523 commits

Author SHA1 Message Date
ishaan-jaff
0d56115336 (fix) Dockerfile use same entrypoint as Dockerfile.database 2024-01-10 21:56:34 +05:30
ishaan-jaff
1ff9785c6b (fix) test - moved to circe ci dockerfile 2024-01-10 21:54:13 +05:30
Krrish Dholakia
954d1b071c test: remove invalid arg 2024-01-10 21:53:29 +05:30
Ishaan Jaff
58d0366447
Merge pull request #1399 from BerriAI/litellm_default_use_gunicorn
LiteLLM Proxy - Use Gunicorn with Uvicorn workers
2024-01-10 21:46:04 +05:30
Krrish Dholakia
9a829ff956 refactor: cleanup duplicates 2024-01-10 21:42:20 +05:30
Krrish Dholakia
31917176ff fix(lowest_latency.py): fix merge issue 2024-01-10 21:37:46 +05:30
ishaan-jaff
fc9af5e900 (fix) use Dockerfile from main 2024-01-10 21:36:31 +05:30
Krrish Dholakia
60229eff57 bump: version 1.16.22 → 1.17.0 2024-01-10 21:35:37 +05:30
Krish Dholakia
9e97227625
Merge pull request #1403 from BerriAI/litellm_latency_routing_updates
fix(lowest_latency.py): add back tpm/rpm checks, configurable time window support, improved latency tracking
2024-01-10 21:34:05 +05:30
Krish Dholakia
298e937586
Merge branch 'main' into litellm_latency_routing_updates 2024-01-10 21:33:54 +05:30
Krrish Dholakia
e44d3e51aa ci(config.yml): run prisma generate before testing 2024-01-10 21:26:38 +05:30
Krrish Dholakia
7f269e92c5 test(test_completion_with_retries.py): remove duplicate test 2024-01-10 21:17:30 +05:30
Krrish Dholakia
14a65eb730 test(test_proxy_server_keys.py): removing as this is now tested via the docker build job 2024-01-10 21:05:12 +05:30
Krrish Dholakia
162f6f1ed3 refactor: refactor key tests 2024-01-10 20:58:29 +05:30
Krrish Dholakia
0d86c4ce5b refactor: move proxy server key testing 2024-01-10 20:56:52 +05:30
Krrish Dholakia
990c32a5d6 test(test_router.py): handle image gen timeouts 2024-01-10 20:56:52 +05:30
Krrish Dholakia
fe632c08a4 fix(router.py): allow user to control the latency routing time window 2024-01-10 20:56:52 +05:30
Ishaan Jaff
2b3fc15fa9
(ghcr) always add -latest tag on ghcr deploys 2024-01-10 20:55:28 +05:30
Krrish Dholakia
bb04a340a5 fix(lowest_latency.py): add back tpm/rpm checks, configurable time window 2024-01-10 20:52:01 +05:30
Krish Dholakia
5e811cfe80
Merge pull request #1402 from BerriAI/litellm_dockerfile_testing
Litellm dockerfile testing
2024-01-10 19:53:27 +05:30
Krrish Dholakia
186e6aaff5 build(dockerfile.database): clean up 2024-01-10 19:51:39 +05:30
Krrish Dholakia
33916cb87c ci(config.yml): bring back local_testing and publish_to_pypi 2024-01-10 19:50:42 +05:30
Krrish Dholakia
81846ee563 build(config.yml): test fixes 2024-01-10 19:43:11 +05:30
Krrish Dholakia
1d8dbe0696 build(config.yml): update build 2024-01-10 19:36:07 +05:30
Krrish Dholakia
0e04e1fa56 build(config.yml): output test results 2024-01-10 19:31:58 +05:30
Krrish Dholakia
4f87ba4200 build(config.yml): fix spacing 2024-01-10 19:25:59 +05:30
Krrish Dholakia
2a2856db3e build(config.yml): set num workers to 8 2024-01-10 19:24:21 +05:30
Krrish Dholakia
21d951f279 build(config.yml): add /key/generate load test 2024-01-10 19:23:42 +05:30
Ishaan Jaff
b89d73e3a8
Update ghcr_deploy.yml 2024-01-10 19:13:29 +05:30
Krrish Dholakia
1becc7a4cf build(config.yml): specify port 2024-01-10 18:18:29 +05:30
Krrish Dholakia
9f23cf5852 build(config.yml): add keys to ci build 2024-01-10 18:13:34 +05:30
ishaan-jaff
9bd9ff1038 (fix) add gunicorn to poetry lock 2024-01-10 18:12:54 +05:30
ishaan-jaff
4d8d58f0c9 (test) temp - comment out deployed proxy keygen test 2024-01-10 18:09:59 +05:30
Krrish Dholakia
b06d7f0cb6 build(config.yml): reintroduce mounting config.yaml 2024-01-10 18:03:57 +05:30
ishaan-jaff
dd3dabc979 (fix) use litellm entrypoint 2024-01-10 17:57:36 +05:30
ishaan-jaff
2b9174c3d7 (feat) add comments on starting with gunicorn 2024-01-10 17:50:51 +05:30
ishaan-jaff
67dc9adc71 (fix) import gunicorn 2024-01-10 17:47:34 +05:30
ishaan-jaff
1276112119 (feat) add gunicorn as a dep 2024-01-10 17:47:24 +05:30
Krrish Dholakia
94259c944a build(dockerfile.database): fix dockerfile 2024-01-10 17:41:46 +05:30
ishaan-jaff
873965df22 (chore) remove old uvicorn logic 2024-01-10 17:39:05 +05:30
Krrish Dholakia
133f6f51d7 build(config.yml): run logging in background 2024-01-10 17:35:51 +05:30
Krrish Dholakia
cf5e31a0b2 build(config.yml): pass database url to docker build 2024-01-10 17:31:22 +05:30
Krrish Dholakia
100fa97cc2 build(config.yml): reorder steps 2024-01-10 17:27:45 +05:30
Krrish Dholakia
4de9a1541d build(config.yml): see container logs 2024-01-10 17:24:53 +05:30
Krrish Dholakia
2302e01cc4 build(config.yml): remove mounting config logic (temporary) 2024-01-10 17:21:48 +05:30
Krrish Dholakia
e3aff7fc92 build(config.yml): bring back dockerize 2024-01-10 17:20:48 +05:30
Krrish Dholakia
8b1c21c156 build(config.yml): comment out dockerize 2024-01-10 17:17:32 +05:30
Krrish Dholakia
5b1601a70b build(config.yml): fixes 2024-01-10 17:09:51 +05:30
ishaan-jaff
5136d5980f (fix) use gunicorn to start proxt 2024-01-10 17:09:03 +05:30
Krrish Dholakia
49b6c07557 build(config.yml): file fix 2024-01-10 17:06:42 +05:30