Commit graph

5216 commits

Author SHA1 Message Date
Ishaan Jaff
c2aec7d20b
Update read_pyproject_version.yml 2024-01-04 15:08:14 +05:30
Ishaan Jaff
2bf51d46fe
Update read_pyproject_version.yml 2024-01-04 15:07:25 +05:30
Ishaan Jaff
511332cc8f
Update read_pyproject_version.yml 2024-01-04 15:06:19 +05:30
Ishaan Jaff
9c24cb1468
Update ghcr_deploy.yml 2024-01-04 15:03:58 +05:30
Ishaan Jaff
b52a0ce3cf
Update ghcr_deploy.yml 2024-01-04 15:00:05 +05:30
ishaan-jaff
2df0377273 (ci/cd) use version from pyproject.toml 2024-01-04 14:56:57 +05:30
Krrish Dholakia
99d9a825de feat(proxy_server.py): abstract config update/writing and support persisting config in db
allows user to opt into writing to db (SAVE_CONFIG_TO_DB) and removes any api keys before sending to db

 https://github.com/BerriAI/litellm/issues/1322
2024-01-04 14:44:59 +05:30
ishaan-jaff
6dea0d3115 (ci/cd) read pyproject version 2024-01-04 14:40:09 +05:30
ishaan-jaff
5b3014a3b1 (ci/cd) read version from pyproject 2024-01-04 14:37:45 +05:30
ishaan-jaff
4aa90682ff (ci/cd) litellm release 2024-01-04 14:34:41 +05:30
ishaan-jaff
cc873ba938 (ci/cd) new litellm release on ghcr deploys 2024-01-04 14:30:00 +05:30
ishaan-jaff
ccf996ecaf (ci/cd) trigger new release on ghcr deploy 2024-01-04 14:22:09 +05:30
ishaan-jaff
2c88fd49a4 (ci/cd) trigger new release on docker deploys 2024-01-04 14:21:42 +05:30
ishaan-jaff
4245274934 (ci/cd) release workflow 2024-01-04 14:17:59 +05:30
Ishaan Jaff
540dc8e11b
Update release2.yaml 2024-01-04 14:05:59 +05:30
Ishaan Jaff
0992dc831a
Update release2.yaml 2024-01-04 13:50:52 +05:30
Ishaan Jaff
a694150385
Create release2.yaml 2024-01-04 13:49:46 +05:30
Ishaan Jaff
8fce25820b
Update new_release.yml 2024-01-04 13:43:56 +05:30
Ishaan Jaff
0aca4dd0b0
Update new_release.yml 2024-01-04 13:43:41 +05:30
Ishaan Jaff
7aa597afd1
Update new_release.yml 2024-01-04 13:41:44 +05:30
Ishaan Jaff
66607de725
(ci/cd) Create new_release.yml 2024-01-04 13:33:28 +05:30
ishaan-jaff
c231a6e4d3 (ci/cd) run proxy test with debug=True 2024-01-04 13:01:00 +05:30
ishaan-jaff
234c057e97 (fix) azure+cf gateway, health check 2024-01-04 12:34:07 +05:30
Krrish Dholakia
b0827a87b2 fix(caching.py): support s-maxage param for cache controls 2024-01-04 11:41:23 +05:30
Krrish Dholakia
4946b1ef6d docs(docs/index.md): add proxy details to docs 2024-01-04 11:20:43 +05:30
Krrish Dholakia
0f7d03f761 fix(proxy/rules.md): add docs on setting post-call rules on the proxy 2024-01-04 11:16:50 +05:30
ishaan-jaff
54653f9a4a (test) proxy + s3 caching 2024-01-04 11:11:08 +05:30
ishaan-jaff
aa757d19f5 (test) router - init clients - azure cloudflare, openai etc 2024-01-04 10:55:18 +05:30
ishaan-jaff
0864713b62 (test) cf azure 2024-01-04 10:26:41 +05:30
ishaan-jaff
8e10a1eb81 (docs) config with cloudflare exampel 2024-01-04 10:25:35 +05:30
ishaan-jaff
6d21ee3a2f (fix) proxy - cloudflare + Azure bug [non-streaming] 2024-01-04 10:24:51 +05:30
ishaan-jaff
b103ab1f0b (docs) proxy - caching 2024-01-03 18:02:14 +05:30
ishaan-jaff
30c6d164d2 (docs) use s3 Cache on litellm proxy 2024-01-03 17:56:44 +05:30
ishaan-jaff
f9139e05e8 (docs) proxy - cachig 2024-01-03 17:56:44 +05:30
Krrish Dholakia
469ae0a378 fix(proxy/utils.py): don't keep connecting to db if connection already established 2024-01-03 17:43:44 +05:30
Krrish Dholakia
f2da345173 fix(caching.py): handle cached_response being a dict not json string 2024-01-03 17:29:27 +05:30
Krrish Dholakia
f2210787cd feat(proxy_server.py): allow admins to update config via /config/update endpoint 2024-01-03 17:18:33 +05:30
ishaan-jaff
64a0c175d5 (docs) simplify caching docs 2024-01-03 16:21:23 +05:30
ishaan-jaff
8bfaee9654 (docs) simplify caching docs 2024-01-03 16:20:19 +05:30
ishaan-jaff
4680a26e2e (test) proxy - load test 2024-01-03 16:16:18 +05:30
ishaan-jaff
344e8d8508 (docs) s3 cache 2024-01-03 16:16:18 +05:30
Krrish Dholakia
d45101b652 fix(proxy_server.py): fix master key reset, to preserve key from env 2024-01-03 16:10:10 +05:30
Krrish Dholakia
40c974999e fix(proxy_server.py): reject bad /model/new POST requests 2024-01-03 15:54:58 +05:30
ishaan-jaff
cc29860785 (docs) s3 Cache 2024-01-03 15:42:23 +05:30
ishaan-jaff
d14a41863f (test) s3 cache with setting s3_bucket_name 2024-01-03 15:42:23 +05:30
ishaan-jaff
58ce5d44ae (feat) s3 cache support all boto3 params 2024-01-03 15:42:23 +05:30
Krrish Dholakia
b51371952b fix(proxy_server.py): handle base case for /model/info 2024-01-03 15:33:29 +05:30
Ishaan Jaff
92c4156ea1
Update README.md 2024-01-03 15:17:59 +05:30
Ishaan Jaff
2eeb20be46
Update README.md 2024-01-03 15:17:46 +05:30
Ishaan Jaff
c71fd26125
Update README.md 2024-01-03 15:17:24 +05:30