Commit graph

3222 commits

Author SHA1 Message Date
Krish Dholakia
8d32f08858
Merge pull request #1342 from BerriAI/litellm_dockerfile_updates
build(Dockerfile): moves prisma logic to dockerfile
2024-01-06 16:03:25 +05:30
ishaan-jaff
f999b63d05 (test) using os.environ/ on cache + proxy 2024-01-06 15:54:50 +05:30
ishaan-jaff
c2b061acb2 (feat) cache+proxy - set os.environ/ on proxy config 2024-01-06 15:54:16 +05:30
Krrish Dholakia
9a4a96f46e perf(azure+openai-files): use model_dump instead of json.loads + model_dump_json 2024-01-06 15:50:05 +05:30
ishaan-jaff
0d152b3748 (fix) cloudflare tests 2024-01-06 15:35:49 +05:30
Krrish Dholakia
13e8535b14 test(test_async_fn.py): skip cloudflare test - flaky 2024-01-06 15:21:10 +05:30
Krrish Dholakia
523d8e5977 build(Dockerfile): moves prisma logic to dockerfile 2024-01-06 15:21:10 +05:30
Krrish Dholakia
9375570547 test(test_async_fn.py): skip cloudflare test - flaky 2024-01-06 15:17:42 +05:30
Krrish Dholakia
7434f1a300 build(Dockerfile): moves prisma logic to dockerfile 2024-01-06 14:59:10 +05:30
ishaan-jaff
6011c5c8c2 (fix) undo changes that led were trying to control prisma connections 2024-01-06 14:32:40 +05:30
Krrish Dholakia
04c04d62e3 test(test_stream_chunk_builder.py): remove completion assert, the test is for prompt tokens 2024-01-06 14:12:44 +05:30
Krrish Dholakia
5c45e69a5e test(test_proxy_server_keys.py): add logic for connecting/disconnecting from http server 2024-01-06 14:09:10 +05:30
Krrish Dholakia
b51d98c6e3 docs: fix pip install litellm[proxy] instruction 2024-01-06 13:49:15 +05:30
Krrish Dholakia
bf56179da8 fix(proxy/utils.py): increase http connection pool for prisma 2024-01-06 13:45:30 +05:30
ishaan-jaff
4a076350cc (ci/cd) move to old version of test_proxy_server_keys.py 2024-01-06 13:03:12 +05:30
ishaan-jaff
41bfd43a48 (ci/cd) pin anyio / async dependencies 2024-01-06 12:38:56 +05:30
ishaan-jaff
3bb49447bc (ci/cd) fix event loop bug proxy_test 2024-01-06 12:30:43 +05:30
ishaan-jaff
250672eddc (ci/cd) temp fix - check if model_dump_json exists 2024-01-06 12:23:39 +05:30
ishaan-jaff
79fd2380bb (ci/cd) run again 2024-01-06 12:11:31 +05:30
ishaan-jaff
65ac4c1acb (ci/cd) run again 2024-01-06 11:57:31 +05:30
ishaan-jaff
0ebd0653c5 (ci/cd) make prisma tests async 2024-01-06 11:43:23 +05:30
ishaan-jaff
357c6c56bd Revert "build(Dockerfile): move prisma build to dockerfile"
This reverts commit 2741835605.
2024-01-06 09:51:44 +05:30
spdustin@gmail.com
6201ab2c21 Update factory (and tests) for Claude 2.1 via Bedrock 2024-01-05 23:32:32 +00:00
spdustin@gmail.com
5d074f5b56 Adds tests and updates docs for Claude "pre-fill" 2024-01-05 22:58:41 +00:00
Dustin Miller
53e5e1df07
Merge branch 'BerriAI:main' into feature_allow_claude_prefill 2024-01-05 15:15:29 -06:00
ishaan-jaff
ae54e6d8b0 (ci/cd) proxy:test_add_new_key 2024-01-05 22:53:03 +05:30
ishaan-jaff
40aaac69cc (ci/cd) add print_verbose for /key/generate 2024-01-05 22:38:46 +05:30
ishaan-jaff
dfdd329ddf (ci/cd) pytest event loop fixture 2024-01-05 22:28:34 +05:30
ishaan-jaff
050c289ed1 (ci/cd) test fixture 2024-01-05 22:15:08 +05:30
ishaan-jaff
d9fd38ae16 (fix) revert 469ae0a 2024-01-05 22:06:39 +05:30
ishaan-jaff
41f5cb7f04 (fix) prisma set DATABASE_URL in env 2024-01-05 20:57:27 +05:30
ishaan-jaff
898c072103 (fix) proxy - self.connect() for get_data() 2024-01-05 20:48:16 +05:30
Krrish Dholakia
2741835605 build(Dockerfile): move prisma build to dockerfile
Seems to solve - https://github.com/BerriAI/litellm/issues/1321
2024-01-05 19:03:41 +05:30
ishaan-jaff
6f9d3fc3bc (ci/cd) retry hosted ollama + stream test 3 times 2024-01-05 18:02:20 +05:30
ishaan-jaff
0eb899c087 (test) hosted ollama - retry 3 times 2024-01-05 17:58:59 +05:30
ishaan-jaff
90973d92bf (fix) re-connect prisma if not connected 2024-01-05 17:58:23 +05:30
ishaan-jaff
d2578f0cd2 (ci/cd) proxy print_verbose on failing insert_data 2024-01-05 17:28:27 +05:30
ishaan-jaff
76b2db4492 (ci/cd) run test again 2024-01-05 16:40:56 +05:30
ishaan-jaff
69bac0dbf6 (ci/cd) test proxy - init prisma in test 2024-01-05 16:18:23 +05:30
ishaan-jaff
4679c7b99a (fix) caching use same "created" in response_object 2024-01-05 16:03:56 +05:30
ishaan-jaff
00b001b96b (feat) completion_cost: improve model=None error 2024-01-05 15:26:04 +05:30
ishaan-jaff
f211009263 (test) openai embedding cost calculation 2024-01-05 15:22:17 +05:30
ishaan-jaff
20256c45ad (fix) retry cloudflare ai workers 3 times 2024-01-05 13:55:47 +05:30
ishaan-jaff
6694975ec3 (test) azure completion_cost 2024-01-05 13:53:08 +05:30
ishaan-jaff
13201edc4b (test) test reading configs on proxy 2024-01-05 13:37:31 +05:30
ishaan-jaff
aeee8fd3da (fix) reading cache params on proxy 2024-01-05 13:36:48 +05:30
ishaan-jaff
72e7178c9b (test) azure/embedding + completion_cost 2024-01-05 13:19:17 +05:30
ishaan-jaff
f681f0f2b2 (feat) completion_cost - embeddings + raise Exception 2024-01-05 13:11:23 +05:30
ishaan-jaff
113b5e7284 (ci/cd) retry cloudflare request 3 times 2024-01-05 12:40:53 +05:30
ishaan-jaff
83b31141c6 (ci/cd) raise correct exception proxy 2024-01-05 12:29:03 +05:30