Commit graph

5286 commits

Author SHA1 Message Date
ishaan-jaff
6011c5c8c2 (fix) undo changes that led were trying to control prisma connections 2024-01-06 14:32:40 +05:30
Krrish Dholakia
04c04d62e3 test(test_stream_chunk_builder.py): remove completion assert, the test is for prompt tokens 2024-01-06 14:12:44 +05:30
Krrish Dholakia
5c45e69a5e test(test_proxy_server_keys.py): add logic for connecting/disconnecting from http server 2024-01-06 14:09:10 +05:30
Krrish Dholakia
b51d98c6e3 docs: fix pip install litellm[proxy] instruction 2024-01-06 13:49:15 +05:30
Krrish Dholakia
bf56179da8 fix(proxy/utils.py): increase http connection pool for prisma 2024-01-06 13:45:30 +05:30
ishaan-jaff
4a076350cc (ci/cd) move to old version of test_proxy_server_keys.py 2024-01-06 13:03:12 +05:30
ishaan-jaff
41bfd43a48 (ci/cd) pin anyio / async dependencies 2024-01-06 12:38:56 +05:30
ishaan-jaff
3bb49447bc (ci/cd) fix event loop bug proxy_test 2024-01-06 12:30:43 +05:30
ishaan-jaff
250672eddc (ci/cd) temp fix - check if model_dump_json exists 2024-01-06 12:23:39 +05:30
ishaan-jaff
79fd2380bb (ci/cd) run again 2024-01-06 12:11:31 +05:30
ishaan-jaff
b508e06e69 Revert "(ci/cd) install correct pydantic"
This reverts commit 256f269ffd.
2024-01-06 12:07:23 +05:30
ishaan-jaff
65ac4c1acb (ci/cd) run again 2024-01-06 11:57:31 +05:30
ishaan-jaff
256f269ffd (ci/cd) install correct pydantic 2024-01-06 11:50:38 +05:30
ishaan-jaff
0ebd0653c5 (ci/cd) make prisma tests async 2024-01-06 11:43:23 +05:30
Krrish Dholakia
e9350ad010 docs(quick_start.md): add ollama to proxy docs 2024-01-06 10:56:25 +05:30
ishaan-jaff
357c6c56bd Revert "build(Dockerfile): move prisma build to dockerfile"
This reverts commit 2741835605.
2024-01-06 09:51:44 +05:30
ishaan-jaff
ae54e6d8b0 (ci/cd) proxy:test_add_new_key 2024-01-05 22:53:03 +05:30
ishaan-jaff
40aaac69cc (ci/cd) add print_verbose for /key/generate 2024-01-05 22:38:46 +05:30
ishaan-jaff
dfdd329ddf (ci/cd) pytest event loop fixture 2024-01-05 22:28:34 +05:30
ishaan-jaff
050c289ed1 (ci/cd) test fixture 2024-01-05 22:15:08 +05:30
ishaan-jaff
d9fd38ae16 (fix) revert 469ae0a 2024-01-05 22:06:39 +05:30
ishaan-jaff
41f5cb7f04 (fix) prisma set DATABASE_URL in env 2024-01-05 20:57:27 +05:30
ishaan-jaff
898c072103 (fix) proxy - self.connect() for get_data() 2024-01-05 20:48:16 +05:30
Krish Dholakia
b4901e6dea
Update .env.example 2024-01-05 19:14:48 +05:30
Krrish Dholakia
aa0b2010d2 build(dockerfile): fixing cmd 2024-01-05 19:09:47 +05:30
Krrish Dholakia
1b2fab28b5 build(dockerfile): exposed port fix 2024-01-05 19:09:10 +05:30
Krrish Dholakia
2741835605 build(Dockerfile): move prisma build to dockerfile
Seems to solve - https://github.com/BerriAI/litellm/issues/1321
2024-01-05 19:03:41 +05:30
ishaan-jaff
6f9d3fc3bc (ci/cd) retry hosted ollama + stream test 3 times 2024-01-05 18:02:20 +05:30
ishaan-jaff
0eb899c087 (test) hosted ollama - retry 3 times 2024-01-05 17:58:59 +05:30
ishaan-jaff
90973d92bf (fix) re-connect prisma if not connected 2024-01-05 17:58:23 +05:30
ishaan-jaff
d2578f0cd2 (ci/cd) proxy print_verbose on failing insert_data 2024-01-05 17:28:27 +05:30
ishaan-jaff
76b2db4492 (ci/cd) run test again 2024-01-05 16:40:56 +05:30
ishaan-jaff
69bac0dbf6 (ci/cd) test proxy - init prisma in test 2024-01-05 16:18:23 +05:30
ishaan-jaff
4679c7b99a (fix) caching use same "created" in response_object 2024-01-05 16:03:56 +05:30
ishaan-jaff
00b001b96b (feat) completion_cost: improve model=None error 2024-01-05 15:26:04 +05:30
ishaan-jaff
f211009263 (test) openai embedding cost calculation 2024-01-05 15:22:17 +05:30
ishaan-jaff
d2487c44ab (feat) add text-embedding-ada-002-v2 2024-01-05 15:19:45 +05:30
ishaan-jaff
20256c45ad (fix) retry cloudflare ai workers 3 times 2024-01-05 13:55:47 +05:30
ishaan-jaff
6694975ec3 (test) azure completion_cost 2024-01-05 13:53:08 +05:30
ishaan-jaff
13201edc4b (test) test reading configs on proxy 2024-01-05 13:37:31 +05:30
ishaan-jaff
aeee8fd3da (fix) reading cache params on proxy 2024-01-05 13:36:48 +05:30
ishaan-jaff
72e7178c9b (test) azure/embedding + completion_cost 2024-01-05 13:19:17 +05:30
ishaan-jaff
f681f0f2b2 (feat) completion_cost - embeddings + raise Exception 2024-01-05 13:11:23 +05:30
ishaan-jaff
db50a07318 (feat) add azure-ada to model_prices.json 2024-01-05 12:56:21 +05:30
ishaan-jaff
113b5e7284 (ci/cd) retry cloudflare request 3 times 2024-01-05 12:40:53 +05:30
ishaan-jaff
83b31141c6 (ci/cd) raise correct exception proxy 2024-01-05 12:29:03 +05:30
ishaan-jaff
bcf22725a6 (ci/cd) run cloudflare test 3 retries 2024-01-05 11:55:12 +05:30
ishaan-jaff
79ab1aa35b (fix) undo - model_dump_json() before logging 2024-01-05 11:47:16 +05:30
ishaan-jaff
40b9f1dcb1 (fix) proxy - log response before model_dump_json 2024-01-05 11:00:02 +05:30
ishaan-jaff
d1865591aa (fix) test caching- use azure, instead of bedrock 2024-01-05 10:51:56 +05:30