Commit graph

3406 commits

Author SHA1 Message Date
Krrish Dholakia
1812b7ae37 fix(proxy_server.py): fix linting errors 2023-11-18 17:35:16 -08:00
Krrish Dholakia
59b547a65e docs(simple_proxy.md): adding token based auth to docs 2023-11-18 17:34:11 -08:00
ishaan-jaff
e276023462 (test) palm streaming test 2023-11-18 17:32:15 -08:00
ishaan-jaff
70dc8441f6 (fix) streaming ensure response obj is initialized 2023-11-18 17:31:58 -08:00
ishaan-jaff
9bea4044b0 (test) remove unused tests 2023-11-18 17:25:42 -08:00
ishaan-jaff
2f0304f100 (test) async for chunk 2023-11-18 17:17:39 -08:00
ishaan-jaff
903016ba2f (fix) stream chunk builder when content == None in chunk 2023-11-18 17:16:05 -08:00
ishaan-jaff
30fcc1f9a0 (test) do nothing if token==None in stream chunk 2023-11-18 17:13:16 -08:00
ishaan-jaff
e527a45ffc (feat) print_verbose Raw openai chunk 2023-11-18 17:12:49 -08:00
ishaan-jaff
2466d26301 (fix) linting 2023-11-18 17:05:46 -08:00
ishaan-jaff
b2f8f8ed45 (test) openai streaming + function calling 2023-11-18 17:01:46 -08:00
ishaan-jaff
8f402e04c9 (fix) streaming openai + function calling 2023-11-18 17:01:46 -08:00
Krrish Dholakia
6a1270ce5a fix(proxy_server.py): handle initializing prisma / db connection just once 2023-11-18 16:45:19 -08:00
ishaan-jaff
e10c2d0bda (test) tool/function calling + streaming 2023-11-18 16:23:29 -08:00
ishaan-jaff
edf98cabae (fix) streaming + function / tool calling 2023-11-18 16:23:29 -08:00
Krrish Dholakia
8e599ed4f8 feat(proxy_server.py): enable token based authentication for server endpoints 2023-11-18 16:13:53 -08:00
Krrish Dholakia
229e5ea083 fix(proxy_server.py): allow user to connect their proxy to a postgres db 2023-11-18 15:57:38 -08:00
ishaan-jaff
c9445db22f (fix) langfuse logging - dont fail when casting optional params 2023-11-18 15:36:12 -08:00
ishaan-jaff
e402dc4880 (docs) langfuse 2023-11-18 15:35:29 -08:00
ishaan-jaff
21f36168bb (docs) callbacks 2023-11-18 15:28:41 -08:00
ishaan-jaff
b31368ac2f (test) function calling 2023-11-18 15:15:02 -08:00
ishaan-jaff
250c891750 (fix) langfuse logger for function calling / tools 2023-11-18 15:14:44 -08:00
ishaan-jaff
2476cf7eab (docs) callbacks 2023-11-18 14:56:16 -08:00
ishaan-jaff
45b1445c85 (docs) langfuse callback litellm 2023-11-18 14:52:24 -08:00
ishaan-jaff
af3b5eb4d2 (docs) add parallel function calling to azure.md 2023-11-18 14:49:57 -08:00
ishaan-jaff
77036474dd (docs) add parallel function calling to openai.md 2023-11-18 14:49:37 -08:00
ishaan-jaff
2f04947fa0 (docs) add parallel function calling on azure openai 2023-11-18 14:42:43 -08:00
ishaan-jaff
e1c88cba84 (docs) parallel function calling with Azure OpenAI 2023-11-18 14:36:56 -08:00
ishaan-jaff
017a72e8d3 (docs) function calling on openai 2023-11-18 14:21:26 -08:00
ishaan-jaff
4536e1080b (docs) parallel function calling 2023-11-18 14:09:20 -08:00
ishaan-jaff
4efc9578ca (docs) parallel function calling 2023-11-18 14:07:10 -08:00
ishaan-jaff
3a32c959c5 (docs) add parallel function calling cookbook 2023-11-18 14:05:16 -08:00
ishaan-jaff
d06916326a (docs) parallel function calling 2023-11-18 13:45:19 -08:00
ishaan-jaff
eb5bfa8d99 (docs) add together ai as litellm_provider in model cost map 2023-11-18 10:13:03 -08:00
Krrish Dholakia
34decba3cf fix(text_completion): allow either model or engine to be set 2023-11-17 18:25:21 -08:00
Krrish Dholakia
7ea80de2f1 test(test_async_fn.py): catch timeouts 2023-11-17 18:01:52 -08:00
Krrish Dholakia
4b80df3aea bump: version 1.0.4 → 1.1.0 2023-11-17 17:56:26 -08:00
Krrish Dholakia
cf0a9f591c fix(router.py): introducing usage-based-routing 2023-11-17 17:56:26 -08:00
ishaan-jaff
259c1c7616 (ci/cd) fix timeout error 2023-11-17 17:46:49 -08:00
ishaan-jaff
505a0c354c (docs) update readme proxy server 2023-11-17 17:40:44 -08:00
ishaan-jaff
f1fdf42831 (docs) new dockerfile for litellm proxy 2023-11-17 17:39:07 -08:00
Ishaan Jaff
6ce0de5de6 Update requirements.txt 2023-11-17 17:37:27 -08:00
ishaan-jaff
aa68dd36f7 (chore) remove old dockerfile 2023-11-17 17:37:00 -08:00
ishaan-jaff
bae94aced0 (docs) load balancer 2023-11-17 17:25:46 -08:00
ishaan-jaff
a9bb85489f (docs) add example load balancer 2023-11-17 17:25:12 -08:00
Krrish Dholakia
452946b2f8 refactor(router.py): code cleanup 2023-11-17 17:05:46 -08:00
Krrish Dholakia
7d70bf84a7 test(test_langfuse.py): handle timeouts 2023-11-17 17:05:46 -08:00
ishaan-jaff
1ba32368ef (test) parallel tool calling 2023-11-17 17:03:24 -08:00
ishaan-jaff
41496596c0 (docs) input params 2023-11-17 16:07:25 -08:00
Krrish Dholakia
29906f6320 test(test_completion.py): change tgai model 2023-11-17 16:06:42 -08:00