Commit graph

1464 commits

Author SHA1 Message Date
Nathan Kim
ada2d40a43 first commit 2023-11-09 22:12:39 -08:00
Nathan Kim
672cd09e3f first commit 2023-11-09 22:07:19 -08:00
Pratham Soni
fc2f4cecdc add custom open ai models to asyncio call 2023-11-09 20:47:46 -08:00
Krrish Dholakia
964e3da107 test(test_completion.py): fix openai testing 2023-11-09 19:05:34 -08:00
Krrish Dholakia
b9d343e634 fix(test_caching.py): flaky test 2023-11-09 18:54:21 -08:00
Krrish Dholakia
d392f6efb5 fix(utils.py): fix sync streaming 2023-11-09 18:47:20 -08:00
Krrish Dholakia
af7468e9bc fix(main.py): accepting azure deployment_id 2023-11-09 18:16:02 -08:00
ishaan-jaff
0a4e1195b0 (replicate) deployments 2023-11-09 18:10:38 -08:00
ishaan-jaff
c2b263e66d (feat) completion - replicate custom deployments 2023-11-09 18:10:38 -08:00
Krrish Dholakia
7e04e46d94 test(test_completion.py): fix test case 2023-11-09 17:43:18 -08:00
Krrish Dholakia
cfd2ccf429 fix(utils.py): fix logging integrations 2023-11-09 17:09:49 -08:00
Krrish Dholakia
1affa89ad7 test: fix linting issues 2023-11-09 16:50:43 -08:00
Krrish Dholakia
272a6dc9b0 refactor(azure.py): enabling async streaming with aiohttp 2023-11-09 16:41:06 -08:00
Krrish Dholakia
9b278f567b refactor(openai.py): support aiohttp streaming 2023-11-09 16:15:30 -08:00
ishaan-jaff
55b005ef9b (feat) proxy use default model in config 2023-11-09 13:08:23 -08:00
ishaan-jaff
5a33b7521a (feat) proxy add config 2023-11-09 13:06:38 -08:00
ishaan-jaff
8d39bf6d43 (fix) proxy cleanup 2023-11-09 11:31:31 -08:00
ishaan-jaff
0e8a034360 (fix) proxy cli default local debug to False 2023-11-09 11:30:11 -08:00
ishaan-jaff
93e7cfd6fc (feat) show well documented config 2023-11-09 11:29:53 -08:00
ishaan-jaff
1f7d397836 (fix) proxy server clean print statements 2023-11-09 11:18:56 -08:00
ishaan-jaff
17c6eebb10 (fix) prxy server remove create_proxy 2023-11-09 11:12:20 -08:00
ishaan-jaff
44a65bdd59 (fix) proxy remove --create_proxy 2023-11-09 11:10:08 -08:00
Krrish Dholakia
1d46891ceb fix(azure.py): adding support for aiohttp calls on azure + openai 2023-11-09 10:40:33 -08:00
ishaan-jaff
cc3ff1c3ae (test) add proxy cli tests 2023-11-09 10:23:14 -08:00
Krrish Dholakia
8ee4b1f603 feat(utils.py): enable returning complete response when stream=true 2023-11-09 09:17:51 -08:00
ishaan-jaff
beae7bf27a run ci/cd again 2023-11-08 20:24:41 -08:00
Krrish Dholakia
36c99b93c6 test(test_streaming.py): fix linting errors 2023-11-08 19:31:06 -08:00
Krrish Dholakia
4206f95256 refactor(azure.py): fix linting errors 2023-11-08 19:24:53 -08:00
Krrish Dholakia
678249ee09 refactor(azure.py): moving embeddings to http call 2023-11-08 19:07:21 -08:00
Krrish Dholakia
880768f83d refactor(openai.py): moving embedding calls to http 2023-11-08 19:01:17 -08:00
Krrish Dholakia
e66373bd47 refactor(openai.py): moving openai text completion calls to http 2023-11-08 18:40:03 -08:00
Krrish Dholakia
decf86b145 refactor(openai.py): moving openai chat completion calls to http 2023-11-08 17:40:41 -08:00
Krrish Dholakia
17f5e46080 refactor(azure.py): moving azure openai calls to http calls 2023-11-08 16:52:18 -08:00
ishaan-jaff
75fafb8736 (test) replicate with params 2023-11-08 14:28:06 -08:00
ishaan-jaff
f46bd51571 (fix) clean up proxy cli 2023-11-08 13:48:02 -08:00
ishaan-jaff
a94532fedf (fix) proxy cli --test 2023-11-08 12:00:13 -08:00
ishaan-jaff
fa61276407 (test) add text completion steaming test 2023-11-08 11:59:31 -08:00
ishaan-jaff
11ee52207e (feat) add streaming for text_completion 2023-11-08 11:58:07 -08:00
ishaan-jaff
edccfbb1da (fix) remove errant print from hf 2023-11-08 11:49:15 -08:00
ishaan-jaff
106ccc2b94 (fix) text_completion don't pass echo to HF after translating 2023-11-08 11:45:05 -08:00
ishaan-jaff
5250366a4b (test) run a test again 2023-11-08 10:34:57 -08:00
ishaan-jaff
769f3d1300 (test) run ci/cd again 2023-11-08 10:21:19 -08:00
ishaan-jaff
739e9c4732 (test) remove dup hf test 2023-11-08 09:54:40 -08:00
ishaan-jaff
6d85d6486b (test) router functionality 2023-11-08 09:48:48 -08:00
ishaan-jaff
c570de72fe bump: version 0.13.7 → 0.13.8 2023-11-08 09:46:57 -08:00
Krrish Dholakia
17867e6e15 fix(factory.py): fixing llama-2 non-chat models prompt templating 2023-11-07 21:33:54 -08:00
Krrish Dholakia
81953f1025 (fix): llama-2 non-chat models prompt template 2023-11-07 21:33:54 -08:00
Krrish Dholakia
97c8b52bba fix(utils.py): llmmonitor integration 2023-11-07 15:49:32 -08:00
Krish Dholakia
7ffdc38195 Update README.md 2023-11-07 12:08:59 -08:00
Krrish Dholakia
78fb8cf941 fix(router.py): fix linting issues 2023-11-06 18:50:09 -08:00