Commit graph

1706 commits

Author SHA1 Message Date
Krrish Dholakia
4b74ddcb17 refactor: fixing linting issues 2023-11-11 18:52:28 -08:00
Krrish Dholakia
753c722c9f refactor(ai21,-aleph-alpha,-ollama): making ai21, aleph-alpha, ollama compatible with openai v1 sdk 2023-11-11 17:49:13 -08:00
Krrish Dholakia
e7d1840d5f fix(main.py): fix caching for router 2023-11-11 17:45:23 -08:00
Krrish Dholakia
5efa3860da refactor(huggingface,-anthropic,-replicate,-sagemaker): making huggingface, anthropic, replicate, sagemaker compatible openai v1 sdk 2023-11-11 17:38:15 -08:00
Krrish Dholakia
7b4e21e574 refactor(bedrock.py-+-cohere.py): making bedrock and cohere compatible with openai v1 sdk 2023-11-11 17:33:19 -08:00
Krrish Dholakia
c0a757a25f refactor(azure.py): working azure completion calls with openai v1 sdk 2023-11-11 16:44:39 -08:00
Krrish Dholakia
1ec07c0aba refactor(openai.py): working openai chat + text completion for openai v1 sdk 2023-11-11 16:25:10 -08:00
Krrish Dholakia
a5ec85b1f2 refactor(openai.py): making it compatible for openai v1
BREAKING CHANGE:
2023-11-11 15:33:02 -08:00
ishaan-jaff
a861dd69c9 (fix) proxy raise exception when config path does not exist 2023-11-11 12:36:22 -08:00
ishaan-jaff
5ab7470c84 (test) tokenizer worked test 2023-11-11 12:13:57 -08:00
ishaan-jaff
5675a82cfa (test) try/pass APIError for TG AI 2023-11-11 11:34:15 -08:00
ishaan-jaff
b2f7076b9b (fix) add APIError to litellm module 2023-11-11 11:33:02 -08:00
ishaan-jaff
ad26dd8946 (fix) tg ai raise errors on non 200 responses 2023-11-11 11:21:12 -08:00
ishaan-jaff
d9365b62fb (test) gpt4 vision 2023-11-11 10:34:37 -08:00
ishaan-jaff
4408a1f806 (fix) completion gpt-4 vision check finish_details or finish_reason 2023-11-11 10:28:20 -08:00
Ishaan Jaff
292b12b191 Merge pull request #787 from duc-phamh/improve_message_trimming
Improve message trimming
2023-11-11 09:39:43 -08:00
ishaan-jaff
4319aa415a (test) async_fn with stream 2023-11-10 17:47:15 -08:00
ishaan-jaff
8f0f9889a6 (test) add gpt-4 vision 2023-11-10 17:34:40 -08:00
ishaan-jaff
7eeb931021 (fix) proxy raise exception when config passed in 2023-11-10 16:28:34 -08:00
ishaan-jaff
a924853182 (fix) proxy print exception when reading config 2023-11-10 16:22:20 -08:00
ishaan-jaff
2bc516ae2d (fix) ssl changes 2023-11-10 15:57:59 -08:00
ishaan-jaff
de456408aa (fix) ssl for acompletion with openai 2023-11-10 15:55:04 -08:00
Krrish Dholakia
54b4130d54 fix(text_completion.py): fix routing logic 2023-11-10 15:46:37 -08:00
Krrish Dholakia
11d1651d36 test(test_streaming.py): set cache to none 2023-11-10 15:24:17 -08:00
ishaan-jaff
4e071291bb (test) fix caching 2023-11-10 15:23:56 -08:00
Krrish Dholakia
429ed2cfba test(test_langfuse.py): add retries to langfuse test 2023-11-10 15:09:21 -08:00
Krrish Dholakia
4c103592e3 test(test_streaming.py): set cache to none 2023-11-10 15:04:01 -08:00
Krrish Dholakia
55b8432145 fix(utils.py): caching for embedding 2023-11-10 14:33:17 -08:00
ishaan-jaff
b50824de58 (feat) replicate add exception mapping for streaming + better logging when polling 2023-11-10 12:46:33 -08:00
ishaan-jaff
8b41876257 (test) replicate with streaming, num retries 2023-11-10 12:46:33 -08:00
ishaan-jaff
5413696771 (fix) streaming replicate 2023-11-10 12:46:33 -08:00
ishaan-jaff
5fc73824bb (fix) replicate print verbose 2023-11-10 12:46:33 -08:00
ishaan-jaff
a6bb5ca8a8 (feat) replicate exception mapping 2023-11-10 12:46:33 -08:00
ishaan-jaff
78c93a0c5a (feat) replicate exception mapping 2023-11-10 12:46:33 -08:00
Krrish Dholakia
c10b0646c1 fix(utils.py): fix exception raised 2023-11-10 11:28:17 -08:00
Krrish Dholakia
548605def8 fix(utils.py): return function call as part of response object 2023-11-10 11:02:10 -08:00
Krrish Dholakia
67e8b12a09 fix(utils.py): fix cached responses - translate dict to objects 2023-11-10 10:38:20 -08:00
Krish Dholakia
2f45587211 Merge pull request #790 from nathankim7/standardize-available-deployments
Fix bad returns in get_available_deployment
2023-11-10 08:59:48 -08:00
ishaan-jaff
6e3654d309 (feat) completion ollama raise exception when ollama resp != 200 2023-11-10 08:54:05 -08:00
Nathan Kim
ada2d40a43 first commit 2023-11-09 22:12:39 -08:00
Nathan Kim
672cd09e3f first commit 2023-11-09 22:07:19 -08:00
Pratham Soni
fc2f4cecdc add custom open ai models to asyncio call 2023-11-09 20:47:46 -08:00
Krrish Dholakia
964e3da107 test(test_completion.py): fix openai testing 2023-11-09 19:05:34 -08:00
Krrish Dholakia
b9d343e634 fix(test_caching.py): flaky test 2023-11-09 18:54:21 -08:00
Krrish Dholakia
d392f6efb5 fix(utils.py): fix sync streaming 2023-11-09 18:47:20 -08:00
Krrish Dholakia
af7468e9bc fix(main.py): accepting azure deployment_id 2023-11-09 18:16:02 -08:00
ishaan-jaff
0a4e1195b0 (replicate) deployments 2023-11-09 18:10:38 -08:00
ishaan-jaff
c2b263e66d (feat) completion - replicate custom deployments 2023-11-09 18:10:38 -08:00
Krrish Dholakia
7e04e46d94 test(test_completion.py): fix test case 2023-11-09 17:43:18 -08:00
Krrish Dholakia
cfd2ccf429 fix(utils.py): fix logging integrations 2023-11-09 17:09:49 -08:00