Commit graph

1376 commits

Author SHA1 Message Date
ishaan-jaff
fba2370341 (ci/cd) run again 2023-12-21 07:25:22 +05:30
ishaan-jaff
8112397a3b (fix) vertex ai auth file 2023-12-21 07:22:25 +05:30
Krrish Dholakia
b873833340 fix(router.py): only do sync image gen fallbacks for now
The customhttptransport we use for dall-e-2 only works for sync httpx calls, not async. Will need to spend some time writing the async version

n
2023-12-20 19:10:59 +05:30
Krrish Dholakia
77b11daf28 fix(utils.py): add support for anyscale function calling 2023-12-20 17:48:33 +05:30
Krrish Dholakia
89b808d767 feat(router.py): support async image generation on router 2023-12-20 17:24:20 +05:30
Krrish Dholakia
a14d51e074 feat(main.py): add async image generation support 2023-12-20 16:58:15 +05:30
Krrish Dholakia
23d0278739 feat(azure.py): add support for azure image generations endpoint 2023-12-20 16:37:21 +05:30
Krrish Dholakia
636ac9b605 feat(ollama.py): add support for ollama function calling 2023-12-20 14:59:55 +05:30
Max Deichmann
a43b8aa703 add users 2023-12-19 09:54:51 +01:00
Max Deichmann
a49e1d662e changes 2023-12-19 09:41:49 +01:00
sumanth
64dfd0d9a6 fix 2023-12-19 13:15:48 +05:30
Krrish Dholakia
e03713ef74 fix(main.py): return async completion calls 2023-12-18 17:41:54 -08:00
Max Deichmann
e8d7235082 improve integration 2023-12-18 23:32:02 +01:00
Krrish Dholakia
5f4310f592 fix(ollama.py): fix sync ollama streaming 2023-12-16 21:23:21 -08:00
Krrish Dholakia
51cb16a015 feat(main.py): add support for image generation endpoint 2023-12-16 21:07:29 -08:00
ishaan-jaff
c4e28a9250 (ci/cd) run again 2023-12-16 22:34:10 +05:30
ishaan-jaff
b317d30b79 (test) gemini vision 2023-12-16 19:16:32 +05:30
ishaan-jaff
7293d981f9 (test) vertex ai: stop running 4 requests / test 2023-12-16 19:01:12 +05:30
ishaan-jaff
177aafca45 (test) gemini-pro-vision 2023-12-16 18:58:31 +05:30
ishaan-jaff
02089fb71e (test) gemini vision test 2023-12-16 18:38:36 +05:30
ishaan-jaff
0ae5635815 (test) gemini pro vision 2023-12-16 18:31:55 +05:30
ishaan-jaff
e8c9783a3f (test) proxy - cache config 2023-12-16 14:45:06 +05:30
Krrish Dholakia
e76ed6be7d feat(router.py): support caching groups 2023-12-15 21:45:51 -08:00
ishaan-jaff
c60350fbb6 (test) ollama-local, add llava test 2023-12-16 10:35:43 +05:30
Krrish Dholakia
0a20b92c12 refactor(test_router_caching.py): add tests for router caching 2023-12-15 20:38:51 -08:00
Krrish Dholakia
1da7d35218 feat(proxy_server.py): enable infinite retries on rate limited requests 2023-12-15 20:03:41 -08:00
Krrish Dholakia
6081602bf8 fix(router.py): support openai-compatible endpoints 2023-12-15 14:47:54 -08:00
ishaan-jaff
7e34899e9e (test) dynamodb set table name 2023-12-15 21:39:03 +05:30
ishaan-jaff
844aa1999e (test) dynamo logger 2023-12-15 17:22:21 +05:30
ishaan-jaff
8c25e8e4e6 (test) dynamo logger 2023-12-15 17:22:07 +05:30
ishaan-jaff
78770b9972 (test) dynamo db writes 2023-12-15 16:43:33 +05:30
ishaan-jaff
564a57f526 (test) dynamo db logger 2023-12-15 15:36:29 +05:30
ishaan-jaff
88dbedf2d8 (test) proxy - AuthError Exception mapping 2023-12-15 14:10:42 +05:30
ishaan-jaff
e3cb7ba6ba (feat) proxy: embeddings-add OpenAI exception mapping 2023-12-15 14:02:24 +05:30
ishaan-jaff
a325321bc6 (test) proxy - exception mapping openai.NotFoundError 2023-12-15 13:34:51 +05:30
ishaan-jaff
1af258ac2f (test) raise NotFoundError 2023-12-15 10:18:53 +05:30
ishaan-jaff
e6a6b070a1 (feat) add BadRequestError for Azure 2023-12-15 09:53:38 +05:30
ishaan-jaff
9f1fad7e26 (test) proxy - Auth Error 2023-12-15 09:36:17 +05:30
ishaan-jaff
0e2f1fe241 (test) proxy - raise openai.AuthenticationError 2023-12-15 09:36:07 +05:30
ishaan-jaff
7a1e10c371 (test) proxy - test exception mapping 2023-12-15 08:28:12 +05:30
ishaan-jaff
b3e3894fb8 (test) router_get_deployments - stop using remove_model_id 2023-12-15 07:07:53 +05:30
ishaan-jaff
e339a2f813 (test) test_cooldown_same_model_name 2023-12-15 07:07:53 +05:30
Krrish Dholakia
096f3baea6 fix(main.py): log user for embedding calls 2023-12-14 15:14:37 -08:00
Krrish Dholakia
fe3af38f95 test(test_proxy_server.py): add testing for sagemaker embeddings to proxy server tests 2023-12-14 14:38:27 -08:00
Krrish Dholakia
e3ec848c10 test(test_optional_params.py): unit tests for get_optional_params_embeddings() 2023-12-14 14:32:36 -08:00
Krrish Dholakia
c2b92fe8b8 fix(proxy_server.py): don't pass in user param if not sent 2023-12-14 14:17:33 -08:00
Krrish Dholakia
bb5b883316 fix(main.py): support async streaming for text completions endpoint 2023-12-14 13:56:32 -08:00
Krrish Dholakia
e3768d0599 test(test_custom_callback_router.py): fix testing 2023-12-14 09:57:35 -08:00
ishaan-jaff
257475d8b4 (test) ollama test 2023-12-14 19:48:18 +05:30
ishaan-jaff
b8d51ee3ab (test) router - acompletion + cache 2023-12-14 19:46:56 +05:30