Commit graph

1456 commits

Author SHA1 Message Date
ishaan-jaff
db188507b9 (test) gemini pro vision 2023-12-16 18:31:55 +05:30
ishaan-jaff
ed0b5d29b0 (test) proxy - cache config 2023-12-16 14:45:06 +05:30
Krrish Dholakia
84ad9f441e feat(router.py): support caching groups 2023-12-15 21:45:51 -08:00
ishaan-jaff
a7822b8772 (test) ollama-local, add llava test 2023-12-16 10:35:43 +05:30
Krrish Dholakia
5fe5149070 refactor(test_router_caching.py): add tests for router caching 2023-12-15 20:38:51 -08:00
Krrish Dholakia
4791dda66f feat(proxy_server.py): enable infinite retries on rate limited requests 2023-12-15 20:03:41 -08:00
Krrish Dholakia
e5268fa6bc fix(router.py): support openai-compatible endpoints 2023-12-15 14:47:54 -08:00
ishaan-jaff
003cf92af3 (test) dynamodb set table name 2023-12-15 21:39:03 +05:30
ishaan-jaff
cec7fcee2c (test) dynamo logger 2023-12-15 17:22:21 +05:30
ishaan-jaff
8cfa233b74 (test) dynamo logger 2023-12-15 17:22:07 +05:30
ishaan-jaff
15b1e758ab (test) dynamo db writes 2023-12-15 16:43:33 +05:30
ishaan-jaff
8b75d30a77 (test) dynamo db logger 2023-12-15 15:36:29 +05:30
ishaan-jaff
4413ef6dd2 (test) proxy - AuthError Exception mapping 2023-12-15 14:10:42 +05:30
ishaan-jaff
0b4f1dee42 (feat) proxy: embeddings-add OpenAI exception mapping 2023-12-15 14:02:24 +05:30
ishaan-jaff
d797bb100f (test) proxy - exception mapping openai.NotFoundError 2023-12-15 13:34:51 +05:30
ishaan-jaff
9826fd6c98 (test) raise NotFoundError 2023-12-15 10:18:53 +05:30
ishaan-jaff
191c1d2887 (feat) add BadRequestError for Azure 2023-12-15 09:53:38 +05:30
ishaan-jaff
8451badaa1 (test) proxy - Auth Error 2023-12-15 09:36:17 +05:30
ishaan-jaff
cc85aa9af3 (test) proxy - raise openai.AuthenticationError 2023-12-15 09:36:07 +05:30
ishaan-jaff
f09ce1d316 (test) proxy - test exception mapping 2023-12-15 08:28:12 +05:30
ishaan-jaff
fff148a835 (test) router_get_deployments - stop using remove_model_id 2023-12-15 07:07:53 +05:30
ishaan-jaff
0a6f6bd045 (test) test_cooldown_same_model_name 2023-12-15 07:07:53 +05:30
Krrish Dholakia
e45b491985 fix(main.py): log user for embedding calls 2023-12-14 15:14:37 -08:00
Krrish Dholakia
03dd7bff13 test(test_proxy_server.py): add testing for sagemaker embeddings to proxy server tests 2023-12-14 14:38:27 -08:00
Krrish Dholakia
51d62189f1 test(test_optional_params.py): unit tests for get_optional_params_embeddings() 2023-12-14 14:32:36 -08:00
Krrish Dholakia
2a4c1a1803 fix(proxy_server.py): don't pass in user param if not sent 2023-12-14 14:17:33 -08:00
Krrish Dholakia
1608dd7e0b fix(main.py): support async streaming for text completions endpoint 2023-12-14 13:56:32 -08:00
Krrish Dholakia
6cdcc1370f test(test_custom_callback_router.py): fix testing 2023-12-14 09:57:35 -08:00
ishaan-jaff
67518387f1 (test) ollama test 2023-12-14 19:48:18 +05:30
ishaan-jaff
26c6c1a03e (test) router - acompletion + cache 2023-12-14 19:46:56 +05:30
ishaan-jaff
5c40929a9b (test) add ollama tests to our ci/cd 2023-12-14 19:42:25 +05:30
ishaan-jaff
c0cc78b943 (feat) mistral - add exception mapping 2023-12-14 18:57:39 +05:30
ishaan-jaff
ee7e2869cb (test) mistral - safe_mode 2023-12-14 18:42:55 +05:30
ishaan-jaff
e34e4d3b71 (test) mistral api - safe_mode, random_seed 2023-12-14 18:42:43 +05:30
ishaan-jaff
6cda49ac6a (test) mistral api streaming 2023-12-14 18:28:03 +05:30
ishaan-jaff
0ef7bf237e (test) mistral ai api 2023-12-14 18:19:45 +05:30
ishaan-jaff
77b26fe9bb (test) test_custom_callback - aembedding cache 2023-12-14 17:36:29 +05:30
Ishaan Jaff
7d8ce6d62e
Merge branch 'main' into fix-langfuse-tests 2023-12-14 16:55:47 +05:30
ishaan-jaff
9a35f347ab (test) - caching - override when caching = False 2023-12-14 16:20:29 +05:30
ishaan-jaff
008df34ddc (feat) use async_cache for acompletion/aembedding 2023-12-14 16:04:45 +05:30
ishaan-jaff
ee6b936377 (test) caching - get cache key for embedding 2023-12-14 14:08:58 +05:30
ishaan-jaff
b70bfbb06f (test) router - test_model_group_aliases 2023-12-14 13:16:44 +05:30
ishaan-jaff
841e941ecd (test) router - model_group_alias 2023-12-14 13:08:35 +05:30
ishaan-jaff
1e48f58443 (fix) custom_callback_input test 2023-12-14 12:40:07 +05:30
Krrish Dholakia
73e5b96d8e fix(utils.py): support cache logging for async router calls 2023-12-13 19:11:43 -08:00
Krrish Dholakia
cffd190887 test(test_custom_callback_router.py): fix test 2023-12-13 19:06:02 -08:00
Krrish Dholakia
73ecc012a9 docs(embedding.md): add embedding docs to proxy 2023-12-13 18:58:46 -08:00
Krrish Dholakia
8d688b6217 fix(utils.py): support caching for embedding + log cache hits
n

n
2023-12-13 18:37:30 -08:00
Krrish Dholakia
0f29cda8d9 test(test_amazing_vertex_completion.py): fix testing 2023-12-13 16:41:26 -08:00
Krrish Dholakia
e678009695 fix(vertex_ai.py): add exception mapping for acompletion calls 2023-12-13 16:35:50 -08:00