Commit graph

4241 commits

Author SHA1 Message Date
Krrish Dholakia
bd8d59e693 refactor(proxy_server.py): linting fix 2023-12-06 22:49:30 -08:00
Krrish Dholakia
e8f526e45f bump: version 1.11.0 → 1.11.1 2023-12-06 22:47:01 -08:00
Krrish Dholakia
6fae3fde22 test(test_embeddings.py): improve testing for titan embeddings 2023-12-06 22:47:01 -08:00
Krrish Dholakia
c1e95740b0 fix(bedrock.py): fix output format for cohere embeddings 2023-12-06 22:47:01 -08:00
ishaan-jaff
7ddc0dad24 (test) fix test_model_group_aliases 2023-12-06 21:25:30 -08:00
ishaan-jaff
fa70b1f85b (test) unset model_group_alias_map after test 2023-12-06 20:35:14 -08:00
ishaan-jaff
7b389d10ca (linting) fix 2023-12-06 20:30:33 -08:00
ishaan-jaff
095aa94e71 (fix) linting 2023-12-06 20:26:57 -08:00
ishaan-jaff
900b8d66f3 (feat) proxy use model_group_alias_map 2023-12-06 20:23:24 -08:00
ishaan-jaff
ee70c4e822 (feat) router - add model_group_alias_map 2023-12-06 20:13:33 -08:00
Krrish Dholakia
9573123e2b bump: version 1.10.11 → 1.11.0 2023-12-06 19:50:09 -08:00
Krrish Dholakia
d3e179e5ad test: fix testing 2023-12-06 19:35:12 -08:00
Krrish Dholakia
ac7d0a1632 fix(together_ai.py): improve together ai custom prompt templating 2023-12-06 19:34:49 -08:00
ishaan-jaff
04eecaa493 (test) custom logger on fail 2023-12-06 19:15:08 -08:00
ishaan-jaff
f3469fdef8 (test) aembedding on custom logger 2023-12-06 19:09:06 -08:00
ishaan-jaff
7fcd17cbbe (feat) aembedding callback 2023-12-06 19:09:06 -08:00
ishaan-jaff
e3b24ec797 (feat) aembedding - add custom logging support 2023-12-06 19:09:06 -08:00
Krrish Dholakia
fff0228c20 fix(factory.py): support togethercomputer codellama pt 2023-12-06 19:02:58 -08:00
Krrish Dholakia
d4c6cc3920 test: fix testing 2023-12-06 18:52:49 -08:00
Krrish Dholakia
c0eedf28fc test: fix proxy server testing 2023-12-06 18:38:53 -08:00
ishaan-jaff
19b1deb200 (feat) proxy: protect health endpoint 2023-12-06 18:14:54 -08:00
ishaan-jaff
1b43c7120c (test) custom logger - check kwargs passed all the way 2023-12-06 18:08:48 -08:00
Krrish Dholakia
0295509b3b fix(factory.py): fix claude 2.1 prompt template to handle system, assistant, user prompt 2023-12-06 18:02:06 -08:00
ishaan-jaff
c8c45ef9c4 (test) async custom logger 2023-12-06 17:53:06 -08:00
Krrish Dholakia
45b4140615 test: fix config import for proxy testing 2023-12-06 17:40:38 -08:00
Krrish Dholakia
c789865c87 fix(langfuse.py): metadata none error 2023-12-06 17:24:59 -08:00
ishaan-jaff
8cd9f18b61 (docs) add async success + fail custom logger 2023-12-06 17:24:39 -08:00
Krrish Dholakia
d814184bc3 test: fix test imports 2023-12-06 17:21:47 -08:00
Krrish Dholakia
d2de7ffe27 test(test_proxy_server_langfuse.py): add langfuse proxy testing 2023-12-06 17:19:17 -08:00
ishaan-jaff
b60dc20f4b (fix) proxy edit custom logger 2023-12-06 17:16:24 -08:00
ishaan-jaff
8adbf35623 (feat) add async loggers under custom logger 2023-12-06 17:16:24 -08:00
ishaan-jaff
b482b9002c (feat) Custom_logger add async success & async failure 2023-12-06 17:16:24 -08:00
ishaan-jaff
1bac052eca (fix) proxy use async logging 2023-12-06 17:16:24 -08:00
ishaan-jaff
dfb30d38fa (feat) proxy print set callbacks 2023-12-06 17:16:24 -08:00
Krrish Dholakia
58848841e1 fix(proxy_server.py): make headers json serializable 2023-12-06 17:09:02 -08:00
Krrish Dholakia
51492125b5 test: skip flaky test 2023-12-06 16:50:02 -08:00
Krrish Dholakia
caac4f1779 docs(virtual_keys.md): fix import line 2023-12-06 15:12:23 -08:00
Krrish Dholakia
ad922b205b fix(proxy_server.py): enable rate limiting concurrent user requests 2023-12-06 15:11:05 -08:00
ishaan-jaff
cf1df8204e (docs) proxy - custom async func 2023-12-06 15:04:24 -08:00
ishaan-jaff
0ea6241d3e (docs) use async callback functions 2023-12-06 15:00:16 -08:00
ishaan-jaff
44bf51601a (feat) proxy - custom on failure callback 2023-12-06 14:43:47 -08:00
ishaan-jaff
b3f039627e (feat) litellm - add _async_failure_callback 2023-12-06 14:43:47 -08:00
ishaan-jaff
3b17fd3821 (feat) proxy - async_on_fail_logger 2023-12-06 14:43:47 -08:00
Krrish Dholakia
f1c1ec8523 fix(bedrock.py): fix embeddings call 2023-12-06 14:16:00 -08:00
ishaan-jaff
be15cf20b9 (chore) print verbose 2023-12-06 14:14:20 -08:00
ishaan-jaff
e1230627d0 (fix) print statements 2023-12-06 14:11:23 -08:00
ishaan-jaff
0598ab9b63 (fix) proxy /model/new writing to config 2023-12-06 14:11:23 -08:00
Krrish Dholakia
346551da29 fix(proxy_server.py): allow worker config to just be the config filepath 2023-12-06 14:03:25 -08:00
ishaan-jaff
368934d160 (feat) proxy: use async_callback function 2023-12-06 13:51:24 -08:00
Krrish Dholakia
b24c9b4cbf refactor: fix linting 2023-12-06 13:27:40 -08:00