Commit graph

3262 commits

Author SHA1 Message Date
Krrish Dholakia
b09ecb986e test(test_custom_callback_input.py): add bedrock testing
n

n
2023-12-11 13:00:01 -08:00
ishaan-jaff
6a3ba74183 (test) proxy logging 2023-12-11 12:52:11 -08:00
ishaan-jaff
563bcbb862 (test) proxy custom logger 2023-12-11 12:50:24 -08:00
ishaan-jaff
5fc61f6d7a (test) custom logger 2023-12-11 12:39:28 -08:00
ishaan-jaff
e23700dd19 (test) custom logger 2023-12-11 12:35:12 -08:00
ishaan-jaff
89d9a5d38d (test) proxy custom logger 2023-12-11 12:00:26 -08:00
ishaan-jaff
fa7bcd5825 (test) proxy custom logger 2023-12-11 11:57:02 -08:00
Krrish Dholakia
ea89a8a938 test(test_custom_callback_unit.py): adding unit tests for custom callbacks + fixing related bugs 2023-12-11 11:44:09 -08:00
ishaan-jaff
1d2f5ce975 (test) proxy - share session config 2023-12-11 11:33:21 -08:00
ishaan-jaff
05a469177b (test) proxy custom logger 2023-12-11 11:21:46 -08:00
ishaan-jaff
c532224308 (test) custom logger proxy 2023-12-11 11:11:44 -08:00
ishaan-jaff
0522ffc4b7 (fix) update back model prices with latest llms 2023-12-11 10:56:01 -08:00
ishaan-jaff
04f6b976e9 (test) proxy callbacks 2023-12-11 10:49:53 -08:00
ishaan-jaff
38fe80266f (test) debug proxy logger test 2023-12-11 10:40:01 -08:00
ishaan-jaff
426c741b40 (test) hf text completion 2023-12-11 10:27:43 -08:00
ishaan-jaff
6aa2f4bc1d (test) custom logger embedding 2023-12-11 10:24:37 -08:00
ishaan-jaff
485c40b9ae (test) proxy 2023-12-11 10:12:01 -08:00
ishaan-jaff
71eee5087d (test) assert metadata in callbacks 2023-12-11 09:47:38 -08:00
ishaan-jaff
91f09365e8 (feat) access metadata in embedding kwargs() 2023-12-11 09:39:25 -08:00
ishaan-jaff
070ca682cf bump: version 1.12.3 → 1.12.4 2023-12-11 09:19:07 -08:00
ishaan-jaff
43b0da3ebc (docs) - proxy_config.yaml 2023-12-11 09:06:27 -08:00
ishaan-jaff
ee3c9d19a2 (feat) caching + stream - bedrock 2023-12-11 08:43:50 -08:00
ishaan-jaff
4b26c550c5 (test) bedrock caching + stream 2023-12-11 08:43:50 -08:00
ishaan-jaff
8cc23b72ec (feat) caching - bedrock 2023-12-11 08:43:50 -08:00
Krrish Dholakia
112881cbb2 test(test_completion.py): assert completion cost > 0.0 2023-12-11 07:59:06 -08:00
Krish Dholakia
4ffe6a4296
Merge pull request #1054 from James4Ever0/main
Update factory.py to fix issue when calling from write-the -> langchain -> litellm served ollama
2023-12-11 07:18:02 -08:00
Krish Dholakia
bbbc5db104
Merge pull request #1080 from nbaldwin98/fixing-replicate-sys-prompt
fix replicate system prompt: forgot to add **optional_params to input data
2023-12-11 07:11:52 -08:00
chabala98
c5ce11541b adfix: ded **optional_params in input data when system prompt is available (allows to papass other optional params apart from sys prompt) 2023-12-11 14:42:05 +01:00
ishaan-jaff
7977f92bd2 (test) langfuse 2023-12-09 22:58:23 -08:00
ishaan-jaff
f6a8ade91a (test) langfuse 2023-12-09 22:52:02 -08:00
ishaan-jaff
ee53139ce2 (fix) langfuse test 2023-12-09 22:47:52 -08:00
Krrish Dholakia
1ef9bfa125 test(test_proxy_server.py): add testing for /model/new endpoint 2023-12-09 22:44:11 -08:00
Krrish Dholakia
22f04e3b33 fix(proxy_server.py): fix /model/new adding new model issue 2023-12-09 22:44:11 -08:00
ishaan-jaff
3c8603f148 (test) langfuse 2023-12-09 22:44:02 -08:00
ishaan-jaff
127f25703a (fix) proxy /model/info 2023-12-09 22:35:09 -08:00
ishaan-jaff
d46a52b8f4 (test) langfuse 2023-12-09 22:33:41 -08:00
ishaan-jaff
9909e49171 (test) langfuse 2023-12-09 22:27:07 -08:00
ishaan-jaff
b4c5bacea9 (test) langfuse - read ddebug logs to find status 200 2023-12-09 22:27:07 -08:00
ishaan-jaff
3acd393c5e (feat) langfuse - print traceback.exec() 2023-12-09 22:27:07 -08:00
Krrish Dholakia
07b4c72a98 fix(proxy_server.py): fix key gen error 2023-12-09 22:04:59 -08:00
Krrish Dholakia
f10bb708c0 fix: fix run_ollama_serve to only run if api base is none 2023-12-09 21:31:46 -08:00
Krrish Dholakia
82484691cb fix: minor bug fixes 2023-12-09 21:24:52 -08:00
ishaan-jaff
bf1044444c (test) caching 2023-12-09 16:58:56 -08:00
ishaan-jaff
8a52e17300 (test) caching - get cache key 2023-12-09 16:42:59 -08:00
ishaan-jaff
2879b36636 (fix) setting cache keys 2023-12-09 16:42:59 -08:00
Krrish Dholakia
6ef0e8485e fix(proxy_server.py): support for streaming 2023-12-09 16:23:04 -08:00
ishaan-jaff
0c8b8200b8 (ci/cd) run tests again 2023-12-09 16:02:02 -08:00
ishaan-jaff
1f1f749ad9 (feat) proxy - cache allow bool 2023-12-09 15:55:38 -08:00
ishaan-jaff
da08be1f43 (test) router + caching 2023-12-09 15:41:36 -08:00
ishaan-jaff
60bf552fe8 (fix) caching + proxy - use model group 2023-12-09 15:40:22 -08:00