Commit graph

78 commits

Author SHA1 Message Date
Krrish Dholakia
73bb1b96e9 update exception mapping and get model cost map 2023-09-04 11:53:20 -07:00
Krrish Dholakia
895e3c1a94 update to logging 2023-09-02 15:45:45 -07:00
Krrish Dholakia
83b8af8567 adding support for aleph alpha 2023-09-02 13:15:41 -07:00
Krrish Dholakia
34ed4cc23c updates to logging 2023-09-01 14:38:52 -07:00
Krrish Dholakia
0ff4515f20 fixes to litedebugger 2023-09-01 13:22:16 -07:00
Krrish Dholakia
fda6dba1ec fixes to core logging 2023-09-01 11:51:49 -07:00
Krrish Dholakia
b44299cce7 update model split tests with ui 2023-08-31 16:42:40 -07:00
Krrish Dholakia
14d4c7ead2 update baseten handler to handle TGI calls 2023-08-30 19:14:48 -07:00
Krrish Dholakia
5bcf612724 adding coverage for openrouter in exception mapping 2023-08-29 15:30:24 -07:00
Krrish Dholakia
f11599e50c add coverage for rate limit errors to togetherai 2023-08-29 12:54:56 -07:00
Krrish Dholakia
88bd1df3e0 adding exception handling for together ai 2023-08-29 12:29:59 -07:00
Krrish Dholakia
2462791f65 bug fixes to client 2023-08-28 15:09:14 -07:00
Krrish Dholakia
e8eb92c108 new logger client 2023-08-28 14:59:00 -07:00
Krrish Dholakia
d542066d4b fixes to streaming for ai21, baseten, and openai text completions 2023-08-28 09:42:51 -07:00
Krrish Dholakia
60873abb41 further fixes to together ai streaming 2023-08-26 19:30:54 -07:00
Krrish Dholakia
bb3c2fefdb anthropic and together ai streaming no longer waits till completion to return response 2023-08-26 19:00:53 -07:00
Krrish Dholakia
0ac17646d9 fix anthropic streaming 2023-08-26 18:54:51 -07:00
Krrish Dholakia
9155ba068f fix anthropic and together ai streaming 2023-08-26 16:05:43 -07:00
Krrish Dholakia
1192640fb9 show litedebugger for streaming objects 2023-08-26 10:28:27 -07:00
Krrish Dholakia
7d16df98ac updates to logging 2023-08-24 18:58:12 -07:00
Krrish Dholakia
6e30b234ac move baseten to a REST endpoint call 2023-08-24 14:43:49 -07:00
Krrish Dholakia
67d6527217 accept model alias 2023-08-24 08:20:21 -07:00
Krrish Dholakia
c8d2a5ed5e adding support for completion with retries 2023-08-23 14:09:08 -07:00
Krrish Dholakia
d183dc8269 updates to litedebugger dashboard 2023-08-23 11:51:16 -07:00
Krrish Dholakia
b47cb95b90 get keys if auth error 2023-08-22 18:01:49 -07:00
Krrish Dholakia
46e1bc24b7 updates 2023-08-22 16:13:09 -07:00
Krrish Dholakia
1f98f38f13 change get to post request 2023-08-22 15:39:24 -07:00
Krrish Dholakia
29daeddb41 updates 2023-08-21 15:16:58 -07:00
Krrish Dholakia
b506e147cf fixing azure bug 2023-08-21 14:20:29 -07:00
Krrish Dholakia
3286a708fe simplifying calling litellm debugger 2023-08-21 11:37:09 -07:00
Krrish Dholakia
582b536276 adding email based litellm debugger logs 2023-08-21 07:47:05 -07:00
Krrish Dholakia
ecdc7abfd8 updates 2023-08-21 06:05:45 -07:00
Krrish Dholakia
a1ad773667 adding lite debugger integration 2023-08-20 15:06:50 -07:00
Krrish Dholakia
d792be89de making logging a class - adding input-callbacks 2023-08-19 20:03:31 -07:00
Krrish Dholakia
6cee3b22ab allow custom provider via model name 2023-08-19 16:35:04 -07:00
Krrish Dholakia
ee20e6a1e6 have response type inherit from openaiobject 2023-08-18 05:13:30 -07:00
Krrish Dholakia
f0b104f37f bug fixes for response object 2023-08-17 20:24:38 -07:00
Krrish Dholakia
16589d1892 return llm_provider as part of the exception 2023-08-17 11:41:47 -07:00
Krrish Dholakia
acbb611e89 adding exact match caching 2023-08-16 21:44:52 -07:00
Krrish Dholakia
77e4acc7fa add testing module 2023-08-16 09:03:33 -07:00
Krrish Dholakia
6aff47083b adding support for meta-llama-2 2023-08-14 14:35:21 -07:00
Krrish Dholakia
15944eb0f3 error handling for huggingface endpoints 2023-08-14 10:21:59 -07:00
Krrish Dholakia
a4cf7e1edd added exception mapping to anthropic class 2023-08-12 17:39:11 -07:00
Krrish Dholakia
bc767cc42a adding anthropic llm class - handles sync + stream 2023-08-12 16:34:32 -07:00
Krrish Dholakia
80d77fed71 coverage for custom api scenario in load testing 2023-08-11 18:20:24 -07:00
Krrish Dholakia
211e1edfcb add model load testing functionality 2023-08-11 17:59:51 -07:00
Krrish Dholakia
fb285c8c9f update 2023-08-11 09:51:14 -07:00
Krrish Dholakia
a84af42dca update version 2023-08-10 19:20:28 -07:00
Krrish Dholakia
24e51ec75c allow custom base to openai 2023-08-10 18:01:52 -07:00
Krrish Dholakia
09fcd88799 updating crash monitoring 2023-08-10 11:13:30 -07:00