Commit graph

71 commits

Author SHA1 Message Date
Krrish Dholakia
c00cb299fc add context window exceeded error for anthropic 2023-08-29 16:28:07 -07:00
Krrish Dholakia
b40d9f79b5 add context window exceeded error mapping to openai 2023-08-29 16:08:00 -07:00
Krrish Dholakia
efbde50a03 adding coverage for openrouter in exception mapping 2023-08-29 15:30:24 -07:00
Krrish Dholakia
9646c03fe5 adding coverage for ai21 2023-08-29 13:32:20 -07:00
Krrish Dholakia
342fece93d add coverage for rate limit errors to togetherai 2023-08-29 12:54:56 -07:00
Krrish Dholakia
c790dfe323 adding exception handling for together ai 2023-08-29 12:29:59 -07:00
Krrish Dholakia
ddd583efb1 bug fixes to logging 2023-08-28 15:36:59 -07:00
Krrish Dholakia
0158e12701 bug fixes to client 2023-08-28 15:09:14 -07:00
Krrish Dholakia
a0f882d507 new logger client 2023-08-28 14:59:00 -07:00
Krrish Dholakia
3087c904eb fixes to streaming for ai21, baseten, and openai text completions 2023-08-28 09:42:51 -07:00
Krrish Dholakia
345a8888e9 further fixes to together ai streaming 2023-08-26 19:30:54 -07:00
Krrish Dholakia
320fe89a24 anthropic and together ai streaming no longer waits till completion to return response 2023-08-26 19:00:53 -07:00
Krrish Dholakia
95ce560f6d fix anthropic streaming 2023-08-26 18:54:51 -07:00
Krrish Dholakia
4c754d29b0 fix anthropic and together ai streaming 2023-08-26 16:05:43 -07:00
Krrish Dholakia
d0eb126700 adding ability to turn off litedebugger but still use key manager 2023-08-26 11:03:40 -07:00
Krrish Dholakia
47917edef4 show litedebugger for streaming objects 2023-08-26 10:28:27 -07:00
Krrish Dholakia
d5e8d8234a updates to get model list 2023-08-24 19:06:44 -07:00
Krrish Dholakia
5aa3bd67ca updates to logging 2023-08-24 18:58:12 -07:00
Krrish Dholakia
f7f108d230 move baseten to a REST endpoint call 2023-08-24 14:43:49 -07:00
Krrish Dholakia
63a226d8ba accept model alias 2023-08-24 08:20:21 -07:00
Krrish Dholakia
0955f9d53d adding support for completion with retries 2023-08-23 14:09:08 -07:00
Krrish Dholakia
e659c66a75 updates to litedebugger dashboard 2023-08-23 11:51:16 -07:00
Krrish Dholakia
a34b613a7c get keys if auth error 2023-08-22 18:01:49 -07:00
Krrish Dholakia
b481a66c7f updates 2023-08-22 16:13:09 -07:00
Krrish Dholakia
d01017256a change get to post request 2023-08-22 15:39:24 -07:00
Krrish Dholakia
2246bf6264 fixing lite debugger error 2023-08-22 15:15:47 -07:00
Krrish Dholakia
c4a4db2b34 cache the model list response 2023-08-22 07:21:24 -07:00
Krrish Dholakia
fd2eeaa6bc adding hosted get model list 2023-08-22 07:11:49 -07:00
Krrish Dholakia
1bbec66b57 acreate thin-client 2023-08-21 16:04:15 -07:00
Krrish Dholakia
a156fa1e1f fixing azure bug 2023-08-21 14:20:29 -07:00
Krrish Dholakia
4835a36cd8 simplifying calling litellm debugger 2023-08-21 11:37:09 -07:00
Krrish Dholakia
16a87afc80 adding lite debugger integration 2023-08-20 15:06:50 -07:00
Krrish Dholakia
7c33d1157a making logging a class - adding input-callbacks 2023-08-19 20:03:31 -07:00
Krrish Dholakia
5e53c9664c allow custom provider via model name 2023-08-19 16:35:04 -07:00
Krrish Dholakia
0ba0ca6896 automatically log data to sentry if it's present in the environment variables 2023-08-18 06:20:19 -07:00
Krrish Dholakia
ec324972d2 have response type inherit from openaiobject 2023-08-18 05:13:30 -07:00
Krrish Dholakia
6cd4c5531e bug fixes for response object 2023-08-17 20:24:38 -07:00
Krrish Dholakia
b91c69ffde return llm_provider as part of the exception 2023-08-17 11:41:47 -07:00
Krrish Dholakia
79bcb59e0b adding exact match caching 2023-08-16 21:44:52 -07:00
Krrish Dholakia
ecc029a2a0 add testing module 2023-08-16 09:03:33 -07:00
Krrish Dholakia
e642483eaf adding support for meta-llama-2 2023-08-14 14:35:21 -07:00
Krrish Dholakia
fb07d6b389 error handling for huggingface endpoints 2023-08-14 10:21:59 -07:00
Krrish Dholakia
1c909707ad added exception mapping to anthropic class 2023-08-12 17:39:11 -07:00
Krrish Dholakia
411ba6a827 adding anthropic llm class - handles sync + stream 2023-08-12 16:34:32 -07:00
Krrish Dholakia
8052b86de8 coverage for custom api scenario in load testing 2023-08-11 18:20:24 -07:00
Krrish Dholakia
386536ce88 add model load testing functionality 2023-08-11 17:59:51 -07:00
Krrish Dholakia
7fac7111f8 update version 2023-08-10 19:20:28 -07:00
Krrish Dholakia
c2ecdf657f allow custom base to openai 2023-08-10 18:01:52 -07:00
Krrish Dholakia
3cc3a15278 updating crash monitoring 2023-08-10 11:13:30 -07:00
Zakhar Kogan
0a2ad8cea6 Added Openrouter support back 2023-08-08 08:22:03 +03:00