Commit graph

288 commits

Author SHA1 Message Date
Krrish Dholakia
3087c904eb fixes to streaming for ai21, baseten, and openai text completions 2023-08-28 09:42:51 -07:00
ishaan-jaff
a69b7ffcfa formatting improvements 2023-08-28 09:20:50 -07:00
ishaan-jaff
73e411572e add text_completion 2023-08-28 08:20:20 -07:00
ishaan-jaff
8589a7e359 add text completion format support 2023-08-28 08:04:06 -07:00
ishaan-jaff
467009076b fix caching 2023-08-26 21:05:35 -07:00
Krrish Dholakia
345a8888e9 further fixes to together ai streaming 2023-08-26 19:30:54 -07:00
Krrish Dholakia
320fe89a24 anthropic and together ai streaming no longer waits till completion to return response 2023-08-26 19:00:53 -07:00
Krrish Dholakia
95ce560f6d fix anthropic streaming 2023-08-26 18:54:51 -07:00
ishaan-jaff
f29d2ecd3b move caching 2023-08-26 16:16:58 -07:00
ishaan-jaff
c153550c59 add litellm caching 2023-08-26 16:08:48 -07:00
Krrish Dholakia
4c754d29b0 fix anthropic and together ai streaming 2023-08-26 16:05:43 -07:00
ishaan-jaff
be16250840 failing gpt cache test 2023-08-26 15:43:00 -07:00
ishaan-jaff
40a0fefc93 fix linting tests 2023-08-26 11:56:52 -07:00
ishaan-jaff
e171c9b3eb with prompt layer test 2023-08-26 11:51:55 -07:00
Krrish Dholakia
06711e7d46 update testing for streaming to catch empty responses 2023-08-26 11:20:06 -07:00
Krrish Dholakia
d0eb126700 adding ability to turn off litedebugger but still use key manager 2023-08-26 11:03:40 -07:00
Krrish Dholakia
cb14701bc4 update model alias map 2023-08-26 10:39:50 -07:00
Krrish Dholakia
47917edef4 show litedebugger for streaming objects 2023-08-26 10:28:27 -07:00
Krrish Dholakia
f7f108d230 move baseten to a REST endpoint call 2023-08-24 14:43:49 -07:00
Krrish Dholakia
2a4cedb1ff enable litedebugger opt-out 2023-08-24 10:19:10 -07:00
Krrish Dholakia
63a226d8ba accept model alias 2023-08-24 08:20:21 -07:00
Krrish Dholakia
0955f9d53d adding support for completion with retries 2023-08-23 14:09:08 -07:00
Krrish Dholakia
e659c66a75 updates to litedebugger dashboard 2023-08-23 11:51:16 -07:00
Vince Lwt
f7391c9b05 Merge branch 'main' into main 2023-08-23 18:39:09 +02:00
Krrish Dholakia
b481a66c7f updates 2023-08-22 16:13:09 -07:00
ishaan-jaff
43fd811f4f fix build errors 2023-08-22 16:11:52 -07:00
ishaan-jaff
a61d261c06 fix linting errors 2023-08-22 16:06:41 -07:00
Krrish Dholakia
d01017256a change get to post request 2023-08-22 15:39:24 -07:00
ishaan-jaff
d47476165f linting fixes 2023-08-22 15:17:38 -07:00
Krrish Dholakia
7bb633e190 updating test 2023-08-22 15:16:08 -07:00
Krrish Dholakia
2246bf6264 fixing lite debugger error 2023-08-22 15:15:47 -07:00
ishaan-jaff
9a04a3b95b test fallbacks 2023-08-22 15:07:07 -07:00
ishaan-jaff
c67e59cd10 formatting fixes 2023-08-22 15:07:07 -07:00
Krrish Dholakia
c4a4db2b34 cache the model list response 2023-08-22 07:21:24 -07:00
Krrish Dholakia
fd2eeaa6bc adding hosted get model list 2023-08-22 07:11:49 -07:00
Vince Lwt
2c3f904491 clean 2023-08-22 15:48:43 +02:00
Vince Lwt
2e5250607e support for later embeddings 2023-08-22 15:42:56 +02:00
Krrish Dholakia
1bbec66b57 acreate thin-client 2023-08-21 16:04:15 -07:00
Krrish Dholakia
b9ee1b38f6 updates 2023-08-21 15:16:58 -07:00
Krrish Dholakia
bfbab563f8 fixing azure bug 2023-08-21 14:05:25 -07:00
Vince Lwt
48a2e7de0d fix error tracking 2023-08-21 21:31:09 +02:00
Krrish Dholakia
4835a36cd8 simplifying calling litellm debugger 2023-08-21 11:37:09 -07:00
Vince Lwt
52a4389ef8 clean format 2023-08-21 17:01:00 +02:00
Vince Lwt
647df99774 almost working llmonitor 2023-08-21 16:26:47 +02:00
Vince Lwt
b96822ea0f Merge branch 'main' of github.com:vincelwt/litellm 2023-08-21 12:22:07 +02:00
Vince Lwt
b1fb75af1b add integration files 2023-08-21 12:19:58 +02:00
Krrish Dholakia
16a87afc80 adding lite debugger integration 2023-08-20 15:06:50 -07:00
Krrish Dholakia
fa26205dab test issues 2023-08-19 20:57:38 -07:00
Krrish Dholakia
7c33d1157a making logging a class - adding input-callbacks 2023-08-19 20:03:31 -07:00
Krrish Dholakia
5e53c9664c allow custom provider via model name 2023-08-19 16:35:04 -07:00