Commit graph

2080 commits

Author SHA1 Message Date
ishaan-jaff
48cad985ad add fake streaming for petals 2023-09-30 10:22:04 -07:00
Krrish Dholakia
6ac9470203 add mistral prompt templating 2023-09-29 21:41:28 -07:00
ishaan-jaff
4f7c6f1c77 fix co embeddings 2023-09-29 16:00:49 -07:00
ishaan-jaff
aaa5ac0488 add param mapping to claude bedrock 2023-09-29 15:36:57 -07:00
ishaan-jaff
0e11fdda42 test fixes for embedding 2023-09-29 15:31:53 -07:00
ishaan-jaff
e039313b63 add bedrock anthropic streaming 2023-09-29 15:19:42 -07:00
Krrish Dholakia
932447e63a updates 2023-09-29 11:33:58 -07:00
ishaan-jaff
17c2863f02 add cohere embedding models 2023-09-29 09:59:31 -07:00
Krrish Dholakia
56bb3cb261 updates to proxy 2023-09-28 17:58:47 -07:00
Krrish Dholakia
91521175f1 update proxy cli 2023-09-28 16:24:41 -07:00
ishaan-jaff
b08aea851f fix petals bug 2023-09-27 20:51:31 -07:00
Krrish Dholakia
8744b2a14b updates 2023-09-27 17:43:22 -07:00
Krrish Dholakia
8e08724d15 remove print statements 2023-09-27 17:06:49 -07:00
Krrish Dholakia
126a8bf909 remove trust remote code option 2023-09-26 19:20:48 -07:00
Krrish Dholakia
6b1d335546 fix linting issue 2023-09-26 18:10:59 -07:00
Krrish Dholakia
7f62b5b6e0 fix llama index validate environment error 2023-09-26 17:53:22 -07:00
Krrish Dholakia
455f3370c8 add support message on exception 2023-09-26 17:48:24 -07:00
Krrish Dholakia
694265798d push cli tool 2023-09-26 13:30:47 -07:00
ishaan-jaff
d1692e89dd palm streaming 2023-09-26 12:27:49 -07:00
ishaan-jaff
f82dc74143 add palm exception mapping 2023-09-26 10:25:11 -07:00
Krrish Dholakia
e8e1bf01f0 allow backup api keys and api bases 2023-09-26 06:56:26 -07:00
Krrish Dholakia
7cf5be98a2 add contributor message to code 2023-09-25 10:00:10 -07:00
Krrish Dholakia
d010760dab update validate environment function 2023-09-23 22:08:57 -07:00
Krrish Dholakia
3cac04f459 fix exception mapping for streaming 2023-09-23 15:04:59 -07:00
ishaan-jaff
b00f69db9d add claude max_tokens_to_sample 2023-09-22 20:57:52 -07:00
Krrish Dholakia
cb8fb8a19d fix anthropic json location bug 2023-09-22 15:21:28 -07:00
Krrish Dholakia
dbbe519e19 fix linting errors 2023-09-22 15:04:18 -07:00
Krrish Dholakia
9876393355 adding support for cohere, anthropic, llama2 tokenizers 2023-09-22 14:03:52 -07:00
Krrish Dholakia
f3b6bd1beb add token trimming to adapt to prompt flag in config 2023-09-21 17:47:52 -07:00
Krrish Dholakia
9434237cbf add docs on using completion with configs 2023-09-21 17:03:36 -07:00
ishaan-jaff
be2f687a07 sagemaker streaming 2023-09-21 16:14:44 -07:00
ishaan-jaff
2e6d6adcc2 response_ms fix 2023-09-21 15:44:50 -07:00
Krrish Dholakia
4d63211e68 add adapt to prompt size to config 2023-09-21 15:08:05 -07:00
Krrish Dholakia
f3c334f27c support default fallback models 2023-09-21 14:28:07 -07:00
Krrish Dholakia
cd1a6e8108 fix linting errors 2023-09-21 14:10:27 -07:00
Krrish Dholakia
a3a36b80e9 add completion configs 2023-09-21 14:00:11 -07:00
ishaan-jaff
c5114011de ollama exception mapping + new cookbook 2023-09-21 12:00:04 -07:00
Krrish Dholakia
fdcfca7699 add metadata logging to promptlayer 2023-09-21 10:45:02 -07:00
Krrish Dholakia
0a6f072471 bump litellm version 2023-09-20 20:20:34 -07:00
Ishaan Jaff
cb63435850 Merge pull request #416 from BerriAI/ishaan/error-logging
Add Dashboard for showing error logs on exception
2023-09-20 20:17:18 -07:00
ishaan-jaff
db6bd17a23 only show error log dashboard on fail 2023-09-20 20:09:02 -07:00
Krrish Dholakia
7e831bed15 add response ms to response object 2023-09-20 19:50:38 -07:00
Krrish Dholakia
f075646dee fix multithreading issue with response objects 2023-09-20 19:36:08 -07:00
Krrish Dholakia
4401d00ea0 return all best of sequences 2023-09-20 14:43:25 -07:00
ishaan-jaff
ca295e6072 exception_type work 2023-09-19 21:29:51 -07:00
ishaan-jaff
c32190f2da petals remove print statement 2023-09-19 10:56:30 -07:00
ishaan-jaff
7527b7ba0d petals fixes 2023-09-19 09:24:34 -07:00
Krrish Dholakia
6f4641ac47 handle llama 2 eos tokens in streaming 2023-09-18 13:44:19 -07:00
Krrish Dholakia
3d2ffcb28b add support for litellm proxy calls 2023-09-18 12:15:21 -07:00
ishaan-jaff
58fe19204e add doc string for completion_cost 2023-09-18 08:44:40 -07:00