Commit graph

263 commits

Author SHA1 Message Date
Krrish Dholakia
c737462beb adding support for completions endpoint in proxy 2023-09-27 21:04:15 -07:00
Krrish Dholakia
47f93024dd cleanup 2023-09-26 21:55:25 -07:00
Krrish Dholakia
7aaa857c90 add switching api keys + api bases to docs 2023-09-26 21:47:33 -07:00
Krrish Dholakia
126a8bf909 remove trust remote code option 2023-09-26 19:20:48 -07:00
ishaan-jaff
d1692e89dd palm streaming 2023-09-26 12:27:49 -07:00
ishaan-jaff
660a223663 lint fix 2023-09-26 10:11:53 -07:00
ishaan-jaff
a178082d89 add palm 2023-09-26 10:00:56 -07:00
ishaan-jaff
59664f0c87 add beta deep infra support 2023-09-25 21:42:46 -07:00
Krrish Dholakia
7cf5be98a2 add contributor message to code 2023-09-25 10:00:10 -07:00
Krrish Dholakia
3cac04f459 fix exception mapping for streaming 2023-09-23 15:04:59 -07:00
ishaan-jaff
689ca2e82d track vertex ai usage 2023-09-22 20:43:03 -07:00
Krrish Dholakia
1d86448b6a expose vertex ai and hf api base as env var 2023-09-22 15:14:33 -07:00
ishaan-jaff
be2f687a07 sagemaker streaming 2023-09-21 16:14:44 -07:00
Krrish Dholakia
a3a36b80e9 add completion configs 2023-09-21 14:00:11 -07:00
Krrish Dholakia
fdcfca7699 add metadata logging to promptlayer 2023-09-21 10:45:02 -07:00
ishaan-jaff
9219fd90c7 support acompletion + stream for ollama 2023-09-21 10:39:48 -07:00
Ishaan Jaff
cb63435850 Merge pull request #416 from BerriAI/ishaan/error-logging
Add Dashboard for showing error logs on exception
2023-09-20 20:17:18 -07:00
Krrish Dholakia
f075646dee fix multithreading issue with response objects 2023-09-20 19:36:08 -07:00
ishaan-jaff
fc7bcf3d77 add batch testing 2023-09-20 08:17:48 -07:00
ishaan-jaff
a6300f8067 add batch_completion_models_all_responses 2023-09-20 08:01:53 -07:00
ishaan-jaff
c8ee924f26 fix moderation 2023-09-19 22:18:02 -07:00
ishaan-jaff
0ba9a26ecd bump v 2023-09-19 21:57:35 -07:00
ishaan-jaff
41e813b22f add moderation 2023-09-19 21:44:04 -07:00
ishaan-jaff
ca295e6072 exception_type work 2023-09-19 21:29:51 -07:00
Krrish Dholakia
4509b62cf8 add oobabooga text web api support 2023-09-19 18:56:53 -07:00
ishaan-jaff
a833d48a51 new batch completion function 2023-09-19 13:29:41 -07:00
ishaan-jaff
ede2da25bb petals on main 2023-09-19 09:27:28 -07:00
ishaan-jaff
7527b7ba0d petals fixes 2023-09-19 09:24:34 -07:00
ishaan-jaff
38348f9390 add petals to init and main 2023-09-19 09:24:34 -07:00
Krrish Dholakia
d078d2f37e bug fix for litellm proxy implementation 2023-09-18 12:54:56 -07:00
Krrish Dholakia
df8aeeed02 bump version 2023-09-18 12:27:18 -07:00
Krrish Dholakia
3d2ffcb28b add support for litellm proxy calls 2023-09-18 12:15:21 -07:00
Krish Dholakia
9800c70a47 Merge pull request #387 from WilliamEspegren/main
Rebuild stream chunks to openAI object
2023-09-18 09:30:42 -07:00
ishaan-jaff
242cdd5462 doc string for completion 2023-09-18 09:03:26 -07:00
ishaan-jaff
c615af246f add doc string for a completion 2023-09-18 08:49:27 -07:00
WilliamEspegren
02859ba9a9 Added function_call support to stream_chunk_builder 2023-09-17 19:42:55 +02:00
WilliamEspegren
ca42b4c942 if "function_call" find name 2023-09-17 19:02:50 +02:00
WilliamEspegren
33d170b9b6 remove unused parameter 2023-09-17 13:12:49 +02:00
WilliamEspegren
4bf7272885 rebuild chunks to openAI response
Rebuild the cunks, but does not include the "usage"
2023-09-17 13:07:54 +02:00
WilliamEspegren
684b11b456 add stream_chunk_builder function 2023-09-17 10:26:34 +02:00
Krrish Dholakia
d6dc825fa7 bump version and clean print statements 2023-09-16 20:59:24 -07:00
Krrish Dholakia
6430bdb636 fix cohere streaming 2023-09-16 19:36:41 -07:00
Krrish Dholakia
e7974d95d5 fix streaming formatting for non-openai models 2023-09-16 19:20:07 -07:00
Krrish Dholakia
d80fe482ce except custom openai proxy 2023-09-16 16:15:44 -07:00
Krrish Dholakia
925ec2ded9 fixes to testing 2023-09-16 11:40:01 -07:00
Krrish Dholakia
0a1f3af840 ensure streaming format is exactly the same as openai 2023-09-16 10:35:20 -07:00
ishaan-jaff
9ee3faed5b streaming for amazon titan bedrock 2023-09-16 09:57:16 -07:00
Toni Engelhardt
d181ab86b0 fix setting mock response 2023-09-16 17:03:32 +01:00
ishaan-jaff
75de6a3516 bump version 2023-09-15 14:15:09 -07:00
ishaan-jaff
595dd46dbc tests 2023-09-15 13:38:26 -07:00