Commit graph

326 commits

Author SHA1 Message Date
Krrish Dholakia
1c802c26fc updates 2023-09-30 18:26:23 -07:00
ishaan-jaff
8d1f5ba69d add fake streaming for petals 2023-09-30 10:22:04 -07:00
ishaan-jaff
1a8144360e fix logging error 2023-09-29 16:02:19 -07:00
ishaan-jaff
3fbad7dfa7 add hf embedding models 2023-09-29 11:57:38 -07:00
ishaan-jaff
17be1d89b3 remove junk code in getting custom_llm_provider 2023-09-29 11:18:08 -07:00
ishaan-jaff
af914d4be1 add cohere embedding models 2023-09-29 09:59:31 -07:00
ishaan-jaff
13ff65a8fe remove junk from completion 2023-09-28 17:57:48 -07:00
ishaan-jaff
0f3be26778 remove junk from completion input 2023-09-28 17:54:46 -07:00
ishaan-jaff
da4a9d3119 remove junk vars in completion.py 2023-09-28 17:50:06 -07:00
ishaan-jaff
1b74cd2790 clean out args passed to completion 2023-09-28 17:43:54 -07:00
ishaan-jaff
8d11a0c722 clean out args given to completion 2023-09-28 17:35:47 -07:00
Krrish Dholakia
e2d23afae4 fix hf routing bug 2023-09-28 13:32:39 -07:00
Krrish Dholakia
3658bdb61b fix testing 2023-09-27 21:31:00 -07:00
Krrish Dholakia
d334031108 adding support for completions endpoint in proxy 2023-09-27 21:04:15 -07:00
Krrish Dholakia
a4ca26a189 cleanup 2023-09-26 21:55:25 -07:00
Krrish Dholakia
6e05fca714 add switching api keys + api bases to docs 2023-09-26 21:47:33 -07:00
Krrish Dholakia
ce62dc40b9 remove trust remote code option 2023-09-26 19:20:48 -07:00
ishaan-jaff
e7a9246414 palm streaming 2023-09-26 12:27:49 -07:00
ishaan-jaff
5944b1bbab lint fix 2023-09-26 10:11:53 -07:00
ishaan-jaff
d6bc20d5be add palm 2023-09-26 10:00:56 -07:00
ishaan-jaff
ed2d461770 add beta deep infra support 2023-09-25 21:42:46 -07:00
Krrish Dholakia
bdc6ef1df8 add contributor message to code 2023-09-25 10:00:10 -07:00
Krrish Dholakia
889679a0dd fix exception mapping for streaming 2023-09-23 15:04:59 -07:00
ishaan-jaff
cd91312252 track vertex ai usage 2023-09-22 20:43:03 -07:00
Krrish Dholakia
9ef0ad9e66 expose vertex ai and hf api base as env var 2023-09-22 15:14:33 -07:00
ishaan-jaff
6add152818 sagemaker streaming 2023-09-21 16:14:44 -07:00
Krrish Dholakia
2f44191642 add completion configs 2023-09-21 14:00:11 -07:00
Krrish Dholakia
b76372cee0 add metadata logging to promptlayer 2023-09-21 10:45:02 -07:00
ishaan-jaff
35bb6f5a50 support acompletion + stream for ollama 2023-09-21 10:39:48 -07:00
Ishaan Jaff
a669f5a738
Merge pull request #416 from BerriAI/ishaan/error-logging
Add Dashboard for showing error logs on exception
2023-09-20 20:17:18 -07:00
Krrish Dholakia
fc922bc300 fix multithreading issue with response objects 2023-09-20 19:36:08 -07:00
ishaan-jaff
eeeb95a6ac add batch testing 2023-09-20 08:17:48 -07:00
ishaan-jaff
41a934a99c add batch_completion_models_all_responses 2023-09-20 08:01:53 -07:00
ishaan-jaff
f9476b7a52 fix moderation 2023-09-19 22:18:02 -07:00
ishaan-jaff
0ca08b1545 bump v 2023-09-19 21:57:35 -07:00
ishaan-jaff
d15d876b02 add moderation 2023-09-19 21:44:04 -07:00
ishaan-jaff
fc10cf5eeb exception_type work 2023-09-19 21:29:51 -07:00
Krrish Dholakia
ecad921b01 add oobabooga text web api support 2023-09-19 18:56:53 -07:00
ishaan-jaff
2c30855389 new batch completion function 2023-09-19 13:29:41 -07:00
ishaan-jaff
5f808f9f87 petals on main 2023-09-19 09:27:28 -07:00
ishaan-jaff
385640b743 petals fixes 2023-09-19 09:24:34 -07:00
ishaan-jaff
934deab1f7 add petals to init and main 2023-09-19 09:24:34 -07:00
Krrish Dholakia
f134de1287 bug fix for litellm proxy implementation 2023-09-18 12:54:56 -07:00
Krrish Dholakia
8c809db567 bump version 2023-09-18 12:27:18 -07:00
Krrish Dholakia
9067ec3b43 add support for litellm proxy calls 2023-09-18 12:15:21 -07:00
Krish Dholakia
e83d89d12f
Merge pull request #387 from WilliamEspegren/main
Rebuild stream chunks to openAI object
2023-09-18 09:30:42 -07:00
ishaan-jaff
a5425df91f doc string for completion 2023-09-18 09:03:26 -07:00
ishaan-jaff
d684f75683 add doc string for a completion 2023-09-18 08:49:27 -07:00
WilliamEspegren
63a8614a14
Added function_call support to stream_chunk_builder 2023-09-17 19:42:55 +02:00
WilliamEspegren
404af1be0f
if "function_call" find name 2023-09-17 19:02:50 +02:00