Commit graph

1298 commits

Author SHA1 Message Date
ishaan-jaff
35bb6f5a50 support acompletion + stream for ollama 2023-09-21 10:39:48 -07:00
Ishaan Jaff
a669f5a738
Merge pull request #416 from BerriAI/ishaan/error-logging
Add Dashboard for showing error logs on exception
2023-09-20 20:17:18 -07:00
Krrish Dholakia
fc922bc300 fix multithreading issue with response objects 2023-09-20 19:36:08 -07:00
ishaan-jaff
eeeb95a6ac add batch testing 2023-09-20 08:17:48 -07:00
ishaan-jaff
41a934a99c add batch_completion_models_all_responses 2023-09-20 08:01:53 -07:00
ishaan-jaff
f9476b7a52 fix moderation 2023-09-19 22:18:02 -07:00
ishaan-jaff
0ca08b1545 bump v 2023-09-19 21:57:35 -07:00
ishaan-jaff
d15d876b02 add moderation 2023-09-19 21:44:04 -07:00
ishaan-jaff
fc10cf5eeb exception_type work 2023-09-19 21:29:51 -07:00
Krrish Dholakia
ecad921b01 add oobabooga text web api support 2023-09-19 18:56:53 -07:00
ishaan-jaff
2c30855389 new batch completion function 2023-09-19 13:29:41 -07:00
ishaan-jaff
5f808f9f87 petals on main 2023-09-19 09:27:28 -07:00
ishaan-jaff
385640b743 petals fixes 2023-09-19 09:24:34 -07:00
ishaan-jaff
934deab1f7 add petals to init and main 2023-09-19 09:24:34 -07:00
Krrish Dholakia
f134de1287 bug fix for litellm proxy implementation 2023-09-18 12:54:56 -07:00
Krrish Dholakia
8c809db567 bump version 2023-09-18 12:27:18 -07:00
Krrish Dholakia
9067ec3b43 add support for litellm proxy calls 2023-09-18 12:15:21 -07:00
Krish Dholakia
e83d89d12f
Merge pull request #387 from WilliamEspegren/main
Rebuild stream chunks to openAI object
2023-09-18 09:30:42 -07:00
ishaan-jaff
a5425df91f doc string for completion 2023-09-18 09:03:26 -07:00
ishaan-jaff
d684f75683 add doc string for a completion 2023-09-18 08:49:27 -07:00
WilliamEspegren
63a8614a14
Added function_call support to stream_chunk_builder 2023-09-17 19:42:55 +02:00
WilliamEspegren
404af1be0f
if "function_call" find name 2023-09-17 19:02:50 +02:00
WilliamEspegren
d2bdfecd96
remove unused parameter 2023-09-17 13:12:49 +02:00
WilliamEspegren
5544a9251f
rebuild chunks to openAI response
Rebuild the cunks, but does not include the "usage"
2023-09-17 13:07:54 +02:00
WilliamEspegren
43a18b9528
add stream_chunk_builder function 2023-09-17 10:26:34 +02:00
Krrish Dholakia
c829798e04 bump version and clean print statements 2023-09-16 20:59:24 -07:00
Krrish Dholakia
e4fbc8d908 fix cohere streaming 2023-09-16 19:36:41 -07:00
Krrish Dholakia
e44c218c1b fix streaming formatting for non-openai models 2023-09-16 19:20:07 -07:00
Krrish Dholakia
122c993e6f except custom openai proxy 2023-09-16 16:15:44 -07:00
Krrish Dholakia
ce827faa93 fixes to testing 2023-09-16 11:40:01 -07:00
Krrish Dholakia
21cd55ab26 ensure streaming format is exactly the same as openai 2023-09-16 10:35:20 -07:00
ishaan-jaff
c714372b9d streaming for amazon titan bedrock 2023-09-16 09:57:16 -07:00
Toni Engelhardt
73bea9345f
fix setting mock response 2023-09-16 17:03:32 +01:00
ishaan-jaff
5ec1fc5048 bump version 2023-09-15 14:15:09 -07:00
ishaan-jaff
abb3793e50 tests 2023-09-15 13:38:26 -07:00
ishaan-jaff
b2c4c3576c add new tg ai llm check 2023-09-15 09:29:46 -07:00
ishaan-jaff
38bdb9335c add bedrock to main and init 2023-09-14 13:51:09 -07:00
Krrish Dholakia
3b4064a58f move cohere to http endpoint 2023-09-14 11:17:38 -07:00
Krrish Dholakia
e2ea4adb84 fixes to mock completion 2023-09-14 10:03:57 -07:00
Krish Dholakia
7c9779f0ac
Merge pull request #371 from promptmetheus/simplify-mock-logic
Simplify mock logic
2023-09-14 09:23:45 -07:00
Krrish Dholakia
f98da9f13c adding support for nlp cloud 2023-09-14 09:19:34 -07:00
ishaan-jaff
61737e67a1 pass api_type as an arg in ChatCompl 2023-09-14 08:48:59 -07:00
Toni Engelhardt
900cf2c2ee
simplify mock logic
Adds shortcut for the mock_completion method.
2023-09-14 16:13:31 +01:00
Toni Engelhardt
630b5d2c1f
add kwargs to mock_completion
Allows replacing `completion` with `mock_completion` without encountering errors.
2023-09-14 10:27:19 +01:00
Krrish Dholakia
aaa57abddd map finish reason 2023-09-13 19:22:38 -07:00
Krrish Dholakia
5b6b9a9fab huggingface conversational task support 2023-09-13 13:45:23 -07:00
ishaan-jaff
e3fa1d686e remove verify_access_key from main 2023-09-12 11:50:30 -07:00
Ishaan Jaff
60e3e42fba
Merge branch 'main' into main 2023-09-12 11:43:03 -07:00
Krrish Dholakia
baa69734b0 raise better exception if llm provider isn't passed in or inferred 2023-09-12 11:28:50 -07:00
ishaan-jaff
0ffcf51445 fix azure logging 2023-09-12 10:35:47 -07:00