Commit graph

440 commits

Author SHA1 Message Date
ishaan-jaff
fc10cf5eeb exception_type work 2023-09-19 21:29:51 -07:00
Krrish Dholakia
ecad921b01 add oobabooga text web api support 2023-09-19 18:56:53 -07:00
ishaan-jaff
2c30855389 new batch completion function 2023-09-19 13:29:41 -07:00
ishaan-jaff
5f808f9f87 petals on main 2023-09-19 09:27:28 -07:00
ishaan-jaff
385640b743 petals fixes 2023-09-19 09:24:34 -07:00
ishaan-jaff
934deab1f7 add petals to init and main 2023-09-19 09:24:34 -07:00
Krrish Dholakia
f134de1287 bug fix for litellm proxy implementation 2023-09-18 12:54:56 -07:00
Krrish Dholakia
8c809db567 bump version 2023-09-18 12:27:18 -07:00
Krrish Dholakia
9067ec3b43 add support for litellm proxy calls 2023-09-18 12:15:21 -07:00
Krish Dholakia
e83d89d12f
Merge pull request #387 from WilliamEspegren/main
Rebuild stream chunks to openAI object
2023-09-18 09:30:42 -07:00
ishaan-jaff
a5425df91f doc string for completion 2023-09-18 09:03:26 -07:00
ishaan-jaff
d684f75683 add doc string for a completion 2023-09-18 08:49:27 -07:00
WilliamEspegren
63a8614a14
Added function_call support to stream_chunk_builder 2023-09-17 19:42:55 +02:00
WilliamEspegren
404af1be0f
if "function_call" find name 2023-09-17 19:02:50 +02:00
WilliamEspegren
d2bdfecd96
remove unused parameter 2023-09-17 13:12:49 +02:00
WilliamEspegren
5544a9251f
rebuild chunks to openAI response
Rebuild the cunks, but does not include the "usage"
2023-09-17 13:07:54 +02:00
WilliamEspegren
43a18b9528
add stream_chunk_builder function 2023-09-17 10:26:34 +02:00
Krrish Dholakia
c829798e04 bump version and clean print statements 2023-09-16 20:59:24 -07:00
Krrish Dholakia
e4fbc8d908 fix cohere streaming 2023-09-16 19:36:41 -07:00
Krrish Dholakia
e44c218c1b fix streaming formatting for non-openai models 2023-09-16 19:20:07 -07:00
Krrish Dholakia
122c993e6f except custom openai proxy 2023-09-16 16:15:44 -07:00
Krrish Dholakia
ce827faa93 fixes to testing 2023-09-16 11:40:01 -07:00
Krrish Dholakia
21cd55ab26 ensure streaming format is exactly the same as openai 2023-09-16 10:35:20 -07:00
ishaan-jaff
c714372b9d streaming for amazon titan bedrock 2023-09-16 09:57:16 -07:00
Toni Engelhardt
73bea9345f
fix setting mock response 2023-09-16 17:03:32 +01:00
ishaan-jaff
5ec1fc5048 bump version 2023-09-15 14:15:09 -07:00
ishaan-jaff
abb3793e50 tests 2023-09-15 13:38:26 -07:00
ishaan-jaff
b2c4c3576c add new tg ai llm check 2023-09-15 09:29:46 -07:00
ishaan-jaff
38bdb9335c add bedrock to main and init 2023-09-14 13:51:09 -07:00
Krrish Dholakia
3b4064a58f move cohere to http endpoint 2023-09-14 11:17:38 -07:00
Krrish Dholakia
e2ea4adb84 fixes to mock completion 2023-09-14 10:03:57 -07:00
Krish Dholakia
7c9779f0ac
Merge pull request #371 from promptmetheus/simplify-mock-logic
Simplify mock logic
2023-09-14 09:23:45 -07:00
Krrish Dholakia
f98da9f13c adding support for nlp cloud 2023-09-14 09:19:34 -07:00
ishaan-jaff
61737e67a1 pass api_type as an arg in ChatCompl 2023-09-14 08:48:59 -07:00
Toni Engelhardt
900cf2c2ee
simplify mock logic
Adds shortcut for the mock_completion method.
2023-09-14 16:13:31 +01:00
Toni Engelhardt
630b5d2c1f
add kwargs to mock_completion
Allows replacing `completion` with `mock_completion` without encountering errors.
2023-09-14 10:27:19 +01:00
Krrish Dholakia
aaa57abddd map finish reason 2023-09-13 19:22:38 -07:00
Krrish Dholakia
5b6b9a9fab huggingface conversational task support 2023-09-13 13:45:23 -07:00
ishaan-jaff
e3fa1d686e remove verify_access_key from main 2023-09-12 11:50:30 -07:00
Ishaan Jaff
60e3e42fba
Merge branch 'main' into main 2023-09-12 11:43:03 -07:00
Krrish Dholakia
baa69734b0 raise better exception if llm provider isn't passed in or inferred 2023-09-12 11:28:50 -07:00
ishaan-jaff
0ffcf51445 fix azure logging 2023-09-12 10:35:47 -07:00
ishaan-jaff
0f89636b47 use api_version for azure completion call 2023-09-12 10:35:24 -07:00
William Espegren
261db15bcf
util: verify_access_key
Verify that the user provided a valid openai token by creating a request to the openAI endpoint.
2023-09-12 18:48:23 +02:00
Ishaan Jaff
fdddd00bfd
Merge pull request #330 from Taik/main
Add support for overriding API type for Azure calls
2023-09-11 17:04:25 -07:00
Krrish Dholakia
cc1313492b code cleanup 2023-09-11 16:32:17 -07:00
Krrish Dholakia
cbc7e6dbc2 mock responses for streaming 2023-09-11 16:30:29 -07:00
Thinh Nguyen
8801f71a52
Add support for overriding API type for Azure calls 2023-09-11 16:28:00 -07:00
Krrish Dholakia
6da500c6e0 add mock request to docs 2023-09-11 12:19:13 -07:00
ishaan-jaff
1ef80c9a2a begin using litellm.api_key 2023-09-11 07:32:20 -07:00