Commit graph

1266 commits

Author SHA1 Message Date
Krrish Dholakia
411ba6a827 adding anthropic llm class - handles sync + stream 2023-08-12 16:34:32 -07:00
ishaan-jaff
be44a9b6b6 ollama with streaming 2023-08-12 14:49:50 -07:00
Krrish Dholakia
8052b86de8 coverage for custom api scenario in load testing 2023-08-11 18:20:24 -07:00
Krrish Dholakia
386536ce88 add model load testing functionality 2023-08-11 17:59:51 -07:00
ishaan-jaff
ad56d3d032 add config 2023-08-11 10:18:13 -07:00
Krrish Dholakia
0dc9c2a4c3 update 2023-08-11 09:51:14 -07:00
Krrish Dholakia
7fac7111f8 update version 2023-08-10 19:20:28 -07:00
Krrish Dholakia
7908e43645 allowing dynamic api base to be set for openai 2023-08-10 18:40:35 -07:00
ishaan-jaff
6224589611 add vertex AI 2023-08-10 18:37:25 -07:00
Krrish Dholakia
c2ecdf657f allow custom base to openai 2023-08-10 18:01:52 -07:00
Krrish Dholakia
91170fddcf code cleanup 2023-08-10 17:57:57 -07:00
Krrish Dholakia
6594bd8477 logging improvements 2023-08-10 17:40:17 -07:00
ishaan-jaff
8f38f61b76 add caching with chromDB - not a dependency 2023-08-10 13:21:06 -07:00
ishaan-jaff
ea34a26a65 add streaming for together-ai 2023-08-09 17:58:54 -07:00
ishaan-jaff
52848e78c6 add together-ai 2023-08-09 15:22:34 -07:00
ishaan-jaff
ab4fd34b01 fix OR test 2023-08-09 14:07:46 -07:00
Krish Dholakia
c4930f2ed5 Merge branch 'main' into main 2023-08-09 11:00:40 -07:00
ishaan-jaff
f4048886ab streaming replicate tests 2023-08-08 17:50:36 -07:00
ishaan-jaff
613df8942f add cohere streaming 2023-08-08 17:01:59 -07:00
ishaan-jaff
5040d08f79 fix anthropic streaming 2023-08-08 16:07:53 -07:00
ishaan-jaff
36a6ac9b08 streaming for anthropic 2023-08-08 15:57:24 -07:00
ishaan-jaff
a94dc9369f fix model response 2023-08-08 13:58:58 -07:00
ishaan-jaff
5c17f90173 add hf support 2023-08-08 13:35:37 -07:00
ishaan-jaff
3332cc2065 remove deps datalib, pytest, tenacity, infisical 2023-08-08 10:58:43 -07:00
ishaan-jaff
8e863120fe add import for co, anth 2023-08-08 10:46:20 -07:00
ishaan-jaff
03a43e158a add import manager - make package lighter 2023-08-08 10:37:41 -07:00
Zakhar Kogan
0a2ad8cea6 Added Openrouter support back 2023-08-08 08:22:03 +03:00
Krrish Dholakia
2bee550a69 fixing claude exception-mapping + set key bug 2023-08-07 12:07:33 -07:00
Krrish Dholakia
46fe03120e code cleanup 2023-08-07 10:44:04 -07:00
Krrish Dholakia
9a3211e5bf fixing azure bug 2023-08-05 22:39:00 -07:00
Krrish Dholakia
1761b6ca0d pass in org id 2023-08-05 22:13:36 -07:00
Krrish Dholakia
8c5118cae6 expose api_version 2023-08-05 21:57:12 -07:00
ishaan-jaff
55ca23456a with infisical managing keys 2023-08-05 12:52:35 -07:00
Krrish Dholakia
595bf7ab1d version '0.1.341' returns usage across providers 2023-08-05 12:20:23 -07:00
Krrish Dholakia
e7c31d7b25 fixing exception mapping 2023-08-05 09:53:48 -07:00
ishaan-jaff
cf451c970f 238 2023-08-05 09:50:16 -07:00
ishaan-jaff
470296ccf2 use build 2023-08-05 09:43:21 -07:00
ishaan-jaff
5c0c4a8193 latest v 2023-08-05 09:15:38 -07:00
Krrish Dholakia
55e670dca2 add community resources 2023-08-03 16:31:01 -07:00
Krrish Dholakia
b5408b08e5 allowing user to set model keys dynamically 2023-08-03 15:05:29 -07:00
Krrish Dholakia
401cc213e2 fixed acompletion import bug 2023-08-03 14:06:32 -07:00
Krrish Dholakia
66a33efd69 fixing acompletion 2023-08-03 13:53:38 -07:00
Krrish Dholakia
6922407238 accept deployment id 2023-08-03 12:03:34 -07:00
Krrish Dholakia
f222ea31f7 adding an async completion function 2023-08-03 11:55:03 -07:00
Krrish Dholakia
7912882d99 adding tenacity retries 2023-08-03 10:06:31 -07:00
Krrish Dholakia
e676bfdbed make default max tokens a controllable param 2023-08-02 19:59:25 -07:00
Krrish Dholakia
9464e2b214 support proxy openai urls 2023-08-02 19:50:08 -07:00
Krrish Dholakia
bd8f840139 pass in api key via params 2023-08-02 15:15:33 -07:00
Krrish Dholakia
11f9950f1e adding telemetry to litellm 2023-08-02 12:34:49 -07:00
Krrish Dholakia
1ff7377ffa updating helper functions with a try-except 2023-08-01 13:03:03 -07:00