Commit graph

203 commits

Author SHA1 Message Date
ishaan-jaff
32a3b98c0a hot fix litellm import 2023-08-17 11:39:28 -07:00
ishaan-jaff
489a31adb7 use importlib_metadata 2023-08-17 11:18:43 -07:00
ishaan-jaff
6e540fee7f create model response object 2023-08-17 11:13:01 -07:00
ishaan-jaff
8b245278b2 fixes to caching, testing caching 2023-08-17 10:41:14 -07:00
ishaan-jaff
afc26df28f fix tg ai streaming 2023-08-16 21:53:39 -07:00
Krrish Dholakia
acbb611e89 adding exact match caching 2023-08-16 21:44:52 -07:00
ishaan-jaff
952e994ad1 fixed get_secret 2023-08-14 17:34:28 -07:00
ishaan-jaff
f5b6c04de4 allow setting litellm.api_key 2023-08-14 17:17:20 -07:00
Krrish Dholakia
6aff47083b adding support for meta-llama-2 2023-08-14 14:35:21 -07:00
ishaan-jaff
1b4aadbb25 with text-bison 2023-08-14 10:34:01 -07:00
Krish Dholakia
887350d082
Merge branch 'main' into multi-class-krrish 2023-08-12 17:47:37 -07:00
Krrish Dholakia
72c1b5dcfc replacing individual provider flags with 'custom_llm_provider' 2023-08-12 16:40:36 -07:00
Krrish Dholakia
bc767cc42a adding anthropic llm class - handles sync + stream 2023-08-12 16:34:32 -07:00
ishaan-jaff
406290b9e4 fix yield + version number 2023-08-12 15:05:11 -07:00
ishaan-jaff
9d644a5634 ollama with streaming 2023-08-12 14:49:50 -07:00
Krrish Dholakia
80d77fed71 coverage for custom api scenario in load testing 2023-08-11 18:20:24 -07:00
Krrish Dholakia
211e1edfcb add model load testing functionality 2023-08-11 17:59:51 -07:00
ishaan-jaff
27cc3760b7 add config 2023-08-11 10:18:13 -07:00
ishaan-jaff
b0a60e5c91 add vertex AI 2023-08-10 18:37:25 -07:00
Krrish Dholakia
85753c0d18 code cleanup 2023-08-10 17:57:57 -07:00
ishaan-jaff
a1b64832a7 with caching 2023-08-10 15:14:58 -07:00
ishaan-jaff
5c92a597e5 debug cache circle ci 2023-08-10 15:03:33 -07:00
ishaan-jaff
f6279353ac fix failing tests 2023-08-10 13:27:59 -07:00
ishaan-jaff
d80f847fde add caching with chromDB - not a dependency 2023-08-10 13:21:06 -07:00
Krrish Dholakia
09fcd88799 updating crash monitoring 2023-08-10 11:13:30 -07:00
Krrish Dholakia
0fc4d9e29c clean up print statements 2023-08-09 19:49:27 -07:00
Krrish Dholakia
654e413500 update 2023-08-09 18:03:22 -07:00
ishaan-jaff
3c3d144584 add streaming for together-ai 2023-08-09 17:58:54 -07:00
ishaan-jaff
23fc936b65 add together-ai 2023-08-09 15:22:34 -07:00
Krrish Dholakia
6ec91227cd fix install error 2023-08-09 14:15:19 -07:00
ishaan-jaff
c83ccb66ca fix streaming format 2023-08-09 13:41:11 -07:00
Krrish Dholakia
a9186dc40c add token usage 2023-08-08 21:11:06 -07:00
Krrish Dholakia
39efc57d84 add helper functions for token usage calculation 2023-08-08 20:47:02 -07:00
ishaan-jaff
d66bda43d3 streaming replicate tests 2023-08-08 17:50:36 -07:00
ishaan-jaff
a166af50d0 add cohere streaming 2023-08-08 17:01:59 -07:00
ishaan-jaff
6ea264d561 streaming for anthropic 2023-08-08 15:57:24 -07:00
ishaan-jaff
b6f601bb86 add import manager - make package lighter 2023-08-08 10:37:41 -07:00
ishaan-jaff
42c5c23d95 fix pydantic import 2023-08-07 21:16:18 -07:00
Krrish Dholakia
dd6b4db090 fixing claude exception-mapping + set key bug 2023-08-07 12:07:33 -07:00
Krrish Dholakia
c8884e21e7 fixing azure bug 2023-08-05 22:39:00 -07:00
Krrish Dholakia
75057c72d2 adding support for supabase integration 2023-08-05 19:57:33 -07:00
Krrish Dholakia
a0ae1d6a18 adding berrispend integration 2023-08-05 16:12:10 -07:00
ishaan-jaff
2ecd132a94 with infisical managing keys 2023-08-05 12:52:35 -07:00
Krrish Dholakia
7575d7ea47 version '0.1.341' returns usage across providers 2023-08-05 12:20:23 -07:00
Krrish Dholakia
92a13958ce fixing exception mapping 2023-08-05 09:53:48 -07:00
Krrish Dholakia
10832be1e4 updating build to include helicone integration 2023-08-03 08:36:25 -07:00
Krrish Dholakia
e5ef18b467 updates 2023-08-03 06:57:30 -07:00
Krrish Dholakia
aa598d506f adding helicone integration 2023-08-02 22:25:11 -07:00
Krrish Dholakia
85f1591413 bug fixes and updates 2023-08-02 13:27:13 -07:00
Krrish Dholakia
03ac0277d1 adding telemetry to litellm 2023-08-02 12:34:49 -07:00