Commit graph

2657 commits

Author SHA1 Message Date
Krrish Dholakia
0ee9c61090 build(litellm_server): add support for global settings 2023-10-27 16:24:54 -07:00
Krrish Dholakia
e54f5d801e bump: version 0.12.5 → 0.12.6 2023-10-27 16:00:42 -07:00
Krrish Dholakia
afe14c8a96 fix(utils.py/completion_with_fallbacks): accept azure deployment name in rotations 2023-10-27 16:00:42 -07:00
Krish Dholakia
ab3b067754
Update README.md 2023-10-27 13:48:16 -07:00
Krish Dholakia
c9a78e866a
Update README.md 2023-10-27 12:31:06 -07:00
Krrish Dholakia
d011a4b5ea build(litellm_server/main.py): fix config loading 2023-10-27 11:42:58 -07:00
ishaan-jaff
05795551f2 (test) comment out traceloop test 2023-10-27 11:27:44 -07:00
Krish Dholakia
de29df1c7f
Update README.md 2023-10-27 11:07:16 -07:00
Krish Dholakia
e9eafd96f0
Update README.md 2023-10-27 11:02:47 -07:00
Krish Dholakia
c6f00398ee
Update README.md 2023-10-27 11:00:12 -07:00
Krrish Dholakia
cd9b671cfe build(litellm_server/main.py): accept config file in /chat/completions 2023-10-27 10:46:32 -07:00
ishaan-jaff
dca28667fa (fix) make /v1/models get 2023-10-27 10:42:30 -07:00
ishaan-jaff
35ffde257d (test) fix traceloop sdk version 2023-10-27 10:25:43 -07:00
ishaan-jaff
6515eef382 (fix) bedrock region name defaults to None 2023-10-27 10:17:45 -07:00
ishaan-jaff
1eb720e447 (test) traceloop logging fixes 2023-10-27 10:12:58 -07:00
ishaan-jaff
925d5caee4 (temp) comment out test traceloop until it's fixed 2023-10-27 10:07:29 -07:00
ishaan-jaff
63928fa166 (feat) use usage class for model responses for cohere, hf, tg ai, cohere 2023-10-27 09:58:47 -07:00
ishaan-jaff
194f85e92f (feat) add model_response.usage.completion_tokens for bedrock, palm, petals, sagemaker 2023-10-27 09:51:50 -07:00
ishaan-jaff
97d237a896 (fix) ci/cd traceloop-sdk 2023-10-27 09:49:37 -07:00
Krish Dholakia
b50300ab7e
Update README.md 2023-10-27 09:45:34 -07:00
ishaan-jaff
8e36f667e5 (test) vertex ai use usage class 2023-10-27 09:39:55 -07:00
ishaan-jaff
dcdbd02a67 (fix) remove errant print statement 2023-10-27 09:38:53 -07:00
ishaan-jaff
3691dc9b08 (feat) use usage class for vertex ai 2023-10-27 09:38:37 -07:00
ishaan-jaff
692bb3f4e9 (test) usage class for anthropic 2023-10-27 09:33:21 -07:00
ishaan-jaff
ea3823fc19 (test) usage for anthropic 2023-10-27 09:33:01 -07:00
ishaan-jaff
0a2de59932 (feat) use usage class for anthropic 2023-10-27 09:32:25 -07:00
ishaan-jaff
962e75eb70 (feat) create a usage class in ModelResponse, use it for anthropic 2023-10-27 09:32:10 -07:00
ishaan-jaff
1aa53f6322 (fix) trim_messages util docstring 2023-10-27 08:35:48 -07:00
ishaan-jaff
895cb5d0f9 (docs) add LiteLLM Server - deploy liteLLM 2023-10-26 20:18:51 -07:00
ishaan-jaff
7f90f400c3 (docs) add 1 click deploy to index.md 2023-10-26 20:12:29 -07:00
ishaan-jaff
13ff7cd429 (docs) add deploy button to index.md 2023-10-26 20:10:58 -07:00
Krrish Dholakia
182f6f701c docs(cookbook): updating NeMO Guardrails tutorials 2023-10-26 18:25:32 -07:00
Krrish Dholakia
e5a4059356 docs(cookbook): using NeMO-Guardrails w/ Bedrock/TogetherAI/etc. via LiteLLM Server 2023-10-26 18:17:04 -07:00
Krrish Dholakia
6ef5bca042 fix(utils.py): adding bedrock to validate_environment() 2023-10-26 18:14:28 -07:00
Krrish Dholakia
7d6d6ec582 build(litellm_server/main.py): removing print statements 2023-10-26 18:07:43 -07:00
Krrish Dholakia
b0e6034380 build(litellm_server/main.py): additional logging information 2023-10-26 18:04:23 -07:00
Krrish Dholakia
5005e9c5ae build(litellm_server/main.py): adding logging 2023-10-26 17:55:16 -07:00
Krrish Dholakia
bdb46f60e8 build(litellm_server/main.py): add logging for data going into litellm pypi 2023-10-26 17:51:13 -07:00
Krish Dholakia
b826a31f0f Updated config.yml 2023-10-26 17:44:24 -07:00
Krrish Dholakia
ffa036566b build(litellm_server/main.py): fix keys in environment 2023-10-26 16:54:15 -07:00
Krish Dholakia
89c94cf14f
Update README.md 2023-10-26 16:22:41 -07:00
Krish Dholakia
5230a683e0
Update README.md 2023-10-26 16:22:12 -07:00
Krish Dholakia
c6c6d4396a
Update README.md 2023-10-26 16:16:19 -07:00
Krish Dholakia
04b0d5704a
Update README.md 2023-10-26 16:15:43 -07:00
ishaan-jaff
3563ae81a8 (docs) improve async + streaming completion 2023-10-26 12:10:37 -07:00
Krrish Dholakia
8d2a4a597a doc cleanup 2023-10-26 11:33:40 -07:00
ishaan-jaff
fd515f2a07 (fix) loggers langfuse - print import exception 2023-10-26 09:38:30 -07:00
Ishaan Jaff
3e2e1c9efe
Update README.md 2023-10-25 19:07:28 -07:00
ishaan-jaff
758628a621 (docs) litellm server deploy aws 2023-10-25 19:05:53 -07:00
ishaan-jaff
63fc276a2b (docs) litellm server deploy on aws 2023-10-25 19:04:37 -07:00