Commit graph

2919 commits

Author SHA1 Message Date
ishaan-jaff
cac320f74e (fix) remove bloat - ratelimitmanager 2023-10-27 18:11:39 -07:00
ishaan-jaff
bf5e8bd0ea (feat) set litellm_call_id in fallbacks 2023-10-27 18:09:00 -07:00
ishaan-jaff
b0970827d3 (fix) utils - remove bloat - deprecated completion_with_split_tests 2023-10-27 18:04:15 -07:00
ishaan-jaff
fe4ef2bd57 (fix) only set litellm call id if it's not set in completion() 2023-10-27 18:02:14 -07:00
ishaan-jaff
e260a9cf2f (fix) remove print statements from completion fallbacks, make them print verbose 2023-10-27 17:54:48 -07:00
ishaan-jaff
ad2afae31d (fix) remove bloat - rate limite manager 2023-10-27 17:47:45 -07:00
ishaan-jaff
bdc96d6390 (docs) improve sentry callback 2023-10-27 16:33:12 -07:00
ishaan-jaff
7508ef958c (test) add sentry callback test 2023-10-27 16:25:02 -07:00
ishaan-jaff
933cc235c3 (test) sentry callback 2023-10-27 16:25:02 -07:00
ishaan-jaff
1d955e7b07 (docs) use sentry DSN to send data 2023-10-27 16:25:02 -07:00
ishaan-jaff
b3776fc0d8 (fix) use sentry dsn instead of sentry API URL 2023-10-27 16:25:02 -07:00
Krrish Dholakia
0ee9c61090 build(litellm_server): add support for global settings 2023-10-27 16:24:54 -07:00
Krrish Dholakia
e54f5d801e bump: version 0.12.5 → 0.12.6 2023-10-27 16:00:42 -07:00
Krrish Dholakia
afe14c8a96 fix(utils.py/completion_with_fallbacks): accept azure deployment name in rotations 2023-10-27 16:00:42 -07:00
Krish Dholakia
ab3b067754
Update README.md 2023-10-27 13:48:16 -07:00
Krish Dholakia
c9a78e866a
Update README.md 2023-10-27 12:31:06 -07:00
Krrish Dholakia
d011a4b5ea build(litellm_server/main.py): fix config loading 2023-10-27 11:42:58 -07:00
ishaan-jaff
05795551f2 (test) comment out traceloop test 2023-10-27 11:27:44 -07:00
Krish Dholakia
de29df1c7f
Update README.md 2023-10-27 11:07:16 -07:00
Krish Dholakia
e9eafd96f0
Update README.md 2023-10-27 11:02:47 -07:00
Krish Dholakia
c6f00398ee
Update README.md 2023-10-27 11:00:12 -07:00
Krrish Dholakia
cd9b671cfe build(litellm_server/main.py): accept config file in /chat/completions 2023-10-27 10:46:32 -07:00
ishaan-jaff
dca28667fa (fix) make /v1/models get 2023-10-27 10:42:30 -07:00
ishaan-jaff
35ffde257d (test) fix traceloop sdk version 2023-10-27 10:25:43 -07:00
ishaan-jaff
6515eef382 (fix) bedrock region name defaults to None 2023-10-27 10:17:45 -07:00
ishaan-jaff
1eb720e447 (test) traceloop logging fixes 2023-10-27 10:12:58 -07:00
ishaan-jaff
925d5caee4 (temp) comment out test traceloop until it's fixed 2023-10-27 10:07:29 -07:00
ishaan-jaff
63928fa166 (feat) use usage class for model responses for cohere, hf, tg ai, cohere 2023-10-27 09:58:47 -07:00
ishaan-jaff
194f85e92f (feat) add model_response.usage.completion_tokens for bedrock, palm, petals, sagemaker 2023-10-27 09:51:50 -07:00
ishaan-jaff
97d237a896 (fix) ci/cd traceloop-sdk 2023-10-27 09:49:37 -07:00
Krish Dholakia
b50300ab7e
Update README.md 2023-10-27 09:45:34 -07:00
ishaan-jaff
8e36f667e5 (test) vertex ai use usage class 2023-10-27 09:39:55 -07:00
ishaan-jaff
dcdbd02a67 (fix) remove errant print statement 2023-10-27 09:38:53 -07:00
ishaan-jaff
3691dc9b08 (feat) use usage class for vertex ai 2023-10-27 09:38:37 -07:00
ishaan-jaff
692bb3f4e9 (test) usage class for anthropic 2023-10-27 09:33:21 -07:00
ishaan-jaff
ea3823fc19 (test) usage for anthropic 2023-10-27 09:33:01 -07:00
ishaan-jaff
0a2de59932 (feat) use usage class for anthropic 2023-10-27 09:32:25 -07:00
ishaan-jaff
962e75eb70 (feat) create a usage class in ModelResponse, use it for anthropic 2023-10-27 09:32:10 -07:00
ishaan-jaff
1aa53f6322 (fix) trim_messages util docstring 2023-10-27 08:35:48 -07:00
mc-marcocheng
f43d59fff8 avoid overwriting litellm_params 2023-10-27 15:30:34 +08:00
ishaan-jaff
895cb5d0f9 (docs) add LiteLLM Server - deploy liteLLM 2023-10-26 20:18:51 -07:00
ishaan-jaff
7f90f400c3 (docs) add 1 click deploy to index.md 2023-10-26 20:12:29 -07:00
ishaan-jaff
13ff7cd429 (docs) add deploy button to index.md 2023-10-26 20:10:58 -07:00
Krrish Dholakia
182f6f701c docs(cookbook): updating NeMO Guardrails tutorials 2023-10-26 18:25:32 -07:00
Krrish Dholakia
e5a4059356 docs(cookbook): using NeMO-Guardrails w/ Bedrock/TogetherAI/etc. via LiteLLM Server 2023-10-26 18:17:04 -07:00
Krrish Dholakia
6ef5bca042 fix(utils.py): adding bedrock to validate_environment() 2023-10-26 18:14:28 -07:00
Krrish Dholakia
7d6d6ec582 build(litellm_server/main.py): removing print statements 2023-10-26 18:07:43 -07:00
Krrish Dholakia
b0e6034380 build(litellm_server/main.py): additional logging information 2023-10-26 18:04:23 -07:00
Krrish Dholakia
5005e9c5ae build(litellm_server/main.py): adding logging 2023-10-26 17:55:16 -07:00
Krrish Dholakia
bdb46f60e8 build(litellm_server/main.py): add logging for data going into litellm pypi 2023-10-26 17:51:13 -07:00