Commit graph

516 commits

Author SHA1 Message Date
ishaan-jaff
9c711cf285 (feat) create a usage class in ModelResponse, use it for anthropic 2023-10-27 09:32:10 -07:00
ishaan-jaff
2e5bf1eff2 (fix) trim_messages util docstring 2023-10-27 08:35:48 -07:00
Krrish Dholakia
dfb19c09a6 fix(utils.py): adding bedrock to validate_environment() 2023-10-26 18:14:28 -07:00
Krrish Dholakia
985fed8902 build(litellm_server/main.py): fix keys in environment 2023-10-26 16:54:15 -07:00
Krrish Dholakia
715ea54544 fix(utils.py): adding support for anyscale models 2023-10-25 09:08:10 -07:00
Krish Dholakia
b7200cf1f1 Merge pull request #647 from nirga/traceloop-bug
fix: bugs in traceloop integration
2023-10-24 17:38:30 -07:00
ishaan-jaff
ec98642667 (fix) utils.token trimming ensure new length always greater than 0 2023-10-24 16:03:11 -07:00
ishaan-jaff
2dfb3bd28f (fix) utils.token trimming, hanging for large messages 2023-10-24 16:03:11 -07:00
Krrish Dholakia
558d2582b5 fix(utils.py): allow url to be passed to model cost map 2023-10-24 15:38:05 -07:00
Krrish Dholakia
9e0897bc26 refactor(test_async_fn.py): refactor for testing 2023-10-24 12:46:30 -07:00
Krrish Dholakia
98c25b08cd fix(vertex_ai.py): fix output parsing 2023-10-24 12:08:22 -07:00
Krrish Dholakia
c7e8bf3e80 test(test_router.py): fixing router testing 2023-10-24 10:21:10 -07:00
Krrish Dholakia
8fa6027d1c fix(openai-proxy/utils.py): adding caching 2023-10-23 17:01:03 -07:00
ishaan-jaff
02a20218ab (fix) get_llm_provider 2023-10-20 15:00:21 -07:00
ishaan-jaff
94f3b973b3 (feat) native perplexity support 2023-10-20 14:29:07 -07:00
Krrish Dholakia
dcf431dbbe feat(main.py): support multiple deployments in 1 completion call 2023-10-20 13:01:53 -07:00
Krrish Dholakia
2fa22dc91e feat(utils.py): adding encode and decode functions 2023-10-20 11:59:47 -07:00
Krrish Dholakia
6e7dd8d64f docs(token_usage.md): adding new register model function 2023-10-19 18:33:53 -07:00
Krrish Dholakia
f10a4ce16b feat(utils.py): add register model helper function 2023-10-19 18:26:36 -07:00
ishaan-jaff
57a7c5e659 (feat) failure handler - log exceptions when incorrect model passed and result=None 2023-10-19 09:11:58 -07:00
ishaan-jaff
de3005ee9e (fix) allow using more than 1 custom callback 2023-10-19 09:11:58 -07:00
Nir Gazit
9e9855d814 fix: bugs in traceloop integration 2023-10-19 17:23:51 +02:00
ishaan-jaff
23cfc009e0 (feat) add langsmith logger to litellm 2023-10-18 11:39:37 -07:00
ishaan-jaff
e8146b16a4 (fix) update docstring for get_max_tokens 2023-10-18 09:16:34 -07:00
ishaan-jaff
c67895315d (feat) weights & biases logger 2023-10-17 18:01:53 -07:00
Krrish Dholakia
eb05b093ad fix(utils.py): mapping azure api version missing exception 2023-10-17 17:12:51 -07:00
Krrish Dholakia
44cafb5bac docs(proxy_server.md): update proxy server docs to include multi-agent autogen tutorial 2023-10-17 09:22:34 -07:00
Krrish Dholakia
f221eac41a fix(proxy_server): improve error handling 2023-10-16 19:42:53 -07:00
Zeeland
7b1d55d110 fix: llm_provider add openai finetune compatibility 2023-10-16 18:44:45 +08:00
ishaan-jaff
c0f7c7a001 (feat) new function_to_dict litellm.util 2023-10-14 18:26:15 -07:00
ishaan-jaff
2cdf0439d1 (fix) handle deepinfra/mistral temp for mistral 2023-10-14 16:47:25 -07:00
Krrish Dholakia
5f9dd0b21f bump: version 0.8.4 → 0.8.5 2023-10-14 16:43:06 -07:00
ishaan-jaff
60f2b32205 (feat) add doc string for litellm.utils 2023-10-14 16:12:21 -07:00
Krrish Dholakia
5269d0bd5f docs(custom_callback.md): add details on what kwargs are passed to custom callbacks 2023-10-14 11:29:26 -07:00
Krrish Dholakia
fa0ff12570 fix(utils.py): read env variables for known openai-compatible api's (e.g. perplexity), dynamically from th eenvironment 2023-10-13 22:43:32 -07:00
Krrish Dholakia
ec5e7aa4a9 fix(openai.p): adding support for exception mapping for openai-compatible apis via http calls 2023-10-13 21:56:51 -07:00
Krrish Dholakia
d60518fccf refactor(utils.py): clean up print statement 2023-10-13 15:33:12 -07:00
ishaan-jaff
c486bcad91 (fix) ensure stop is always a list for anthropic 2023-10-12 21:25:18 -07:00
Krrish Dholakia
d0b4dfd26c feat(proxy_server): adds create-proxy feature 2023-10-12 18:27:07 -07:00
ishaan-jaff
e77fc7e10d (feat) bedrock add finish_reason to streaming responses 2023-10-12 16:22:34 -07:00
ishaan-jaff
a021637e6e (feat) add Rate Limit Error for bedrock 2023-10-12 15:57:34 -07:00
ishaan-jaff
797892b679 (fix) add bedrock exception mapping for Auth 2023-10-12 15:38:09 -07:00
ishaan-jaff
0eeed31652 (feat) add ollama exception mapping 2023-10-11 17:00:39 -07:00
Krrish Dholakia
382dd0a13d fix(utils): remove ui to view error message 2023-10-11 16:01:57 -07:00
Krrish Dholakia
dac3a57095 fix(utils): don't wait for thread to complete to return response 2023-10-11 14:23:55 -07:00
ishaan-jaff
5c92b9c4c1 (feat) upgrade supabase callback + support logging streaming on supabase 2023-10-11 12:34:10 -07:00
Krrish Dholakia
87e5f79924 fix(proxy_cli-and-utils.py): fixing how config file is read + infering llm_provider for known openai endpoints 2023-10-10 20:53:02 -07:00
Krrish Dholakia
cc0e4f4f9f fix: fix value error if model returns empty completion 2023-10-10 10:11:40 -07:00
ishaan-jaff
a214a0f328 (fix) remove print from supabaseClient 2023-10-10 09:59:38 -07:00
ishaan-jaff
303d27923e (fix) identify users in logging 2023-10-10 09:56:16 -07:00