Commit graph

593 commits

Author SHA1 Message Date
ishaan-jaff
fb94c7e00d (fix) litellm utils 2023-11-02 17:03:46 -07:00
ishaan-jaff
3c22fbf637 (fix) vertexai detect code_chat and code_text llms as vertex 2023-11-02 16:31:13 -07:00
Krrish Dholakia
33c1118080 feat(completion()): enable setting prompt templates via completion() 2023-11-02 16:24:01 -07:00
ishaan-jaff
5262a3a2f7 (feat) add transform_logprobs for text_completion 2023-11-01 18:25:13 -07:00
ishaan-jaff
51060d1eea (feat) text_completion add transform_logprobs 2023-11-01 18:25:13 -07:00
ishaan-jaff
a0ed669f25 (fix) improve litellm.set_verbose=True logging 2023-11-01 18:25:13 -07:00
ishaan-jaff
f66e9c6bce (feat) detect amazon.titan-embed-text-v1 as bedrock embedding model 2023-11-01 14:46:33 -07:00
Krrish Dholakia
a951f7ff85 fix(utils.py): mapping stop sequences for palm 2023-11-01 14:00:45 -07:00
Krrish Dholakia
2cf06a3235 feat(utils.py): accept context window fallback dictionary 2023-10-31 22:32:36 -07:00
ishaan-jaff
c6229b7113 (feat) add bedrock.cohere streaming 2023-10-31 22:26:43 -07:00
ishaan-jaff
19177ae041 (feat) add support for echo for HF logprobs 2023-10-31 18:20:59 -07:00
ishaan-jaff
d57dc616b8 (feat) text_completion return raw response for davinci003 2023-10-31 15:32:04 -07:00
Krrish Dholakia
147d69f230 feat(main.py): add support for maritalk api 2023-10-30 17:36:51 -07:00
ishaan-jaff
32b6714a8b (docs) completion_with_config 2023-10-30 14:29:40 -07:00
ishaan-jaff
ae376a9835 (docs) encode docstring 2023-10-30 14:10:29 -07:00
ishaan-jaff
fdef63439d (docs) add docstring for validate_environment 2023-10-30 14:06:55 -07:00
ishaan-jaff
94542ae6be def get_valid_models():
(docs) add docstring for
2023-10-30 14:05:09 -07:00
ishaan-jaff
bb5073fcbe (docs) add doc string for check_valid_api_key 2023-10-30 14:02:31 -07:00
ishaan-jaff
0069b09caa (feat) track cost for responses easily 2023-10-28 15:08:35 -07:00
ishaan-jaff
8803116ec6 (feat) set litellm_call_id in fallbacks 2023-10-27 18:09:00 -07:00
ishaan-jaff
ef449f155e (fix) utils - remove bloat - deprecated completion_with_split_tests 2023-10-27 18:04:15 -07:00
ishaan-jaff
8ab127d6a3 (fix) only set litellm call id if it's not set in completion() 2023-10-27 18:02:14 -07:00
ishaan-jaff
a88ed12a9a (fix) remove print statements from completion fallbacks, make them print verbose 2023-10-27 17:54:48 -07:00
ishaan-jaff
effd08f597 (fix) remove bloat - rate limite manager 2023-10-27 17:47:45 -07:00
ishaan-jaff
e1c2b55825 (fix) use sentry dsn instead of sentry API URL 2023-10-27 16:25:02 -07:00
Krrish Dholakia
daa7aed7a4 fix(utils.py/completion_with_fallbacks): accept azure deployment name in rotations 2023-10-27 16:00:42 -07:00
ishaan-jaff
f82f73c55e (fix) remove errant print statement 2023-10-27 09:38:53 -07:00
ishaan-jaff
9c711cf285 (feat) create a usage class in ModelResponse, use it for anthropic 2023-10-27 09:32:10 -07:00
ishaan-jaff
2e5bf1eff2 (fix) trim_messages util docstring 2023-10-27 08:35:48 -07:00
Krrish Dholakia
dfb19c09a6 fix(utils.py): adding bedrock to validate_environment() 2023-10-26 18:14:28 -07:00
Krrish Dholakia
985fed8902 build(litellm_server/main.py): fix keys in environment 2023-10-26 16:54:15 -07:00
Krrish Dholakia
715ea54544 fix(utils.py): adding support for anyscale models 2023-10-25 09:08:10 -07:00
Krish Dholakia
b7200cf1f1 Merge pull request #647 from nirga/traceloop-bug
fix: bugs in traceloop integration
2023-10-24 17:38:30 -07:00
ishaan-jaff
ec98642667 (fix) utils.token trimming ensure new length always greater than 0 2023-10-24 16:03:11 -07:00
ishaan-jaff
2dfb3bd28f (fix) utils.token trimming, hanging for large messages 2023-10-24 16:03:11 -07:00
Krrish Dholakia
558d2582b5 fix(utils.py): allow url to be passed to model cost map 2023-10-24 15:38:05 -07:00
Krrish Dholakia
9e0897bc26 refactor(test_async_fn.py): refactor for testing 2023-10-24 12:46:30 -07:00
Krrish Dholakia
98c25b08cd fix(vertex_ai.py): fix output parsing 2023-10-24 12:08:22 -07:00
Krrish Dholakia
c7e8bf3e80 test(test_router.py): fixing router testing 2023-10-24 10:21:10 -07:00
Krrish Dholakia
8fa6027d1c fix(openai-proxy/utils.py): adding caching 2023-10-23 17:01:03 -07:00
ishaan-jaff
02a20218ab (fix) get_llm_provider 2023-10-20 15:00:21 -07:00
ishaan-jaff
94f3b973b3 (feat) native perplexity support 2023-10-20 14:29:07 -07:00
Krrish Dholakia
dcf431dbbe feat(main.py): support multiple deployments in 1 completion call 2023-10-20 13:01:53 -07:00
Krrish Dholakia
2fa22dc91e feat(utils.py): adding encode and decode functions 2023-10-20 11:59:47 -07:00
Krrish Dholakia
6e7dd8d64f docs(token_usage.md): adding new register model function 2023-10-19 18:33:53 -07:00
Krrish Dholakia
f10a4ce16b feat(utils.py): add register model helper function 2023-10-19 18:26:36 -07:00
ishaan-jaff
57a7c5e659 (feat) failure handler - log exceptions when incorrect model passed and result=None 2023-10-19 09:11:58 -07:00
ishaan-jaff
de3005ee9e (fix) allow using more than 1 custom callback 2023-10-19 09:11:58 -07:00
Nir Gazit
9e9855d814 fix: bugs in traceloop integration 2023-10-19 17:23:51 +02:00
ishaan-jaff
23cfc009e0 (feat) add langsmith logger to litellm 2023-10-18 11:39:37 -07:00