phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 03:34:10 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

add additional param mapping

Browse source
This commit is contained in:
Krrish Dholakia 2023-10-03 21:56:00 -07:00
parent b5fc04c315
commit 95899bf60e
6 changed files with 47 additions and 26 deletions
Download patch file Download diff file Expand all files Collapse all files

36
docs/my-website/docs/completion/input.md
View file

@ -62,20 +62,22 @@ E.g. If Anthropic supports top_k, then `completion(model="claude-2", .., top_k=3
This list is constantly being updated.
| Provider | functions | function_call | temperature | top_p | n | stream | stop | max_tokens | presence_penalty | frequency_penalty | logit_bias | user |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|Anthropic| | | ✅ | ✅ | | ✅ | ✅ | ✅ | | |
|OpenAI| ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
|Replicate| | | ✅ | ✅ | ✅ | ✅ | ✅ | ✅| | |
|Cohere| | | ✅ | ✅ | | ✅ | | ✅| | | ✅ |
|Huggingface| | | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | | | |
|Openrouter| ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
|AI21| | | | | | | | | | | |
|VertexAI| | | ✅ | ✅ | | ✅ | | ✅ | | | |
|Bedrock| | | ✅ | ✅ | | ✅ | ✅ | ✅ | | | |
|Sagemaker| | | ✅ | | | ✅ | | ✅ | | | |
|TogetherAI| | | ✅ | ✅ | | ✅ | ✅ | ✅ | | ✅ | |
|AlephAlpha| | | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | | |
|Palm| | | ✅ | ✅ | | ✅ | | | | | |
|NLP Cloud| | | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | | |
|Petals| | | ✅ | ✅ | | | | ✅ | | |
| Provider | temperature | top_p | n | stream | stop | max_tokens | presence_penalty | frequency_penalty | functions | function_call |
|---|---|---|---|---|---|---|---|---|---|---|
|Anthropic| ✅ | ✅ | | ✅ | ✅ | ✅ | | | | |
|OpenAI| ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
|Replicate | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | | | | |
|Cohere| ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | | |
|Huggingface| ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | | | |
|Openrouter| ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
|AI21| ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | | |
|VertexAI| ✅ | ✅ | | ✅ | | ✅ | | | | |
|Bedrock| ✅ | ✅ | | ✅ | ✅ | ✅ | | | | |
|Sagemaker| ✅ | | | ✅ | | ✅ | | | | |
|TogetherAI| ✅ | ✅ | | ✅ | ✅ | ✅ | | | | |
|AlephAlpha| ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | | | | |
|Palm| ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | | | | |
|NLP Cloud| ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | | | | |
|Petals| ✅ | ✅ | | ✅ | ✅ | | | | | |
By default, LiteLLM raises an exception if the param being passed in isn't supported. However, if you want to just drop the param, instead of raising an exception, just set `litellm.drop_params = True`.