phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

docs(input.md): updating litellm-specific params for completion

Browse source
This commit is contained in:
Krrish Dholakia 2023-10-28 19:17:07 -07:00
parent 585f7b0434
commit ffd80ca850
1 changed files with 3 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

3
docs/my-website/docs/completion/input.md
View file

@ -85,6 +85,7 @@ def completion(
api_version: Optional[str] = None,
api_key: Optional[str] = None,
fallbacks: Optional[list] = None, # pass in a list of api_base,keys, etc.
metadata: Optional[dict] = None # additional call metadata, passed to logging integrations / custom callbacks
**kwargs,
) -> ModelResponse:
@ -148,6 +149,8 @@ def completion(
- `fallbacks`: *list (optional)* - A list of model names + params to be used, in case the initial call fails
- `metadata`: *dict (optional)* - Any additional data you want to be logged when the call is made (sent to logging integrations, eg. promptlayer and accessible via custom callback function)
## Provider-specific Params
Providers might offer params not supported by OpenAI (e.g. top_k). You can pass those in 2 ways:
- via completion(): We'll pass the non-openai param, straight to the provider as part of the request body.