forked from phoenix/litellm-mirror
(docs) check if supports function calling
This commit is contained in:
parent
a26ebc4f72
commit
f07ed2bee3
1 changed files with 18 additions and 11 deletions
|
@ -1,18 +1,25 @@
|
||||||
# Function Calling
|
# Function Calling
|
||||||
Function calling is supported with the following models on OpenAI, Azure OpenAI
|
|
||||||
|
|
||||||
- gpt-4
|
## Checking if a model supports function calling
|
||||||
- gpt-4-1106-preview
|
|
||||||
- gpt-4-0613
|
|
||||||
- gpt-3.5-turbo
|
|
||||||
- gpt-3.5-turbo-1106
|
|
||||||
- gpt-3.5-turbo-0613
|
|
||||||
- Non OpenAI LLMs (litellm adds the function call to the prompt for these llms)
|
|
||||||
|
|
||||||
In addition, parallel function calls is supported on the following models:
|
Use `litellm.supports_function_calling(model="")` -> returns `True` if model supports Function calling, `False` if not
|
||||||
- gpt-4-1106-preview
|
|
||||||
- gpt-3.5-turbo-1106
|
|
||||||
|
|
||||||
|
```python
|
||||||
|
assert litellm.supports_function_calling(model="gpt-3.5-turbo") == True
|
||||||
|
assert litellm.supports_function_calling(model="azure/gpt-4-1106-preview") == True
|
||||||
|
assert litellm.supports_function_calling(model="palm/chat-bison") == False
|
||||||
|
assert litellm.supports_function_calling(model="ollama/llama2") == False
|
||||||
|
```
|
||||||
|
|
||||||
|
|
||||||
|
## Checking if a model supports parallel function calling
|
||||||
|
|
||||||
|
Use `litellm.supports_parallel_function_calling(model="")` -> returns `True` if model supports parallel function calling, `False` if not
|
||||||
|
|
||||||
|
```python
|
||||||
|
assert litellm.supports_parallel_function_calling(model="gpt-4-turbo-preview") == True
|
||||||
|
assert litellm.supports_parallel_function_calling(model="gpt-4") == False
|
||||||
|
```
|
||||||
## Parallel Function calling
|
## Parallel Function calling
|
||||||
Parallel function calling is the model's ability to perform multiple function calls together, allowing the effects and results of these function calls to be resolved in parallel
|
Parallel function calling is the model's ability to perform multiple function calls together, allowing the effects and results of these function calls to be resolved in parallel
|
||||||
|
|
||||||
|
|
Loading…
Add table
Add a link
Reference in a new issue