phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

docs

Browse source
This commit is contained in:
ishaan-jaff 2023-09-15 13:37:51 -07:00
parent 929f0dbfaa
commit 634e6d7bdb
1 changed files with 29 additions and 9 deletions
Download patch file Download diff file Expand all files Collapse all files

28
docs/my-website/docs/providers/vertex.md
View file

@ -1,7 +1,7 @@
# Google Palm/VertexAI # VertexAI / Google Palm
LiteLLM supports chat-bison, chat-bison@001, text-bison, text-bison@001 LiteLLM supports chat-bison, chat-bison@001, text-bison, text-bison@001
### Google VertexAI Models ## Google VertexAI Models
Sample notebook for calling VertexAI models: https://github.com/BerriAI/litellm/blob/main/cookbook/liteLLM_VertextAI_Example.ipynb Sample notebook for calling VertexAI models: https://github.com/BerriAI/litellm/blob/main/cookbook/liteLLM_VertextAI_Example.ipynb
All calls using Vertex AI require the following parameters: All calls using Vertex AI require the following parameters:
@ -10,7 +10,7 @@ All calls using Vertex AI require the following parameters:
* Your Project Location * Your Project Location
`litellm.vertex_location` = "us-central1" `litellm.vertex_location` = "us-central1"
### Pre-requisites ## Pre-requisites
`pip install google-cloud-aiplatform` `pip install google-cloud-aiplatform`
Authentication: Authentication:
@ -18,10 +18,30 @@ VertexAI uses Application Default Credentials, see https://cloud.google.com/docs
VertexAI requires you to set `application_default_credentials.json`, this can be set by running `gcloud auth application-default login` in your terminal VertexAI requires you to set `application_default_credentials.json`, this can be set by running `gcloud auth application-default login` in your terminal
## Chat Models
| Model Name | Function Call | | Model Name | Function Call |
|------------------|----------------------------------------------------------| |------------------|--------------------------------------|
| chat-bison-32k | `completion('chat-bison-32k', messages)` |
| chat-bison | `completion('chat-bison', messages)` | | chat-bison | `completion('chat-bison', messages)` |
| chat-bison@001 | `completion('chat-bison@001', messages)` | | chat-bison@001 | `completion('chat-bison@001', messages)` |
## Code Chat Models
| Model Name | Function Call |
|----------------------|--------------------------------------------|
| codechat-bison | `completion('codechat-bison', messages)` |
| codechat-bison-32k | `completion('codechat-bison-32k', messages)` |
| codechat-bison@001 | `completion('codechat-bison@001', messages)` |
## Text Models
| Model Name | Function Call |
|------------------|--------------------------------------|
| text-bison | `completion('text-bison', messages)` | | text-bison | `completion('text-bison', messages)` |
| text-bison@001 | `completion('text-bison@001', messages)` | | text-bison@001 | `completion('text-bison@001', messages)` |
## Code Text Models
| Model Name | Function Call |
|------------------|--------------------------------------|
| code-bison | `completion('code-bison', messages)` |
| code-bison@001 | `completion('code-bison@001', messages)` |
| code-gecko@001 | `completion('code-gecko@001', messages)` |
| code-gecko@latest| `completion('code-gecko@latest', messages)` |