phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

docs

Browse source
This commit is contained in:
ishaan-jaff 2023-09-15 13:37:51 -07:00
parent 929f0dbfaa
commit 634e6d7bdb
1 changed files with 29 additions and 9 deletions
Download patch file Download diff file Expand all files Collapse all files

38
docs/my-website/docs/providers/vertex.md
View file

@ -1,7 +1,7 @@
# Google Palm/VertexAI
# VertexAI / Google Palm
LiteLLM supports chat-bison, chat-bison@001, text-bison, text-bison@001
### Google VertexAI Models
## Google VertexAI Models
Sample notebook for calling VertexAI models: https://github.com/BerriAI/litellm/blob/main/cookbook/liteLLM_VertextAI_Example.ipynb
All calls using Vertex AI require the following parameters:
@ -10,7 +10,7 @@ All calls using Vertex AI require the following parameters:
* Your Project Location
`litellm.vertex_location` = "us-central1"
### Pre-requisites
## Pre-requisites
`pip install google-cloud-aiplatform`
Authentication:
@ -18,10 +18,30 @@ VertexAI uses Application Default Credentials, see https://cloud.google.com/docs
VertexAI requires you to set `application_default_credentials.json`, this can be set by running `gcloud auth application-default login` in your terminal
| Model Name | Function Call |
|------------------|----------------------------------------------------------|
| chat-bison | `completion('chat-bison', messages)` |
| chat-bison@001 | `completion('chat-bison@001', messages)` |
| text-bison | `completion('text-bison', messages)` |
| text-bison@001 | `completion('text-bison@001', messages)` |
## Chat Models
| Model Name | Function Call |
|------------------|--------------------------------------|
| chat-bison-32k | `completion('chat-bison-32k', messages)` |
| chat-bison | `completion('chat-bison', messages)` |
| chat-bison@001 | `completion('chat-bison@001', messages)` |
## Code Chat Models
| Model Name | Function Call |
|----------------------|--------------------------------------------|
| codechat-bison | `completion('codechat-bison', messages)` |
| codechat-bison-32k | `completion('codechat-bison-32k', messages)` |
| codechat-bison@001 | `completion('codechat-bison@001', messages)` |
## Text Models
| Model Name | Function Call |
|------------------|--------------------------------------|
| text-bison | `completion('text-bison', messages)` |
| text-bison@001 | `completion('text-bison@001', messages)` |
## Code Text Models
| Model Name | Function Call |
|------------------|--------------------------------------|
| code-bison | `completion('code-bison', messages)` |
| code-bison@001 | `completion('code-bison@001', messages)` |
| code-gecko@001 | `completion('code-gecko@001', messages)` |
| code-gecko@latest| `completion('code-gecko@latest', messages)` |