phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

vertex docs

Browse source
This commit is contained in:
ishaan-jaff 2023-09-15 13:46:50 -07:00
parent 5a9e60861f
commit 09fd39d80f
1 changed files with 14 additions and 7 deletions
Download patch file Download diff file Expand all files Collapse all files

21
docs/my-website/docs/providers/vertex.md
View file

@ -1,22 +1,29 @@
# VertexAI / Google Palm # VertexAI / Google Palm
LiteLLM supports chat-bison, chat-bison@001, text-bison, text-bison@001
## Google VertexAI Models ## Google VertexAI Models
Sample notebook for calling VertexAI models: https://github.com/BerriAI/litellm/blob/main/cookbook/liteLLM_VertextAI_Example.ipynb Sample notebook for calling VertexAI models: https://github.com/BerriAI/litellm/blob/main/cookbook/liteLLM_VertextAI_Example.ipynb
## Pre-requisites
* `pip install google-cloud-aiplatform`
* Authentication:
* run `gcloud auth application-default login` See [Google Cloud Docs](https://cloud.google.com/docs/authentication/external/set-up-adc)
* Alternatively you can set `application_default_credentials.json`
## Set Vertex Project & Vertex Location
All calls using Vertex AI require the following parameters: All calls using Vertex AI require the following parameters:
* Your Project ID * Your Project ID
`litellm.vertex_project` = "hardy-device-38811" Your Project ID `litellm.vertex_project` = "hardy-device-38811" Your Project ID
* Your Project Location * Your Project Location
`litellm.vertex_location` = "us-central1" `litellm.vertex_location` = "us-central1"
## Pre-requisites ## Sample Usage
`pip install google-cloud-aiplatform` ```python
import litellm
litellm.vertex_project = "hardy-device-38811" # Your Project ID
litellm.vertex_location = "us-central1" # proj location
Authentication: response = completion(model="chat-bison", messages=[{"role": "user", "content": "write code for saying hi from LiteLLM"}])
VertexAI uses Application Default Credentials, see https://cloud.google.com/docs/authentication/external/set-up-adc for more information on setting this up ```
VertexAI requires you to set `application_default_credentials.json`, this can be set by running `gcloud auth application-default login` in your terminal
## Chat Models ## Chat Models
| Model Name | Function Call | | Model Name | Function Call |