phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

Merge pull request #5030 from BerriAI/litellm_add_vertex_ft_proxy

Browse source 
[Feat] Add support for Vertex AI Fine tuning on LiteLLM Proxy
This commit is contained in:
Ishaan Jaff 2024-08-03 08:29:11 -07:00 • committed by GitHub
commit 9dffe23108
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 5 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

6
litellm/proxy/proxy_config.yaml
View file

@ -34,6 +34,10 @@ finetune_settings:
api_version: "2023-03-15-preview" api_version: "2023-03-15-preview"
- custom_llm_provider: openai - custom_llm_provider: openai
api_key: os.environ/OPENAI_API_KEY api_key: os.environ/OPENAI_API_KEY
- custom_llm_provider: "vertex_ai"
vertex_project: "adroit-crow-413218"
vertex_location: "us-central1"
vertex_credentials: "/Users/ishaanjaffer/Downloads/adroit-crow-413218-a956eef1a2a8.json"
# for /files endpoints # for /files endpoints
files_settings: files_settings:
@ -54,5 +58,3 @@ general_settings:
# google cloud run maximum repsonses size is 32MB # google cloud run maximum repsonses size is 32MB
max_response_size_mb: 10 max_response_size_mb: 10
litellm_settings:
callbacks: ["gcs_bucket"] # 👈 KEY CHANGE

2
litellm/types/llms/openai.py
View file

@ -506,4 +506,4 @@ class FineTuningJobCreate(BaseModel):
class LiteLLMFineTuningJobCreate(FineTuningJobCreate): class LiteLLMFineTuningJobCreate(FineTuningJobCreate):
custom_llm_provider: Literal["openai", "azure"] custom_llm_provider: Literal["openai", "azure", "vertex_ai"]