phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

Merge pull request #5203 from paul-gauthier/main

Browse source 
vertex_ai/claude-3-5-sonnet@20240620 support prefill
This commit is contained in:
Krish Dholakia 2024-08-14 14:06:20 -07:00 • committed by GitHub
commit 4c6b14c301
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 2 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

3
model_prices_and_context_window.json
View file

@ -2085,7 +2085,8 @@
"litellm_provider": "vertex_ai-anthropic_models",
"mode": "chat",
"supports_function_calling": true,
"supports_vision": true
"supports_vision": true,
"supports_assistant_prefill": true
},
"vertex_ai/claude-3-haiku@20240307": {
"max_tokens": 4096,