phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-28 04:04:31 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

fix(factory.py): add replicate meta llama prompt templating support

Browse source
This commit is contained in:
Krrish Dholakia 2024-04-25 08:24:28 -07:00
parent a26ecbad97
commit cf24e3eb02
4 changed files with 26 additions and 4 deletions
Download patch file Download diff file Expand all files Collapse all files

3
litellm/proxy/_super_secret_config.yaml
View file

@ -31,6 +31,9 @@ model_list:
- litellm_params:
model: gpt-3.5-turbo
model_name: gpt-3.5-turbo
- model_name: llama-3
litellm_params:
model: replicate/meta/meta-llama-3-8b-instruct
router_settings:
allowed_fails: 3
context_window_fallbacks: null