phoenix-oss/llama-stack
1
0
Fork 0
forked from phoenix-oss/llama-stack-mirror
Code Pull requests Releases Packages 2 Activity Actions

Together AI basic integration (#43)

Browse source 
* working!

* accounting for eos
This commit is contained in:
Hassan El Mghari 2024-08-28 16:07:13 -07:00 • committed by GitHub
parent a8b9541f19
commit f2e18826b6
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
5 changed files with 364 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

9
llama_toolchain/distribution/registry.py
View file

@ -59,6 +59,15 @@ def available_distribution_specs() -> List[DistributionSpec]:
Api.agentic_system: providers[Api.agentic_system]["meta-reference"],
},
),
DistributionSpec(
spec_id="remote-together",
description="Use Together.ai for running LLM inference",
provider_specs={
Api.inference: providers[Api.inference]["together"],
Api.safety: providers[Api.safety]["meta-reference"],
Api.agentic_system: providers[Api.agentic_system]["meta-reference"],
},
),
]