phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-06-28 02:53:30 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Together AI basic integration (#43)

Browse source 
* working!

* accounting for eos
This commit is contained in:
Hassan El Mghari 2024-08-28 16:07:13 -07:00 • committed by GitHub
parent a8b9541f19
commit f2e18826b6
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
5 changed files with 364 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

9
llama_toolchain/inference/providers.py
View file

@ -45,4 +45,13 @@ def available_inference_providers() -> List[ProviderSpec]:
module="llama_toolchain.inference.fireworks",
config_class="llama_toolchain.inference.fireworks.FireworksImplConfig",
),
InlineProviderSpec(
api=Api.inference,
provider_id="together",
pip_packages=[
"together",
],
module="llama_toolchain.inference.together",
config_class="llama_toolchain.inference.together.TogetherImplConfig",
),
]