llama-stack-mirror/llama_stack/templates
Xi Yan 7a4383e4c1
add 3.3 to together inference provider (#729)
# What does this PR do?

- add llama3.3 model for together
- fix fireworks distro_codegen

```
python llama_stack/scripts/distro_codegen.py
```

## Test Plan

<img width="1132" alt="image"
src="https://github.com/user-attachments/assets/bf94b933-9200-4e73-878e-d1a95d450a88"
/>

**Tests**
```
pytest -v -s -k "together" --inference-model="meta-llama/Llama-3.3-70B-Instruct" ./llama_stack/providers/tests/inference/test_text_inference.py
```
<img width="1139" alt="image"
src="https://github.com/user-attachments/assets/407dc98b-8de3-4841-8cb1-75e4b5128544"
/>


## Sources

Please link relevant resources if necessary.


## Before submitting

- [ ] This PR fixes a typo or improves the docs (you can dismiss the
other checks if that's the case).
- [ ] Ran pre-commit to handle lint / formatting issues.
- [ ] Read the [contributor
guideline](https://github.com/meta-llama/llama-stack/blob/main/CONTRIBUTING.md),
      Pull Request section?
- [ ] Updated relevant documentation.
- [ ] Wrote necessary unit or integration tests.
2025-01-06 15:39:41 -08:00
..
bedrock Dont include 3B / 1B models for bedrock since they arent ondemand 2024-12-18 06:30:02 -08:00
cerebras Update Cerebras from Llama 3.1 to 3.3 (#645) 2024-12-17 16:28:24 -08:00
experimental-post-training Change post training run.yaml inference config (#710) 2025-01-03 08:37:48 -08:00
fireworks Add Llama 70B 3.3 to fireworks (#654) 2024-12-19 17:32:49 -08:00
hf-endpoint add embedding model by default to distribution templates (#617) 2024-12-13 12:48:00 -08:00
hf-serverless add embedding model by default to distribution templates (#617) 2024-12-13 12:48:00 -08:00
meta-reference-gpu add embedding model by default to distribution templates (#617) 2024-12-13 12:48:00 -08:00
meta-reference-quantized-gpu add embedding model by default to distribution templates (#617) 2024-12-13 12:48:00 -08:00
ollama add embedding model by default to distribution templates (#617) 2024-12-13 12:48:00 -08:00
remote-vllm add embedding model by default to distribution templates (#617) 2024-12-13 12:48:00 -08:00
tgi add embedding model by default to distribution templates (#617) 2024-12-13 12:48:00 -08:00
together add 3.3 to together inference provider (#729) 2025-01-06 15:39:41 -08:00
vllm-gpu add embedding model by default to distribution templates (#617) 2024-12-13 12:48:00 -08:00
__init__.py Auto-generate distro yamls + docs (#468) 2024-11-18 14:57:06 -08:00
template.py add embedding model by default to distribution templates (#617) 2024-12-13 12:48:00 -08:00