forked from phoenix-oss/llama-stack-mirror
# What does this PR do? Minor bug fix and simplify code - [ ] Addresses issue (#issue) ## Test Plan See the updated `llama_stack/templates/fireworks/report.md` ## Sources Please link relevant resources if necessary. ## Before submitting - [ ] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case). - [ ] Ran pre-commit to handle lint / formatting issues. - [ ] Read the [contributor guideline](https://github.com/meta-llama/llama-stack/blob/main/CONTRIBUTING.md), Pull Request section? - [ ] Updated relevant documentation. - [ ] Wrote necessary unit or integration tests.
1.9 KiB
1.9 KiB
Report for fireworks distribution
Supported Models:
Model Descriptor | fireworks |
---|---|
Llama-3-8B-Instruct | ❌ |
Llama-3-70B-Instruct | ❌ |
Llama3.1-8B-Instruct | ✅ |
Llama3.1-70B-Instruct | ✅ |
Llama3.1-405B-Instruct | ✅ |
Llama3.2-1B-Instruct | ✅ |
Llama3.2-3B-Instruct | ✅ |
Llama3.2-11B-Vision-Instruct | ✅ |
Llama3.2-90B-Vision-Instruct | ✅ |
Llama3.3-70B-Instruct | ✅ |
Llama-Guard-3-11B-Vision | ✅ |
Llama-Guard-3-1B | ❌ |
Llama-Guard-3-8B | ✅ |
Llama-Guard-2-8B | ❌ |
Inference:
Model | API | Capability | Test | Status |
---|---|---|---|---|
Text | /chat_completion | streaming | test_text_chat_completion_streaming | ✅ |
Vision | /chat_completion | streaming | test_image_chat_completion_streaming | ✅ |
Vision | /chat_completion | non_streaming | test_image_chat_completion_non_streaming | ✅ |
Text | /chat_completion | non_streaming | test_text_chat_completion_non_streaming | ✅ |
Text | /chat_completion | tool_calling | test_text_chat_completion_with_tool_calling_and_streaming | ✅ |
Text | /chat_completion | tool_calling | test_text_chat_completion_with_tool_calling_and_non_streaming | ✅ |
Text | /completion | streaming | test_text_completion_streaming | ✅ |
Text | /completion | non_streaming | test_text_completion_non_streaming | ✅ |
Text | /completion | structured_output | test_text_completion_structured_output | ✅ |
Memory:
API | Capability | Test | Status |
---|---|---|---|
/insert, /query | inline | test_memory_bank_insert_inline_and_query | ❌ |
/insert, /query | url | test_memory_bank_insert_from_url_and_query | ❌ |
Agents:
API | Capability | Test | Status |
---|---|---|---|
create_agent_turn | rag | test_rag_agent | ❌ |
create_agent_turn | custom_tool | test_custom_tool | ✅ |
create_agent_turn | code_execution | test_code_execution | ❌ |