phoenix-oss/llama-stack
1
0
Fork 0
forked from phoenix-oss/llama-stack-mirror
Code Pull requests Releases Packages 2 Activity Actions
llama-stack/llama_stack/templates/cerebras/report.md
Ashwin Bharambe 272d3359ee
fix: remove code interpeter implementation (#2087) 
# What does this PR do?

The builtin implementation of code interpreter is not robust and has a
really weak sandboxing shell (the `bubblewrap` container). Given the
availability of better MCP code interpreter servers coming up, we should
use them instead of baking an implementation into the Stack and
expanding the vulnerability surface to the rest of the Stack.

This PR only does the removal. We will add examples with how to
integrate with MCPs in subsequent ones.

## Test Plan

Existing tests.
2025-05-01 14:35:08 -07:00

2.1 KiB
Raw Blame History

Report for cerebras distribution

Supported Models

Model Descriptor cerebras
meta-llama/Llama-3-8B-Instruct ❌
meta-llama/Llama-3-70B-Instruct ❌
meta-llama/Llama-3.1-8B-Instruct ✅
meta-llama/Llama-3.1-70B-Instruct ❌
meta-llama/Llama-3.1-405B-Instruct-FP8 ❌
meta-llama/Llama-3.2-1B-Instruct ❌
meta-llama/Llama-3.2-3B-Instruct ❌
meta-llama/Llama-3.2-11B-Vision-Instruct ❌
meta-llama/Llama-3.2-90B-Vision-Instruct ❌
meta-llama/Llama-3.3-70B-Instruct ✅
meta-llama/Llama-Guard-3-11B-Vision ❌
meta-llama/Llama-Guard-3-1B ❌
meta-llama/Llama-Guard-3-8B ❌
meta-llama/Llama-Guard-2-8B ❌

Inference

Model API Capability Test Status
Llama-3.1-8B-Instruct /chat_completion streaming test_text_chat_completion_streaming ✅
Llama-3.2-11B-Vision-Instruct /chat_completion streaming test_image_chat_completion_streaming ❌
Llama-3.2-11B-Vision-Instruct /chat_completion non_streaming test_image_chat_completion_non_streaming ❌
Llama-3.1-8B-Instruct /chat_completion non_streaming test_text_chat_completion_non_streaming ✅
Llama-3.1-8B-Instruct /chat_completion tool_calling test_text_chat_completion_with_tool_calling_and_streaming ✅
Llama-3.1-8B-Instruct /chat_completion tool_calling test_text_chat_completion_with_tool_calling_and_non_streaming ✅
Llama-3.1-8B-Instruct /completion streaming test_text_completion_streaming ✅
Llama-3.1-8B-Instruct /completion non_streaming test_text_completion_non_streaming ✅
Llama-3.1-8B-Instruct /completion structured_output test_text_completion_structured_output ❌

Vector IO

API Capability Test Status
/retrieve test_vector_db_retrieve ✅

Agents

API Capability Test Status
/create_agent_turn rag test_rag_agent ✅
/create_agent_turn custom_tool test_custom_tool ❌