phoenix-oss/llama-stack
1
0
Fork 0
forked from phoenix-oss/llama-stack-mirror
Code Pull requests Releases Packages 2 Activity Actions
llama-stack/llama_stack/providers/registry
History
Ashwin Bharambe 928a39d17b
feat(providers): Groq now uses LiteLLM openai-compat (#1303) 
Groq has never supported raw completions anyhow. So this makes it easier
to switch it to LiteLLM. All our test suite passes.

I also updated all the openai-compat providers so they work with api
keys passed from headers. `provider_data`

## Test Plan

```bash
LLAMA_STACK_CONFIG=groq \
   pytest -s -v tests/client-sdk/inference/test_text_inference.py \
   --inference-model=groq/llama-3.3-70b-versatile --vision-inference-model=""
```

Also tested (openai, anthropic, gemini) providers. No regressions.
2025-02-27 13:16:50 -08:00
..
__init__.py API Updates (#73) 2024-09-17 19:51:35 -07:00
agents.py [memory refactor][2/n] Update faiss and make it pass tests (#830) 2025-01-22 10:02:15 -08:00
datasetio.py [remove import *] clean up import *'s (#689) 2024-12-27 15:45:44 -08:00
eval.py [remove import *] clean up import *'s (#689) 2024-12-27 15:45:44 -08:00
inference.py feat(providers): Groq now uses LiteLLM openai-compat (#1303) 2025-02-27 13:16:50 -08:00
post_training.py Pin torchtune pkg version (#791) 2025-01-16 16:31:13 -08:00
safety.py [remove import *] clean up import *'s (#689) 2024-12-27 15:45:44 -08:00
scoring.py [remove import *] clean up import *'s (#689) 2024-12-27 15:45:44 -08:00
telemetry.py optional api dependencies (#793) 2025-01-17 15:26:53 -08:00
tool_runtime.py chore: move embedding deps to RAG tool where they are needed (#1210) 2025-02-21 11:33:41 -08:00
vector_io.py chore: move embedding deps to RAG tool where they are needed (#1210) 2025-02-21 11:33:41 -08:00