phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-07-30 07:39:38 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
43 commits 78 branches 89 tags 90 MiB
Commit graph

43 commits

This branch
This branch
All branches
Author SHA1 Message Date
Ashwin Bharambe
db3e6dda07 refactor a method out 2024-08-05 13:14:15 -07:00
Ashwin Bharambe
125fdb1b2a ApiSurface -> Api 2024-08-05 12:46:38 -07:00
Ashwin Bharambe
7890921e5c move straggler files and fix some important existing bugs 2024-08-05 09:30:14 -07:00
Ashwin Bharambe
5e972ece13 refactor to reduce size of agentic_system 2024-08-04 20:34:15 -07:00
Ashwin Bharambe
be19b22391 Bring agentic system api to toolchain 
Add adapter dependencies and resolve adapters using a topological sort
 2024-08-04 17:33:29 -07:00
Ashwin Bharambe
b0e5340645 fixes 2024-08-03 22:16:24 -07:00
Ashwin Bharambe
750202ddd5 Add a Path() wrapper at the earliest place 2024-08-03 21:25:48 -07:00
Ashwin Bharambe
803976df26 cleanup, moving stuff to common, nuke utils 2024-08-03 20:58:00 -07:00
Ashwin Bharambe
fe582a739d add safety adapters, configuration handling, server + clients 2024-08-03 19:46:59 -07:00
Ashwin Bharambe
9dafa6ad94 implement full-passthrough in the server 2024-08-03 14:15:20 -07:00
Ashwin Bharambe
38fd76f85c undo a typo, add a passthrough distribution 2024-08-02 20:49:19 -07:00
Hardik Shah
67229f23a4 local imports for faster cli 2024-08-02 16:35:22 -07:00
Ashwin Bharambe
af4710c959 Improved exception handling 2024-08-02 15:52:15 -07:00
Hardik Shah
493f0d99b2 updated dependency and client model name 2024-08-02 15:37:40 -07:00
Ashwin Bharambe
d3e269fcf2 Remove inference uvicorn server entrypoint and llama inference CLI command 2024-08-02 14:18:25 -07:00
Ashwin Bharambe
3bc827cd5f read existing configuration, save enums properly 2024-08-02 14:09:57 -07:00
Ashwin Bharambe
2cf9915806 Distribution server now functioning 2024-08-02 13:37:40 -07:00
Ashwin Bharambe
041cafbee3 getting closer to a distro definition, distro install + configure works 2024-08-01 23:12:43 -07:00
Ashwin Bharambe
dac2b5a1ed More progress towards llama distribution install 2024-08-01 16:40:43 -07:00
Ashwin Bharambe
5a583cf16e Add distribution CLI scaffolding 2024-08-01 14:44:57 -07:00
Ashwin Bharambe
09cf3fe78b Use new definitions of Model / SKU 2024-07-31 22:44:35 -07:00
Hardik Shah
156bfa0e15
Added Ollama as an inference impl (#20) 
* fix non-streaming api in inference server

* unit test for inline inference

* Added non-streaming ollama inference impl

* add streaming support for ollama inference with tests

* addressing comments

---------

Co-authored-by: Hardik Shah <hjshah@fb.com>
 2024-07-31 22:08:37 -07:00
Ashwin Bharambe
c253c1c9ad Begin adding a /safety/run_shield API 2024-07-31 21:57:10 -07:00
Ashwin Bharambe
1bc81eae7b update toolchain to work with updated imports from llama_models 2024-07-30 17:52:57 -07:00
Ashwin Bharambe
23014ea4d1 Add hacks because Cloudfront config limits on the 405b model files 2024-07-30 13:46:47 -07:00
Ashwin Bharambe
404af06e02 Bump version to 0.0.2 2024-07-29 23:56:41 -07:00
Ashwin Bharambe
7306e6b167 show sampling params in model describe 2024-07-29 23:44:07 -07:00
Ashwin Bharambe
040c30ee54 added resumable downloader for downloading models 2024-07-29 23:29:16 -07:00
Ashwin Bharambe
59574924de model template --template -> model template --name 2024-07-29 18:21:05 -07:00
Ashwin Bharambe
45b8a7ffcd Add model describe subcommand 2024-07-29 18:19:53 -07:00
Ashwin Bharambe
9d7f283722 Add model list subcommand 2024-07-29 16:39:53 -07:00
Dalton Flanagan
a789c47ec9
Update cli_reference.md 2024-07-29 16:31:56 -04:00
Dalton Flanagan
dd6c1f1e64
Add links to shields 2024-07-27 11:28:46 -04:00
Dalton Flanagan
b5d7cec11e
Add shields to README 2024-07-27 11:02:50 -04:00
Ashwin Bharambe
3583cf2d51 update model template output to be prettier, more consumable 2024-07-26 15:39:46 -07:00
Ashwin Bharambe
51f8049c7a Update fp8_requirements, we don't need nightly torch anymore 2024-07-26 08:25:44 -07:00
Dalton Flanagan
ec433448f2
Add CLI reference docs (#14) 
* Add CLI reference doc

* touchups

* add helptext for download
 2024-07-25 13:56:29 -07:00
Jianyu Huang
b8aa99b034
Update fbgemm version (#12) 2024-07-24 23:48:44 -07:00
Lucain
378a2077dd
Update download command (#9) 2024-07-24 16:50:40 -07:00
Ashwin Bharambe
17bd1d876c Canonical package name for the dependency 2024-07-23 13:30:33 -07:00
Ashwin Bharambe
f7e053e3ba Updates to setup and requirements for PyPI 2024-07-23 13:28:30 -07:00
Ashwin Bharambe
d802d0f051 add requirements to MANIFEST.in 2024-07-23 12:59:28 -07:00
Ashwin Bharambe
5d5acc8ed5 Initial commit 2024-07-23 08:32:33 -07:00