Commit graph

  • d8cea721ca elaborate on distributions Justin Lee 2024-11-08 10:30:36 -08:00
  • fc6c39b598 additional instructions in quickstart Justin Lee 2024-11-08 10:25:25 -08:00
  • 7a4fa9e30d change model-size, consolidate setup, formating changes Justin Lee 2024-11-08 09:56:52 -08:00
  • 731644e111 pre-commit Dalton Flanagan 2024-11-08 12:51:24 -05:00
  • 05d9e5465f reorganized file names Justin Lee 2024-11-08 08:58:33 -08:00
  • 92f16ed27b changed from vision to text model Justin Lee 2024-11-08 08:57:38 -08:00
  • efb0fbfaea tool calling changes Justin Lee 2024-11-08 08:52:15 -08:00
  • 14dff9745d tool calling changes Justin Lee 2024-11-08 08:32:35 -08:00
  • 75f742775d Merge branch 'main' of https://github.com/santiagxf/llama-stack into santiagxf/azure-ai-inference Facundo Santiago 2024-11-08 15:04:48 +00:00
  • c07919aa36 remove print Dalton Flanagan 2024-11-08 08:20:11 -05:00
  • 33ea496cf9 pip install helptext Dalton Flanagan 2024-11-08 08:18:32 -05:00
  • 72b2c885ee openapi gen Xi Yan 2024-11-07 23:17:10 -08:00
  • 8b018c4b78 gen openapi Xi Yan 2024-11-07 22:26:38 -08:00
  • e178081be5 Use the list endpoint instead of ps to get ollama's models Geronimo De Abreu 2024-11-08 00:40:18 -05:00
  • d42774c41b msg Xi Yan 2024-11-07 21:36:49 -08:00
  • 989f070bc0 move benchmark task def to file Xi Yan 2024-11-07 21:35:02 -08:00
  • f429e75b3e fix tests Xi Yan 2024-11-07 21:31:05 -08:00
  • 0443b36cc1 merge Xi Yan 2024-11-07 21:27:08 -08:00
  • 6192bf43a4
    [Evals API][10/n] API updates for EvalTaskDef + new test migration (#379) Xi Yan 2024-11-07 21:24:12 -08:00
  • 0dc2b9c6e4 fixture return impl Xi Yan 2024-11-07 21:22:18 -08:00
  • 9076221924 resource oriented object design for models Dinesh Yeduguru 2024-11-07 16:43:55 -08:00
  • 0297111dfd dont add together fixture Dinesh Yeduguru 2024-11-07 21:07:38 -08:00
  • 49b68942e8 use correct shield impl in meta ref Dinesh Yeduguru 2024-11-07 21:04:08 -08:00
  • d66293d498 add register in meta reference Dinesh Yeduguru 2024-11-07 20:59:16 -08:00
  • b9474144b6 use env vars for bedrock guardrail vars Dinesh Yeduguru 2024-11-07 20:15:42 -08:00
  • 74e92acf5e bedrock test for inference fixes Dinesh Yeduguru 2024-11-07 15:24:45 -08:00
  • 916aaec2d1 working bedrock tests Dinesh Yeduguru 2024-11-07 14:57:12 -08:00
  • bb76b0bfe0 init Dinesh Yeduguru 2024-11-07 12:09:14 -08:00
  • 8350f2df4c
    [docs] refactor remote-hosted distro (#402) Xi Yan 2024-11-07 19:16:38 -08:00
  • ff05e51425 docs Xi Yan 2024-11-07 19:15:59 -08:00
  • 537699f51a move docs Xi Yan 2024-11-07 19:12:08 -08:00
  • 9e8b41e605 delete old tests Xi Yan 2024-11-07 18:57:21 -08:00
  • bb475d58ae tool calling working now Kai Wu 2024-11-07 18:47:47 -08:00
  • 4ae1d37c2f msg Xi Yan 2024-11-07 18:43:21 -08:00
  • 6525b43906 refactor Xi Yan 2024-11-07 18:41:33 -08:00
  • edeb6dcf04 mmlu loose Xi Yan 2024-11-07 18:36:41 -08:00
  • 6ee02ca23b fix Xi Yan 2024-11-07 18:25:39 -08:00
  • 33b6d9b7b7 merge Xi Yan 2024-11-07 18:15:13 -08:00
  • 027ee2335c delete old tests Xi Yan 2024-11-07 18:06:21 -08:00
  • 3c17853d79 register task required Xi Yan 2024-11-07 16:42:44 -08:00
  • 94a56cc3f3 register task required Xi Yan 2024-11-07 16:41:23 -08:00
  • 7ca479f400 fix optional Xi Yan 2024-11-07 16:22:33 -08:00
  • fd581c3d88 only keep 1 run_eval Xi Yan 2024-11-07 16:17:49 -08:00
  • 37d87c585a wip huggingface register Xi Yan 2024-11-07 15:59:55 -08:00
  • d1633dc412 huggingface provider Xi Yan 2024-11-07 15:20:22 -08:00
  • cc6edf6287 Merge branch 'eval_task_register' into mmlu_benchmark Xi Yan 2024-11-07 14:41:50 -08:00
  • 6b889651d6 Merge branch 'main' into eval_task_register Xi Yan 2024-11-07 14:41:29 -08:00
  • 6da74262ef remove type ignore Xi Yan 2024-11-07 14:37:50 -08:00
  • f05db9a25c add eval_id for jobs Xi Yan 2024-11-07 14:30:46 -08:00
  • ea80f623fb add default task_eval_id for routing Xi Yan 2024-11-07 14:19:33 -08:00
  • 51c20f9c29 api refactor Xi Yan 2024-11-07 13:54:26 -08:00
  • 345ae07317
    Factor out create_dist_registry (#398) Dalton Flanagan 2024-11-07 16:13:19 -05:00
  • 594aa81f75 Factor out create_dist_registry Dalton Flanagan 2024-11-07 16:04:11 -05:00
  • 97dcd5704c Merge branch 'main' into eval_task_register Xi Yan 2024-11-07 13:08:58 -08:00
  • 694c142b89
    Add provider deprecation support; change directory structure (#397) Ashwin Bharambe 2024-11-07 13:04:53 -08:00
  • be6fe0fd77 move the meta_reference safety dir also Ashwin Bharambe 2024-11-07 13:02:13 -08:00
  • ec603a435a fix a couple dangling imports Ashwin Bharambe 2024-11-07 12:54:58 -08:00
  • 0747ee2f10 Add provider deprecation support; change directory structure Ashwin Bharambe 2024-11-07 12:34:23 -08:00
  • 36e2538eb0
    fix together inference validator (#393) Xi Yan 2024-11-07 11:31:53 -08:00
  • a982f21556 fix together inference validator Xi Yan 2024-11-07 11:27:21 -08:00
  • eaa6a29cef Merge branch 'main' into eval_task_register Xi Yan 2024-11-07 11:18:37 -08:00
  • 3acd37bcb3 remove type ignore Xi Yan 2024-11-07 11:15:36 -08:00
  • 93995ecc4c test wip Xi Yan 2024-11-07 11:11:27 -08:00
  • 3322aa9ee4 mmlu scoring fn Xi Yan 2024-11-07 10:54:00 -08:00
  • b946afddc0 datasetdef files Xi Yan 2024-11-07 10:28:51 -08:00
  • d75095033d huggingface provider Xi Yan 2024-11-07 10:21:25 -08:00
  • 31c5fbda5e
    [LlamaStack][Fireworks] Update client and add unittest (#390) Yufei (Benny) Chen 2024-11-07 10:11:28 -08:00
  • 5c429b0b67
    Merge branch 'main' into santiagxf/azure-ai-inference Facundo Santiago 2024-11-07 12:43:55 -05:00
  • f78f4cc5f2 [LlamaStack][Fireworks] Update client and add unittest benjibc 2024-11-07 05:41:08 +00:00
  • 69215b6f6c Update checkpoint directory to include model Connor Hack 2024-11-07 06:36:27 -08:00
  • b7f18eb012
    Merge branch 'meta-llama:main' into main Chacksu 2024-11-07 09:33:47 -05:00
  • cfcc0a871c Slightly update PR template Ashwin Bharambe 2024-11-06 22:49:01 -08:00
  • 283b5c1def Merge branch 'main' into eval_task_register Xi Yan 2024-11-06 21:50:09 -08:00
  • 3f1ac29d57 test eval works Xi Yan 2024-11-06 21:40:38 -08:00
  • 413a1b6d8b fix eval Xi Yan 2024-11-06 21:10:54 -08:00
  • 489f74a70b Allow simpler initialization of RemoteProviderConfig; fix issue in httpx client Ashwin Bharambe 2024-11-06 19:18:58 -08:00
  • 45e9e3ac4a removed redundant comments Justin Lee 2024-11-06 18:30:55 -08:00
  • b91e2cc201 minor improvement Justin Lee 2024-11-06 18:20:57 -08:00
  • 56239fce90 scoring fix Xi Yan 2024-11-06 18:07:16 -08:00
  • 02975ae54c fixed agent output Justin Lee 2024-11-06 18:07:01 -08:00
  • 9e24f31b8d agent kind of working Kai Wu 2024-11-06 17:54:38 -08:00
  • 064d2a5287
    Remove the safety adapter for Together; we can just use "meta-reference" (#387) Ashwin Bharambe 2024-11-06 17:36:57 -08:00
  • c5cf9c30be score batch Xi Yan 2024-11-06 17:30:46 -08:00
  • 0bce74402f scoring test pass Xi Yan 2024-11-06 17:27:55 -08:00
  • 0351072531 fix scoring register Xi Yan 2024-11-06 17:18:16 -08:00
  • def6d5d8ad scoring resolve Xi Yan 2024-11-06 17:04:25 -08:00
  • c53733d1a3 fixture Xi Yan 2024-11-06 16:41:17 -08:00
  • 00869799a1 Merge branch 'main' into eval_task_register Xi Yan 2024-11-06 16:34:22 -08:00
  • 8fc2d212a2
    fix safety signature mismatch (#388) Xi Yan 2024-11-06 16:30:47 -08:00
  • ea9f5368cb shield_type->identifier Xi Yan 2024-11-06 16:25:35 -08:00
  • 7c340f0236 rename test_inference -> test_text_inference Ashwin Bharambe 2024-11-06 16:12:50 -08:00
  • 67bfd946dc fix safety sig Xi Yan 2024-11-06 16:11:36 -08:00
  • 10eda0af59 delete unused Xi Yan 2024-11-06 16:08:04 -08:00
  • 3b54ce3499 remote::vllm now works with vision models Ashwin Bharambe 2024-11-06 16:07:17 -08:00
  • 1fe4099bd0 datasetio test Xi Yan 2024-11-06 16:00:38 -08:00
  • 9e0fb9b68d Remove the safety adapter for Together; we can just use "meta-reference" Ashwin Bharambe 2024-11-06 15:43:14 -08:00
  • 5a3e1c5f63 code changes from review Justin Lee 2024-11-06 15:31:55 -08:00
  • d0d785235d change working dir Justin Lee 2024-11-06 15:19:38 -08:00
  • 6cd67d0cbd implement github pages & action Justin Lee 2024-11-06 15:16:36 -08:00
  • 1b7e19d5d0 Merge branch 'main' into eval_task_register Xi Yan 2024-11-06 15:05:46 -08:00