Commit graph

19 commits

Author SHA1 Message Date
Chacksu
edfd92d81f
Merge branch 'meta-llama:main' into main 2024-11-20 16:12:38 -05:00
Ashwin Bharambe
983d6ce2df
Remove the "ShieldType" concept (#430)
# What does this PR do?

This PR kills the notion of "ShieldType". The impetus for this is the
realization:

> Why is keyword llama-guard appearing so many times everywhere,
sometimes with hyphens, sometimes with underscores?

Now that we have a notion of "provider specific resource identifiers"
and "user specific aliases" for those and the fact that this works with
models ("Llama3.1-8B-Instruct" <> "fireworks/llama-3pv1-..."), we can
follow the same rules for Shields.

So each Safety provider can make up a notion of identifiers it has
registered. This already happens with Bedrock correctly. We just
generalize it for Llama Guard, Prompt Guard, etc.

For Llama Guard, we further simplify by just adopting the underlying
model name itself as the identifier! No confusion necessary.

While doing this, I noticed a bug in our DistributionRegistry where we
weren't scoping identifiers by type. Fixed.

## Feature/Issue validation/testing/test plan

Ran (inference, safety, memory, agents) tests with ollama and fireworks
providers.
2024-11-12 12:37:24 -08:00
Connor Hack
69215b6f6c Update checkpoint directory to include model 2024-11-07 06:36:27 -08:00
Chacksu
b7f18eb012
Merge branch 'meta-llama:main' into main 2024-11-07 09:33:47 -05:00
Ashwin Bharambe
cfcc0a871c Slightly update PR template 2024-11-06 22:49:01 -08:00
Connor Hack
91b37c8972 Remove old environment variables 2024-11-06 13:24:15 -08:00
Connor Hack
00829b8537 Rename checkpoint directory env var 2024-11-06 12:52:07 -08:00
Connor Hack
f6b658e8b9 Add torchrun specially for meta_reference 2024-11-06 11:12:55 -08:00
Connor Hack
274b5a0d0c Add WORLD_SIZE env var for torch.distributed 2024-11-06 10:16:19 -08:00
Connor Hack
307b2ca33e Add RANK environment variable for torch.distributed 2024-11-06 09:58:35 -08:00
Connor Hack
e200a4232c Add aiosqlite as library dependency 2024-11-06 09:38:42 -08:00
Connor Hack
02663d86b5 Remove Workplace Message notification Action 2024-11-06 09:25:10 -08:00
Connor Hack
9d5636180c Update torchrun to pytest and checkpoint directory env var 2024-11-06 09:23:57 -08:00
Connor Hack
e972a04b7d Add workflow for GitHub Actions 2024-11-06 09:17:26 -08:00
Justin Lee
b6d8246b82
added templates and enhanced readme (#307)
Co-authored-by: Justin Lee <justinai@fb.com>
2024-10-24 17:07:06 -07:00
Yuan Tang
a2b87ed0cb
Switch to pre-commit/action (#239) 2024-10-11 11:09:11 -07:00
Yuan Tang
05282d1234
Enable pre-commit on main branch (#237) 2024-10-11 10:03:59 -07:00
Russell Bryant
eba9d1ea14
ci: Run pre-commit checks in CI (#176)
Run the pre-commit checks in a github workflow to validate that a PR
or a direct push to the repo does not introduce new errors.
2024-10-10 11:21:59 -07:00
Xi Yan
1433aaf9f7 add CODEOWNERS file 2024-09-11 11:40:37 -07:00