Commit graph

  • 072d1b7205 Add completion() impl for meta-reference Ashwin Bharambe 2024-10-18 20:41:21 -07:00
  • bcaf639dd6 Get the agents method also Ashwin Bharambe 2024-10-18 19:57:34 -07:00
  • 627edaf407 Make all API methods async def again Ashwin Bharambe 2024-10-18 16:50:57 -07:00
  • c085886cdb
    Address feedback Yuan Tang 2024-10-11 16:08:45 -04:00
  • 660983b72d
    Address comments Yuan Tang 2024-10-11 14:37:41 -04:00
  • 24f64915b6
    Fix pre-commit Yuan Tang 2024-10-10 21:34:30 -04:00
  • f93f7f0199
    Fix pre-commit Yuan Tang 2024-10-10 21:32:39 -04:00
  • 7bbce6394a
    Working Yuan Tang 2024-10-10 20:58:52 -04:00
  • cdadf0f87d
    Update Yuan Tang 2024-10-10 20:37:20 -04:00
  • ad4e65e876
    Fixes Yuan Tang 2024-10-03 22:05:07 -04:00
  • 765f2c86af
    Fix import and model mapping Yuan Tang 2024-10-03 17:57:21 -04:00
  • 925e1afb5b
    Add vLLM provider Yuan Tang 2024-10-03 13:01:56 -04:00
  • f58441cc21 readme Xi Yan 2024-10-18 18:55:29 -07:00
  • 100b5fecd4 readme Xi Yan 2024-10-18 18:53:49 -07:00
  • 955743ba7a kill distribution/templates Xi Yan 2024-10-18 17:32:11 -07:00
  • c830235936 rename Xi Yan 2024-10-18 17:28:26 -07:00
  • cbb423a32f move distribution/templates to distributions/ Xi Yan 2024-10-18 17:21:50 -07:00
  • b4aca0aeb6 move distribution folders Xi Yan 2024-10-18 17:05:41 -07:00
  • 95a96afe34 Small rename Ashwin Bharambe 2024-10-18 14:41:38 -07:00
  • fd90d2ae97 readme Xi Yan 2024-10-18 14:30:44 -07:00
  • 71a905e93f Allow overridding checkpoint_dir via config Ashwin Bharambe 2024-10-18 14:28:06 -07:00
  • a3f748a875 readme for distributions Xi Yan 2024-10-18 14:21:44 -07:00
  • 33afd34e6f
    Add an option to not use elastic agents for meta-reference inference (#269) Ashwin Bharambe 2024-10-18 12:51:10 -07:00
  • 4bda515990 Rename config var Ashwin Bharambe 2024-10-18 12:46:31 -07:00
  • bb3c26cfc5 Add an option to not use elastic agents for meta-reference inference Ashwin Bharambe 2024-10-18 12:22:48 -07:00
  • dcac9e4874 update compose file Xi Yan 2024-10-18 11:12:27 -07:00
  • 965bab950c Added value inside valueerror Sarthak Deshpande 2024-10-18 22:07:47 +05:30
  • a542509399 Changed order of parameters Sarthak Deshpande 2024-10-18 17:50:14 +05:30
  • 761217dcc4 Added implementation for get_agents_step and get_agents_turn Sarthak Deshpande 2024-10-18 17:21:33 +05:30
  • c2e8011175 Added a check on turn_ids Sarthak Deshpande 2024-10-18 12:52:28 +05:30
  • 9bcd03fe2a Added implementations for get_agents_session, delete_agents_session and delete_agents Sarthak Deshpande 2024-10-18 12:44:42 +05:30
  • 542ffbee72 comment Xi Yan 2024-10-17 19:37:22 -07:00
  • 293d8f2895 docker compose ollama Xi Yan 2024-10-17 19:31:29 -07:00
  • be3c5c034d
    [bugfix] fix case for agent when memory bank registered without specifying provider_id (#264) Xi Yan 2024-10-17 17:28:17 -07:00
  • 6d7f341ecf agents unit test Xi Yan 2024-10-17 17:26:34 -07:00
  • 4667c1f542 memory test Xi Yan 2024-10-17 16:43:14 -07:00
  • f0600a30c9 fix case where memory bank is registered without provider_id Xi Yan 2024-10-17 16:17:46 -07:00
  • 560b3b5461 Merge branch 'main' into dell_tgi Xi Yan 2024-10-17 13:48:00 -07:00
  • 9fcf5d58e0 Allow overriding MODEL_IDS for inference test Ashwin Bharambe 2024-10-17 10:03:27 -07:00
  • 616a7979b9 changed description picografix 2024-10-17 12:40:07 +05:30
  • 013a811b76 Merge branch 'main' into feature/add-platform-to-docker picografix 2024-10-17 12:34:51 +05:30
  • 0c75f2cf31 added platform for docker image picografix 2024-10-17 12:32:07 +05:30
  • 02be26098a getting started Xi Yan 2024-10-16 23:56:21 -07:00
  • cf9e5b76b2
    Update getting_started.md Xi Yan 2024-10-16 23:52:29 -07:00
  • 7cc47da8f2
    Update getting_started.md Xi Yan 2024-10-16 23:50:31 -07:00
  • d787d1e84f
    config templates restructure, docs (#262) Xi Yan 2024-10-16 23:25:10 -07:00
  • 292ef8fdd2 readmes Xi Yan 2024-10-16 23:24:02 -07:00
  • a07dfffbbf
    initial changes (#261) Tam 2024-10-16 23:15:59 -07:00
  • 049d6b2a06 config templates Xi Yan 2024-10-16 23:06:56 -07:00
  • 5eb53a7b77 wip Xi Yan 2024-10-16 19:14:08 -07:00
  • 580acdc459 initial changes Tam Nguyen 2024-10-16 18:41:51 -07:00
  • 319a6b5f83
    Update getting_started.md (#260) ATH 2024-10-16 21:05:36 -04:00
  • 1374248426
    Update getting_started.md ATH 2024-10-16 20:27:26 -04:00
  • eaab21dd48 nit Xi Yan 2024-10-16 16:39:21 -07:00
  • cd1f1a86bf dell tgi adapter Xi Yan 2024-10-16 16:35:46 -07:00
  • cfc97df6d5 dell tgi fix Xi Yan 2024-10-16 15:37:05 -07:00
  • c4d5d6bb91
    Docker compose scripts for remote adapters (#241) Xi Yan 2024-10-15 16:32:53 -07:00
  • 770647dede
    Fix broken rendering in Google Colab (#247) Matthieu FRONTON 2024-10-16 00:41:49 +02:00
  • 09b793c4d6 Fix fp8 implementation which had bit-rotten a bit Ashwin Bharambe 2024-10-15 13:57:01 -07:00
  • fa68809a2e llm judge llamastack scorer Xi Yan 2024-10-15 13:25:46 -07:00
  • 80ada04f76
    Remove request arg from chat completion response processing (#240) Yuan Tang 2024-10-15 16:03:17 -04:00
  • 7c450f8660 readme Xi Yan 2024-10-15 12:02:31 -07:00
  • d1f8515a78 add readme Xi Yan 2024-10-15 12:00:44 -07:00
  • 1330ab7f47 move scripts to distribution/ folder Xi Yan 2024-10-15 11:55:47 -07:00
  • 463214c203 update provider-id Xi Yan 2024-10-15 11:50:38 -07:00
  • 0c4ed66ecc regen openapi Xi Yan 2024-10-15 10:20:30 -07:00
  • 2c23a66300
    Merge branch 'main' into evals_new Xi Yan 2024-10-15 10:20:03 -07:00
  • be4f395032 full evals / full scoring flow Xi Yan 2024-10-15 10:17:45 -07:00
  • cccd5be090 move eval_task_config to client Xi Yan 2024-10-15 10:14:35 -07:00
  • d2b62157a3 openapi gen Xi Yan 2024-10-15 00:44:54 -07:00
  • 9cc0a54f0b rag correctness scorer w/ custom dataset Xi Yan 2024-10-15 00:42:03 -07:00
  • ec6c63ba57 dataset accept file uploads Xi Yan 2024-10-14 23:36:15 -07:00
  • 3c29108b6e input query optional input for braintrust scorer Xi Yan 2024-10-14 21:17:16 -07:00
  • 7b5895003a braintrust scorer Xi Yan 2024-10-14 21:09:59 -07:00
  • c8f6849291 full accuracy Xi Yan 2024-10-14 20:42:22 -07:00
  • fcb8dea1ef scorer only api Xi Yan 2024-10-14 17:46:29 -07:00
  • a22c31b8a4 processor registry Xi Yan 2024-10-14 16:25:06 -07:00
  • 95fd53d292 registry refactor Xi Yan 2024-10-14 16:09:55 -07:00
  • c50686b6fe scorer registry Xi Yan 2024-10-14 15:41:31 -07:00
  • 9c501d042b cleanup hardcoded dataset registry Xi Yan 2024-10-14 14:19:15 -07:00
  • a9210cd416 datasets api crud Xi Yan 2024-10-14 13:54:16 -07:00
  • 25316d6efc
    Fix broken rendering in Google Colab Matthieu FRONTON 2024-10-14 22:48:50 +02:00
  • f046899a1c datasets api Xi Yan 2024-10-14 13:16:39 -07:00
  • 209cd3d35e Bump version to 0.0.42 Xi Yan 2024-10-14 11:13:04 -07:00
  • 6f7318b243 readme sanjaychelliah 2024-10-14 14:21:58 +05:30
  • 18fe966e96 registry refactor Xi Yan 2024-10-14 00:12:46 -07:00
  • 78cb88c3c4 RunEvalTask / InferenceGenerator Xi Yan 2024-10-13 23:48:15 -07:00
  • 8890de7322 cleanup original BaseTask Xi Yan 2024-10-13 23:30:21 -07:00
  • a25aff290e generator + scorer Api for MMLU Xi Yan 2024-10-13 23:27:02 -07:00
  • 4b78f3dce6
    Add llama download cli reference for multiple models ABucket 2024-10-12 14:29:43 +08:00
  • 8fcded0004 Add llama download support for multiple models with comma-separated list ABucket 2024-10-12 14:28:36 +08:00
  • dfa570ca2e wait for tgi server to start before starting server Xi Yan 2024-10-11 18:54:48 -07:00
  • 2da8aa18bf path Xi Yan 2024-10-11 18:25:20 -07:00
  • 0325a767b6 tgi docker compose Xi Yan 2024-10-11 18:24:11 -07:00
  • fe9029f169
    Remove request arg from chat completion response processing Yuan Tang 2024-10-11 16:18:40 -04:00
  • a2b87ed0cb
    Switch to pre-commit/action (#239) Yuan Tang 2024-10-11 14:09:11 -04:00
  • 2dd4fc5ca5
    Switch to pre-commit/action Yuan Tang 2024-10-11 13:33:28 -04:00
  • 05282d1234
    Enable pre-commit on main branch (#237) Yuan Tang 2024-10-11 13:03:59 -04:00
  • fb565dfb06 eleuther eval fix Xi Yan 2024-10-11 09:30:10 -07:00
  • 2128e61da2
    Fix incorrect completion() signature for Databricks provider (#236) Yuan Tang 2024-10-11 11:47:57 -04:00