llama-stack-mirror

phoenix-oss/llama-stack-mirror

Fork 1

mirror of https://github.com/meta-llama/llama-stack.git synced 2025-07-28 15:02:37 +00:00

Commit graph

Select branches

Hide pull requests

ak/llama-stack-litellm-support

allow_more_providers_guide

create-pull-request/changelog

create-pull-request/patch

dependabot/uv/opentelemetry-semantic-conventions-0.56b0

dependabot/uv/pandas-2.3.1

dependabot/uv/prompt-toolkit-3.0.51

dependabot/uv/pydantic-2.11.7

dependabot/uv/starlette-0.47.2

eval_api_final

fix_aclose

inject-metrics-response-v2

jeff/getting_started

k8s_demo

lm-studio-integration

main

rc-0.0.0.dev20250530002458

rc-0.0.0.dev20250531002418

rc-0.0.0.dev20250601003125

rc-0.0.0.dev20250606002455

rc-0.0.0.dev20250607002501

rc-0.0.0.dev20250608002809

rc-0.0.0.dev20250609002706

rc-0.0.0.dev20250610002515

rc-0.0.0.dev20250611002524

rc-0.0.0.dev20250612002501

rc-0.0.0.dev20250618002522

rc-0.0.0.dev20250619002551

rc-0.0.0.dev20250621002510

rc-0.0.0.dev20250622002816

rc-0.0.0.dev20250624002529

rc-0.0.0.dev20250625233419

rc-0.0.0.dev20250626002527

rc-0.0.0.dev20250627002554

rc-0.0.0.dev20250628002443

rc-0.0.0.dev20250715180855

rc-0.0.0.dev20250716012020

rc-0.0.0.dev20250717012111

rc-0.0.0.dev20250718012025

rc-0.0.0.dev20250719011820

rc-0.0.0.dev20250720012750

rc-0.0.0.dev20250721012509

rc-0.2.10.1rc1

rc-0.2.10rc2

rc-0.2.10rc3

rc-0.2.11rc1

rc-0.2.12rc3

rc-0.2.12rc4

rc-0.2.12rc5

rc-0.2.12rc6

rc-0.2.13rc2

rc-0.2.14rc1

rc-0.2.14rc2

rc-0.2.15rc1

rc-0.2.8rc1

rc-0.2.8rc2

rc-0.2.8rc3

rc-0.2.8rc4

rc-0.2.9rc1

release-0.1.5.1

release-0.1.6

release-0.1.7

release-0.1.8

release-0.1.9

release-0.2.10

release-0.2.10.1

release-0.2.11

release-0.2.12

release-0.2.13

release-0.2.14

release-0.2.15

release-0.2.2

release-0.2.3

release-0.2.4

release-0.2.5

release-0.2.6

release-0.2.7

release-0.2.8

release-0.2.9

simplify_pt_api

#1000

#1001

#1002

#1003

#1004

#1006

#1008

#1009

#1010

#1012

#1013

#1015

#1016

#1017

#1018

#1019

#1020

#1022

#1023

#1024

#1025

#1026

#1028

#103

#1030

#1032

#1033

#1034

#1035

#1036

#1037

#1039

#104

#1040

#1041

#1042

#1044

#1047

#1049

#105

#1050

#1051

#1052

#1053

#1055

#1056

#1057

#1059

#1060

#1062

#1063

#1064

#1065

#1068

#107

#1070

#1072

#1074

#1075

#1077

#1078

#1079

#108

#1080

#1081

#1083

#1084

#1085

#1086

#1087

#1089

#1090

#1093

#1094

#1095

#1096

#1097

#1098

#1099

#11

#1100

#1101

#1103

#1104

#1105

#1106

#1107

#1108

#1114

#1116

#1117

#1118

#1119

#112

#1121

#1123

#1124

#1125

#1126

#1127

#1128

#1129

#113

#1132

#1133

#1134

#1135

#1136

#1137

#1138

#1139

#1140

#1143

#1145

#1146

#1147

#1148

#1149

#1150

#1151

#1152

#1155

#1156

#1157

#1160

#1161

#1162

#1163

#1164

#1166

#1167

#1168

#1169

#117

#1171

#1172

#1173

#1174

#1175

#1176

#1177

#1178

#1179

#118

#1180

#1181

#1183

#1184

#1186

#1187

#1188

#1190

#1191

#1192

#1194

#1195

#1196

#1197

#1198

#1199

#12

#1200

#1201

#1202

#1203

#1204

#1205

#1206

#1208

#1209

#121

#1210

#1213

#1214

#1215

#1216

#1217

#1218

#1219

#122

#1220

#1221

#1222

#1223

#1224

#1225

#1226

#1227

#1228

#1230

#1231

#1233

#1234

#1235

#1236

#1237

#1239

#1240

#1241

#1242

#1243

#1244

#1245

#1246

#1247

#1248

#1250

#1251

#1252

#1253

#1255

#1256

#1257

#1258

#1259

#1260

#1261

#1262

#1263

#1264

#1265

#1266

#1267

#1268

#1269

#1271

#1272

#1273

#1274

#1275

#1276

#1278

#1279

#128

#1280

#1281

#1282

#1283

#1284

#1285

#1286

#1287

#1288

#1290

#1291

#1293

#1295

#1296

#1299

#13

#130

#1300

#1301

#1302

#1303

#1304

#1305

#1306

#1307

#1308

#1309

#131

#1310

#1311

#1312

#1313

#1314

#1315

#1316

#1317

#1318

#132

#1320

#1321

#1322

#1323

#1325

#1326

#1327

#1328

#1329

#133

#1330

#1331

#1333

#1334

#1335

#1336

#1337

#1338

#1339

#134

#1340

#1341

#1342

#1343

#1344

#1345

#1346

#1347

#1348

#1349

#1350

#1351

#1352

#1353

#1354

#1356

#1358

#1359

#136

#1360

#1361

#1362

#1364

#137

#1372

#1376

#1377

#1378

#1379

#138

#1380

#1381

#1382

#1383

#1384

#1385

#1386

#1387

#1388

#139

#1390

#1392

#1393

#1394

#1397

#1398

#1399

#14

#1400

#1401

#1402

#1403

#1404

#1405

#1406

#1407

#1408

#1410

#1411

#1413

#1415

#1416

#1417

#1418

#1419

#1420

#1422

#1423

#1424

#1425

#1426

#1428

#1429

#1430

#1433

#1434

#1436

#1437

#1439

#144

#1440

#1442

#1443

#1444

#1445

#1446

#1448

#145

#1450

#1452

#1453

#1456

#1458

#1459

#1460

#1461

#1462

#1463

#1465

#1467

#1468

#1469

#147

#1470

#1471

#1472

#1473

#1475

#1476

#1479

#148

#1480

#1481

#1482

#1483

#1484

#1485

#1486

#1487

#149

#1490

#1491

#1492

#1493

#1494

#1495

#1496

#1497

#1498

#1499

#1500

#1501

#1502

#1503

#1504

#1505

#1506

#1507

#1508

#1509

#151

#1510

#1512

#1513

#1515

#1516

#1520

#1521

#1522

#1523

#1524

#1525

#1526

#1527

#1529

#153

#1530

#1532

#1533

#1534

#1535

#1536

#1538

#1541

#1542

#1543

#1544

#1546

#1547

#1548

#1549

#1550

#1551

#1552

#1555

#1556

#1557

#1558

#1559

#1562

#1563

#1564

#1565

#1566

#1568

#1569

#157

#1570

#1571

#1572

#1573

#1574

#1575

#1576

#1577

#1578

#1579

#1580

#1581

#1582

#1583

#1585

#1589

#159

#1590

#1591

#1592

#1593

#1594

#1595

#1596

#1597

#1598

#1599

#160

#1600

#1601

#1602

#1603

#1605

#1606

#1608

#1609

#1610

#1611

#1612

#1613

#1614

#1615

#1616

#1617

#1618

#1619

#1620

#1621

#1622

#1624

#1625

#1626

#1627

#1628

#163

#1632

#1634

#1635

#1636

#1637

#1639

#1640

#1641

#1642

#1643

#1644

#1645

#1646

#1647

#1649

#165

#1650

#1651

#1653

#1654

#1655

#1656

#1657

#1658

#1659

#1660

#1663

#1664

#1665

#1666

#1667

#1668

#1669

#167

#1670

#1671

#1672

#1673

#1675

#1676

#1677

#1678

#1679

#1680

#1684

#1685

#1686

#1687

#1688

#1689

#1690

#1691

#1693

#1695

#1698

#170

#1700

#1701

#1702

#1703

#1704

#1705

#1706

#1708

#1709

#171

#1710

#1711

#1712

#1713

#1714

#1715

#1718

#1719

#1720

#1721

#1724

#1726

#1727

#173

#1730

#1731

#1732

#1733

#1734

#1735

#1736

#1737

#1738

#1739

#1740

#1743

#1744

#1745

#1747

#175

#1750

#1752

#1753

#1754

#1755

#1756

#1757

#1758

#1759

#176

#1760

#1761

#1762

#1763

#1764

#1766

#177

#1770

#1772

#1774

#1776

#1777

#1778

#178

#1780

#1782

#1784

#1785

#1786

#1787

#1788

#1789

#179

#1790

#1791

#1792

#1793

#1795

#1796

#1797

#1799

#1800

#1801

#1802

#1803

#1804

#1805

#1806

#1807

#1808

#1809

#181

#1810

#1812

#182

#1821

#1823

#1826

#1827

#1828

#1829

#1830

#1831

#1833

#1835

#1836

#1838

#1839

#1840

#1841

#1843

#1845

#1846

#1848

#185

#1850

#1851

#1852

#1854

#1855

#1856

#1858

#1859

#1861

#1863

#1864

#1865

#1866

#1868

#187

#1870

#1871

#1873

#1877

#1878

#1879

#1880

#1881

#1882

#1884

#1885

#1886

#1887

#1889

#1890

#1891

#1892

#1893

#1894

#1895

#1896

#1897

#1898

#1899

#1900

#1901

#1903

#1904

#1905

#1906

#1907

#1908

#1909

#1910

#1911

#1913

#1914

#1917

#1918

#192

#1920

#1921

#1922

#1923

#1924

#1925

#1926

#1928

#1930

#1931

#1932

#1933

#1934

#1935

#1936

#1937

#1939

#1940

#1941

#1943

#1944

#1945

#1946

#1947

#195

#1950

#1952

#1954

#1957

#1958

#196

#1960

#1961

#1962

#1963

#1964

#1965

#1966

#1967

#1969

#1971

#1972

#1973

#1974

#1975

#1977

#1978

#1979

#1980

#1981

#1982

#1983

#1984

#1985

#1986

#1987

#1988

#1989

#1990

#1991

#1992

#1993

#1995

#1996

#1997

#1998

#1999

#20

#2000

#2001

#2002

#2003

#2004

#2005

#2006

#2007

#2008

#2009

#201

#2011

#2012

#2013

#2014

#2015

#2018

#2020

#2021

#2022

#2023

#2024

#2025

#2026

#2027

#2028

#2029

#2030

#2031

#2032

#2033

#2034

#2035

#2036

#2037

#2038

#2039

#204

#2040

#2041

#2044

#2045

#2046

#2047

#2048

#2049

#2050

#2051

#2052

#2054

#2055

#2057

#2058

#2059

#206

#2060

#2061

#2062

#2063

#2065

#2066

#2067

#2068

#2069

#207

#2071

#2072

#2075

#2081

#2083

#2084

#2086

#2087

#2088

#209

#2090

#2092

#2094

#2095

#2096

#2099

#210

#2100

#2101

#2102

#2103

#2104

#2105

#2106

#2107

#2108

#2109

#2112

#2114

#2116

#2118

#212

#2123

#2124

#2125

#2126

#2127

#2128

#213

#2130

#2131

#2132

#2134

#2136

#2137

#2138

#2140

#2141

#2143

#2144

#2145

#2146

#2147

#2148

#2149

#2151

#2152

#2153

#2155

#2156

#2157

#2158

#2159

#216

#2160

#2161

#2163

#2164

#2165

#2166

#217

#2170

#2171

#2172

#2175

#2176

#2177

#2178

#2179

#2180

#2181

#2182

#2183

#2185

#2186

#2187

#219

#2190

#2191

#2193

#2194

#2195

#2196

#2197

#2198

#2199

#22

#2200

#2201

#2202

#2205

#2206

#221

#2214

#2215

#2216

#2217

#2218

#2219

#222

#2220

#2221

#2222

#2223

#2225

#2226

#2227

#2228

#2229

#2230

#2231

#2232

#2233

#2235

#2236

#2237

#2238

#2239

#224

#2240

#2241

#2242

#2243

#2244

#2245

#2246

#2247

#2248

#2249

#2250

#2251

#2252

#2253

#2254

#2255

#2256

#2257

#2258

#2259

#2260

#2261

#2263

#2264

#2265

#2266

#2267

#2268

#2269

#227

#2271

#2272

#2273

#2275

#2276

#2277

#2279

#2280

#2281

#2282

#2284

#2285

#2286

#2287

#2288

#2289

#2290

#2292

#2293

#2294

#2295

#2298

#23

#230

#2300

#2302

#2303

#2304

#2305

#2306

#231

#2310

#2311

#2312

#2314

#2316

#2317

#2319

#232

#2320

#2321

#2323

#2324

#2326

#2327

#2329

#2330

#2331

#2332

#2333

#2334

#2335

#2336

#2337

#2339

#2342

#2343

#2344

#2347

#2348

#2349

#235

#2350

#2351

#236

#2360

#2361

#2362

#237

#2375

#2387

#2388

#2389

#239

#2391

#2392

#2393

#2394

#2396

#2397

#2398

#2399

#24

#240

#2400

#2403

#2404

#2405

#2407

#2408

#2409

#241

#2410

#2411

#2412

#2413

#2414

#2415

#2416

#2419

#2420

#2422

#2423

#2424

#2425

#2426

#2427

#2429

#243

#2434

#2438

#2440

#2441

#2442

#2443

#2446

#2448

#2449

#2450

#2452

#2454

#2457

#2460

#2464

#2465

#2466

#2467

#2468

#2469

#247

#2470

#2471

#2472

#2473

#2474

#2475

#2476

#2479

#2481

#2482

#2483

#2484

#2485

#2486

#2487

#2488

#2489

#2490

#2491

#2492

#2494

#2497

#2498

#2500

#2503

#2505

#2507

#2509

#2510

#2513

#2514

#2515

#2516

#2518

#2520

#2521

#2523

#2524

#2525

#2526

#2527

#2531

#2533

#2534

#2537

#2538

#2541

#2543

#2544

#2545

#2546

#2547

#2548

#2549

#2550

#2551

#2552

#2554

#2555

#2559

#2565

#2566

#2567

#2568

#2570

#2573

#2574

#2575

#2577

#2578

#2579

#2580

#2582

#2583

#2586

#2587

#259

#2590

#2591

#2592

#2593

#2595

#260

#261

#2610

#2611

#2612

#2614

#2616

#2617

#2618

#262

#2621

#2623

#2625

#2627

#2628

#2629

#263

#2630

#2631

#2632

#2633

#2634

#2635

#2636

#2637

#2639

#264

#2640

#2641

#2642

#2643

#2644

#2645

#2646

#2648

#2649

#265

#2650

#2651

#2654

#2655

#2656

#2657

#2658

#2659

#266

#2660

#2661

#2662

#2663

#2664

#2665

#2666

#2667

#2668

#2669

#267

#2670

#2671

#2672

#2673

#2674

#2675

#2676

#2677

#2678

#2679

#2682

#2686

#2687

#2688

#2689

#269

#2690

#2692

#2693

#2695

#2697

#2698

#2699

#27

#270

#2700

#2701

#2703

#2705

#2707

#2708

#2710

#2712

#2714

#2716

#2717

#2718

#2719

#272

#2722

#2723

#2724

#2725

#2726

#2727

#2728

#2730

#2731

#2732

#2733

#2734

#2736

#2737

#2738

#2739

#274

#2741

#2744

#2745

#2746

#2748

#275

#2750

#2752

#2753

#2754

#2755

#2756

#2757

#2758

#2759

#2766

#2767

#2768

#2769

#2771

#2772

#2773

#2774

#2775

#2776

#2777

#278

#2780

#2781

#2782

#2783

#2784

#2785

#2786

#2787

#2788

#2789

#279

#2790

#2791

#2792

#2793

#2794

#2795

#2796

#2798

#2799

#280

#2800

#2801

#2802

#2803

#2804

#2805

#2806

#2807

#2808

#2809

#281

#2811

#2812

#2814

#2815

#2816

#2817

#2818

#2822

#2823

#2824

#2825

#2826

#2827

#2828

#2829

#2830

#2831

#2832

#2833

#2835

#2840

#2841

#2842

#2844

#2847

#2848

#2849

#285

#2850

#2851

#2853

#2854

#2855

#2856

#2857

#2858

#2859

#286

#2861

#2862

#2863

#2867

#2868

#2869

#287

#2874

#2875

#2876

#2879

#288

#2880

#2881

#2882

#2883

#2884

#2885

#2886

#2889

#289

#2890

#2891

#2893

#2896

#2897

#2898

#2899

#29

#2900

#2901

#2902

#2903

#2904

#2905

#2906

#2907

#2909

#291

#2914

#2916

#2917

#2918

#2919

#2920

#2921

#2922

#2923

#2924

#2925

#2926

#2927

#2928

#2930

#2931

#2932

#2933

#2934

#294

#295

#296

#298

#299

#30

#300

#301

#303

#307

#319

#32

#323

#324

#325

#326

#327

#329

#33

#330

#333

#335

#338

#339

#34

#340

#343

#346

#348

#349

#35

#351

#352

#353

#354

#355

#356

#358

#359

#36

#360

#362

#364

#366

#368

#369

#37

#370

#371

#374

#375

#376

#378

#379

#38

#380

#381

#383

#384

#386

#387

#388

#39

#390

#392

#393

#397

#398

#399

#400

#401

#402

#403

#404

#408

#409

#410

#411

#413

#417

#419

#420

#421

#422

#423

#424

#425

#426

#427

#428

#429

#43

#430

#433

#435

#439

#440

#441

#442

#443

#445

#446

#447

#448

#449

#450

#451

#452

#453

#456

#457

#458

#459

#461

#463

#464

#465

#467

#468

#469

#47

#470

#471

#472

#473

#474

#476

#477

#478

#479

#480

#481

#482

#483

#484

#485

#486

#487

#488

#489

#49

#490

#491

#492

#493

#494

#496

#497

#498

#499

#50

#500

#501

#503

#504

#505

#507

#508

#51

#510

#511

#512

#515

#516

#517

#518

#519

#52

#521

#522

#523

#524

#525

#526

#527

#528

#529

#53

#531

#532

#533

#534

#535

#536

#537

#54

#540

#541

#543

#545

#546

#547

#549

#55

#550

#551

#552

#553

#554

#555

#556

#557

#558

#559

#56

#560

#563

#564

#565

#566

#567

#568

#569

#57

#570

#572

#573

#574

#575

#576

#577

#578

#579

#58

#580

#581

#583

#584

#585

#587

#588

#589

#59

#590

#591

#592

#593

#594

#595

#596

#597

#598

#599

#60

#600

#601

#603

#604

#605

#606

#607

#608

#609

#61

#611

#614

#617

#618

#619

#62

#620

#622

#623

#624

#627

#629

#630

#631

#632

#634

#635

#636

#637

#638

#639

#64

#640

#641

#642

#644

#645

#646

#649

#653

#654

#655

#657

#659

#660

#661

#662

#663

#664

#665

#666

#668

#669

#67

#670

#672

#673

#674

#675

#676

#677

#678

#680

#681

#683

#686

#689

#69

#690

#692

#693

#694

#696

#698

#699

#700

#701

#702

#703

#704

#705

#706

#707

#708

#709

#710

#711

#712

#713

#714

#715

#717

#718

#719

#72

#720

#722

#723

#725

#727

#728

#729

#73

#730

#731

#732

#733

#734

#735

#736

#737

#738

#739

#74

#742

#743

#744

#745

#748

#749

#75

#750

#751

#752

#753

#754

#755

#756

#757

#758

#759

#760

#761

#762

#763

#764

#765

#766

#767

#77

#770

#771

#772

#773

#774

#775

#776

#777

#778

#779

#78

#780

#781

#782

#785

#786

#787

#788

#789

#79

#790

#791

#792

#793

#794

#795

#796

#797

#798

#799

#80

#800

#801

#802

#803

#806

#807

#808

#81

#810

#811

#813

#814

#815

#816

#817

#818

#819

#82

#821

#822

#823

#825

#828

#83

#830

#831

#832

#833

#834

#835

#836

#837

#838

#839

#84

#840

#841

#842

#843

#844

#845

#846

#847

#848

#849

#85

#850

#851

#852

#853

#854

#855

#856

#857

#858

#859

#86

#860

#861

#862

#863

#864

#865

#866

#867

#868

#871

#872

#874

#875

#876

#877

#878

#879

#88

#880

#881

#883

#884

#885

#886

#888

#889

#89

#890

#891

#892

#893

#894

#895

#896

#897

#898

#899

#90

#900

#901

#903

#905

#906

#907

#908

#909

#91

#910

#911

#912

#914

#915

#916

#917

#918

#92

#921

#926

#927

#928

#929

#93

#930

#931

#935

#936

#937

#938

#939

#94

#940

#941

#943

#944

#945

#946

#947

#95

#950

#951

#952

#954

#955

#956

#957

#96

#960

#961

#962

#963

#968

#969

#97

#970

#972

#974

#976

#977

#978

#979

#98

#980

#982

#983

#984

#985

#986

#987

#988

#989

#99

#990

#991

#992

#994

#996

#997

#998

stable

tools-doc

v0.0.53

v0.0.54

v0.0.55

v0.0.61

v0.0.62

v0.0.63

v0.1.0

v0.1.0rc11

v0.1.0rc12

v0.1.1

v0.1.19rc8

v0.1.1rc3

v0.1.1rc4

v0.1.2

v0.1.2rc1

v0.1.2rc3

v0.1.2rc4

v0.1.3

v0.1.3rc1

v0.1.3rc2

v0.1.3rc3

v0.1.4

v0.1.4.dev3

v0.1.4rc1

v0.1.4rc2

v0.1.4rc3

v0.1.5

v0.1.5.1

v0.1.5.1rc1

v0.1.5rc1

v0.1.5rc2

v0.1.5rc3

v0.1.6

v0.1.6.1rc1

v0.1.6rc10

v0.1.6rc7

v0.1.6rc8

v0.1.6rc9

v0.1.7

v0.1.7rc1

v0.1.7rc2

v0.1.8

v0.1.8rc1

v0.1.8rc2

v0.1.9

v0.2.0

v0.2.1

v0.2.10

v0.2.10.1

v0.2.10.1rc1

v0.2.10rc2

v0.2.10rc3

v0.2.11

v0.2.11rc1

v0.2.12

v0.2.12rc3

v0.2.12rc4

v0.2.12rc5

v0.2.12rc6

v0.2.13

v0.2.13rc2

v0.2.14

v0.2.14rc1

v0.2.14rc2

v0.2.15

v0.2.15rc1

v0.2.2

v0.2.2rc1

v0.2.3

v0.2.3rc5

v0.2.4

v0.2.4rc1

v0.2.5

v0.2.5rc1

v0.2.6

v0.2.6rc1

v0.2.7

v0.2.7rc1

v0.2.8

v0.2.8rc1

v0.2.8rc2

v0.2.8rc3

v0.2.8rc4

v0.2.9

v0.2.9rc1

0e985648f5 add streaming support for ollama inference with tests Hardik Shah 2024-07-31 19:33:36 -07:00
0e75e73fa7 Added non-streaming ollama inference impl Hardik Shah 2024-07-30 18:11:44 -07:00
1bc81eae7b update toolchain to work with updated imports from llama_models Ashwin Bharambe 2024-07-30 17:52:57 -07:00
5b9c05c5dd unit test for inline inference Hardik Shah 2024-07-30 16:23:47 -07:00
cc98fbb058 fix non-streaming api in inference server Hardik Shah 2024-07-30 14:25:50 -07:00
23014ea4d1 Add hacks because Cloudfront config limits on the 405b model files Ashwin Bharambe 2024-07-30 13:46:20 -07:00
404af06e02 Bump version to 0.0.2 Ashwin Bharambe 2024-07-29 23:56:41 -07:00
7306e6b167 show sampling params in model describe Ashwin Bharambe 2024-07-29 23:44:07 -07:00
040c30ee54 added resumable downloader for downloading models Ashwin Bharambe 2024-07-29 07:41:07 -07:00
59574924de model template --template -> model template --name Ashwin Bharambe 2024-07-29 18:21:05 -07:00
45b8a7ffcd Add model describe subcommand Ashwin Bharambe 2024-07-29 18:19:53 -07:00
9d7f283722 Add model list subcommand Ashwin Bharambe 2024-07-29 16:39:53 -07:00
a789c47ec9

Update cli_reference.md Dalton Flanagan 2024-07-29 16:31:56 -04:00
dd6c1f1e64

Add links to shields Dalton Flanagan 2024-07-27 11:28:46 -04:00
b5d7cec11e

Add shields to README Dalton Flanagan 2024-07-27 11:02:50 -04:00
3583cf2d51 update model template output to be prettier, more consumable Ashwin Bharambe 2024-07-26 15:39:46 -07:00
51f8049c7a Update fp8_requirements, we don't need nightly torch anymore Ashwin Bharambe 2024-07-26 08:25:44 -07:00
ec433448f2

Add CLI reference docs (#14) Dalton Flanagan 2024-07-25 16:56:29 -04:00
b1f02cc654 add helptext for download dltn 2024-07-25 13:50:29 -07:00
86924fd7b1 touchups dltn 2024-07-25 12:43:44 -07:00
142b36c7c5 Add CLI reference doc dltn 2024-07-25 12:37:05 -07:00
ad6c889cca

Update README.md Yuan-Man 2024-07-25 15:38:40 +08:00
b8aa99b034

Update fbgemm version (#12) Jianyu Huang 2024-07-24 23:48:44 -07:00
1b8bc38d04 Update fbgemm version Jianyu Huang 2024-07-24 23:45:19 -07:00
378a2077dd

Update download command (#9) Lucain 2024-07-25 01:50:40 +02:00
fe7477f55f

Rename fp8_requirements.txt to ZXV-ONLINE-MARKET-PLATFORM.com Jahin9999 2024-07-24 22:13:25 +04:00
c5843cd2f6

Update download command Lucain 2024-07-24 10:13:16 +02:00
17bd1d876c Canonical package name for the dependency Ashwin Bharambe 2024-07-23 13:30:33 -07:00
f7e053e3ba Updates to setup and requirements for PyPI Ashwin Bharambe 2024-07-23 13:25:40 -07:00
d802d0f051 add requirements to MANIFEST.in Ashwin Bharambe 2024-07-23 12:59:28 -07:00
5d5acc8ed5 Initial commit Ashwin Bharambe 2024-06-25 15:47:57 -07:00
05f47d848b RFC-0001-llama-stack rsm 2024-07-23 07:53:40 -07:00
9fb50bbd99 Initial commit Hardik Shah 2024-06-25 15:47:57 -07:00
8030fbd82e

Create CONTRIBUTING.md Joseph Spisak 2024-07-23 06:08:26 -07:00
81d50b9d3d

Create CODE_OF_CONDUCT.md Joseph Spisak 2024-07-23 06:07:25 -07:00
f89b4b451d Initial commit - yes! Hardik Shah 2024-06-25 15:47:57 -07:00
ab829b0557 revert excluded cat defaults Kate Plawiak 2024-07-22 22:09:44 -07:00
ab8a220faa add missing license part Kate Plawiak 2024-07-22 22:03:05 -07:00
16fe0e4594 clean up and add license Kate Plawiak 2024-07-22 21:59:57 -07:00
7a8b5c1604 Merge branch 'main' into fix_llama_guard_inference Kate Plawiak 2024-07-22 21:31:18 -07:00
138b92ae69 llama_guard inference fix Kate Plawiak 2024-07-22 21:26:03 -07:00
a14daf5829 Update license Ashwin Bharambe 2024-07-22 20:47:32 -07:00
dae6357e49 nit update cli message Hardik Shah 2024-07-22 20:45:49 -07:00
aca6bfe0df drop custom classes to manage hydra Hardik Shah 2024-07-22 20:40:50 -07:00
86fff23a9e updating license for toolchain Ashwin Bharambe 2024-07-22 20:31:42 -07:00
0e2fc9966a Reduce loading time for non-fp8 Ashwin Bharambe 2024-07-22 19:21:04 -07:00
fef679bb34 Don't load as bf16 on CPU unless fp8 is active Ashwin Bharambe 2024-07-22 19:09:32 -07:00
8cd2e4164c

Merge pull request #2 from meta-llama/revert-1-fix_llama_guard Kate Plawiak 2024-07-22 17:28:13 -07:00
5228bdc0f3

Revert "Update llama guard file to latest version" Kate Plawiak 2024-07-22 17:27:19 -07:00
dfe0173b58

Merge pull request #1 from meta-llama/fix_llama_guard Kate Plawiak 2024-07-22 16:27:47 -07:00
9b51b4edd8 update batch completion endpoint Ashwin Bharambe 2024-07-22 16:08:28 -07:00
1e573843ce added pre-commit to toolchain Ashwin Bharambe 2024-07-22 16:04:31 -07:00
acb2a91872 Remove configurations Ashwin Bharambe 2024-07-22 16:03:37 -07:00
bbfd8a587e add EventLogger for inference Ashwin Bharambe 2024-07-22 15:11:34 -07:00
7574ffb25f added __init__ Hardik Shah 2024-07-22 14:49:26 -07:00
441e5da6ed no special casign for original Hardik Shah 2024-07-22 14:42:38 -07:00
4d3b226275 check original folder Hardik Shah 2024-07-22 14:35:09 -07:00
91b43600f7 increase max_new_tokens Kate Plawiak 2024-07-22 13:58:51 -07:00
cb5829901f redo and fix only specific lines Kate Plawiak 2024-07-22 13:46:43 -07:00
d5019cf3b3 update llama guard file to latest version Kate Plawiak 2024-07-22 13:36:11 -07:00
74442e88b1 add yaml to manifest Hardik Shah 2024-07-22 13:34:08 -07:00
6f0d348b1c add init for common Hardik Shah 2024-07-22 11:50:54 -07:00
54a22e288a requirements Ashwin Bharambe 2024-07-22 11:39:42 -07:00
c38d638340 sku -> family Ashwin Bharambe 2024-07-22 11:15:04 -07:00
f0e0903270 add llama model subcommand Ashwin Bharambe 2024-07-22 11:07:11 -07:00
4417407652 agentic_system --> llama_agentic_system Hardik Shah 2024-07-22 01:20:32 -07:00
1eac470045 add __init__ Hardik Shah 2024-07-22 01:17:41 -07:00
2e7978fa39 update import for quantization format from models Ashwin Bharambe 2024-07-21 23:56:04 -07:00
f9111652ef rename toolchain/ --> llama_toolchain/ Hardik Shah 2024-07-21 23:48:38 -07:00
d95f5f863d use default_config file to configure inference Hardik Shah 2024-07-21 19:26:11 -07:00
c64b8cba22 from models.llama3_1 --> from llama_models.llama3_1 Hardik Shah 2024-07-21 19:07:02 -07:00
c6ef16f6bd consol_scripts for toolchain Hardik Shah 2024-07-21 17:39:47 -07:00
7c69675b79 added pypi package rsm 2024-07-21 13:43:36 -07:00
b0f3406a08 deleting bash script as this is not done via cli Hardik Shah 2024-07-21 12:55:49 -07:00
6bcd826b32 enable import of subcommands from llama-agentic-system Hardik Shah 2024-07-21 12:54:38 -07:00
67f0510edd rename ModelInference to Inference rsm 2024-07-21 12:19:52 -07:00
245461620d make sure scripts always have pipefail Ashwin Bharambe 2024-07-21 12:18:49 -07:00
c9f33d8f68 cli updates Hardik Shah 2024-07-21 01:51:54 -07:00
23fe353e4a cli -- llama inference configure Hardik Shah 2024-07-21 01:16:44 -07:00
0df57c4447 fix bad merge with injection shield? Ashwin Bharambe 2024-07-20 23:54:32 -07:00
2408bd81c8 easy script to create config Hardik Shah 2024-07-20 23:51:35 -07:00
7c9ed3e58e update README a bit Ashwin Bharambe 2024-07-20 23:26:50 -07:00
d73fed5cc3 cleanup for fp8 and requirements etc Ashwin Bharambe 2024-07-20 23:21:41 -07:00
2428701951 download inside model_name directory Hardik Shah 2024-07-20 23:16:10 -07:00
0746a0f62b fp8 inference Ashwin Bharambe 2024-07-20 23:13:47 -07:00
ad62e2e1f3 make inference server load checkpoints for fp8 inference Ashwin Bharambe 2024-07-20 21:10:17 -07:00
7d2c0b14b8 Changes from the main repo Ashwin Bharambe 2024-07-19 16:11:17 -07:00
9c9b834c0f update prompt-shield to reflect latest changes in agentic Hardik Shah 2024-07-19 18:12:09 -07:00
ce0804556b update requirements for running standalone Hardik Shah 2024-07-19 18:11:25 -07:00
2ed2881a21 fixed imports models.llama3. --> models.llama3_1.api. Hardik Shah 2024-07-19 17:42:14 -07:00
f94efcf2ee kill older junk Ashwin Bharambe 2024-07-19 12:32:22 -07:00
95781ec85d Add toolchain from agentic system here Ashwin Bharambe 2024-07-19 12:30:35 -07:00
f6b2b2fb39 cleanup Ashwin Bharambe 2024-07-11 10:04:56 -07:00
6d6c07b882 added more docs Raghotham Murthy 2024-07-11 03:12:28 -07:00
8631d90f1e added more docs Raghotham Murthy 2024-07-11 03:11:45 -07:00
e657e71446 added more docs Raghotham Murthy 2024-07-11 03:10:30 -07:00
ab44e9c862 added more docs Raghotham Murthy 2024-07-11 03:09:13 -07:00
62f2db8f62

saving the spec changes raghotham 2024-07-11 05:02:16 -04:00
0e4b9efedf added more docs Raghotham Murthy 2024-07-11 01:54:03 -07:00
9070d45629 added more docs Raghotham Murthy 2024-07-11 01:48:13 -07:00