PrismML — Announcing Bonsai 27B: The First 27B-Class Model to Run on a Phone
prismml.com
  • Irdial@lemmy.mlEnglish
    2·
    8 days ago

    I’m surprised that the model’s benchmark performance isn’t that much worse than the base given that it’s running with 1-bit quantization. Impressive.