☆ Yσɠƚԋσʂ ☆@lemmy.ml to Technology@lemmy.mlEnglish · 12 hours agoBonsai 27B: The First 27B-Class Model to Run on a Phoneprismml.comexternal-linkmessage-square1fedilinkarrow-up17arrow-down11cross-posted to: technology@midwest.social
arrow-up16arrow-down1external-linkBonsai 27B: The First 27B-Class Model to Run on a Phoneprismml.com☆ Yσɠƚԋσʂ ☆@lemmy.ml to Technology@lemmy.mlEnglish · 12 hours agomessage-square1fedilinkcross-posted to: technology@midwest.social
minus-squareIrdial@lemmy.mllinkfedilinkEnglisharrow-up2·7 hours agoI’m surprised that the model’s benchmark performance isn’t that much worse than the base given that it’s running with 1-bit quantization. Impressive.
I’m surprised that the model’s benchmark performance isn’t that much worse than the base given that it’s running with 1-bit quantization. Impressive.