• Irdial@lemmy.ml
    link
    fedilink
    English
    arrow-up
    2
    ·
    6 hours ago

    I’m surprised that the model’s benchmark performance isn’t that much worse than the base given that it’s running with 1-bit quantization. Impressive.