• ℍ𝕂-𝟞𝟝@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    1
    ·
    8 hours ago

    You can run Claude Sonnet equivalent quantised models locally on much less RAM.

    Local LLMs are close to being viable. We’re almost at the point where they fit a Macbook.