• Moonrise2473@lemmy.ml
    link
    fedilink
    arrow-up
    11
    ·
    11 hours ago

    running a model on a reasonably specced laptop

    my 128GB M5 Max MacBook Pro

    TIL a $7000 laptop is “reasonably specced”

    • ☆ Yσɠƚԋσʂ ☆@lemmy.mlOP
      link
      fedilink
      arrow-up
      6
      ·
      11 hours ago

      You can run it on smaller hardware too, people managed to get 3.6 to run with 16 gb ram with stuff like quants and MTP. But the fact that you can run a model that performs as well as a frontier model from half a year ago on any laptop is frankly mind blowing.