• magnue@lemmy.world
    link
    fedilink
    arrow-up
    9
    ·
    2 days ago

    Kinda cool that if you were reasonably wealthy, you could spend around 100k on compute and have something with similar performance to Opus running entirely locally.

        • ☆ Yσɠƚԋσʂ ☆@lemmy.mlOP
          link
          fedilink
          arrow-up
          4
          ·
          1 day ago

          Not on its own, but take a look at the benchmarks for ATLAS. It does some clever tricks to compensate for the capabilities of the smaller model, so it ends up punching far above its weight. One key trick they use is to have the model produce a few shots, and then use a small and fast model to do a heuristic to score which ones are promising. And turns out that dramatically improves the quality of the output.

    • racoon@lemmy.ml
      link
      fedilink
      arrow-up
      5
      ·
      2 days ago

      Without nagging restrictions like “press continue” from time to time? I would enjoy it more than a similarly priced Lamborghini