• vane@lemmy.world
      link
      fedilink
      arrow-up
      2
      ·
      edit-2
      2 hours ago

      You can’t right now because there is no dataset available for fine tuning. I’m just saying that it’s possible to fine tune 8B-35B parameter model in int4 that will outperform those models ex. for single programming language and developer specific problems. You can read example of fine tuned 8B model here https://fermisense.com/when-machines-take-the-wheel/