• vane@lemmy.world
    link
    fedilink
    arrow-up
    2
    ·
    edit-2
    46 minutes ago

    You can’t right now because there is no dataset available for fine tuning. I’m just saying that it’s possible to fine tune 8B-35B parameter model in int4 that will outperform those models ex. for single programming language and developer specific problems. You can read example of fine tuned 8B model here https://fermisense.com/when-machines-take-the-wheel/