• leanleft@lemmy.ml
    link
    fedilink
    English
    arrow-up
    3
    ·
    edit-2
    7 hours ago

    im not bothered by it.
    but also… i wouldn’t use it as my sole model to perform every task. [waves hand toward huggingface.] ( a gazillion bajillion models, specialized for all types of tasks).

    edit: i checked. and there aren’t as many models as i expected, for this task(didnt test them). and… small multimodal model failed badly(see picture of the iguana … or whatever the hell that is)
    it’s a strange benchmark. but it seems reasonable to expect LLMs to be able to do this.