• theneverfox@pawb.social
    link
    fedilink
    English
    arrow-up
    2
    ·
    19 hours ago

    Well of course they outperform them if they’re specialized to a purpose… Theres a like 3B model that plays Minecraft and generally kicks the ass of all the more general llms

    And in general, the big models are primarily better at remembering instructions and context… An 8B model can hold a basic conversation or perform simple tasks on a similar level to a frontier model

    Really, really depends on what they’re specialized to do though