• akrot@lemmy.world
    link
    fedilink
    English
    arrow-up
    6
    arrow-down
    1
    ·
    1 year ago

    The NPU performance is very interesting on the 8G3. 20 tokens/s for Llama2 and <1s for Stable diffusion.