GGUF quants are already up and llama.cpp was updated today to support it.

  • Picasso@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    1
    ·
    5 hours ago

    Im especially interested in its advanced OCR capabilities. Will be testing this one out on lm studio