GGUF
#1
by
nk789
- opened
Boss, why don't you do a GGUF? Q4 ，Q4k_m, Convenient for low-visual graphics card users, such as 4080
Sorry, I haven't time to study to convert to gguf now, if you have scripts, Pls convert it yourself...
and the quantization accuracy too low will affects the generation quality, especially the text generate...