Q4_0_4_4-GGUF GGUF dedicated for ARM NEON devices flyfishstudio/yarn-llama-2-7b-128k-Q4_0_4_4.gguf 7B • Updated Sep 19, 2024 flyfishstudio/Qwen2.5-3B-Instruct-Q4_0_4_4.gguf 3B • Updated Sep 19, 2024 • 11 flyfishstudio/rocket-3b-Q4_0_4_4.gguf 3B • Updated Sep 19, 2024 • 1 flyfishstudio/Gemma-2-Ataraxy-9B-Q4_0_4_4.gguf 9B • Updated Sep 19, 2024
Q4_0_4_8-GGUF GGUF dedicated for ARM i8mm devices / Snapdragon X Elite / Snapdragon 8 Gen 1,2,3 flyfishstudio/Gemma-2-Ataraxy-9B-Q4_0_4_8.gguf 9B • Updated Sep 20, 2024 • 1 flyfishstudio/Hermes-3-Llama-3.1-8B-Q4_0_4_8.gguf 8B • Updated Sep 20, 2024 • 4 • 1 flyfishstudio/llama-2-7b-chat-Q4_0_4_8.gguf 7B • Updated Sep 20, 2024 • 4 flyfishstudio/meta-llama-3.1-8b-instruct-abliterated-Q4_0_4_8.gguf 8B • Updated Sep 20, 2024 • 18
flyfishstudio/meta-llama-3.1-8b-instruct-abliterated-Q4_0_4_8.gguf 8B • Updated Sep 20, 2024 • 18
Q4_0_4_4-GGUF GGUF dedicated for ARM NEON devices flyfishstudio/yarn-llama-2-7b-128k-Q4_0_4_4.gguf 7B • Updated Sep 19, 2024 flyfishstudio/Qwen2.5-3B-Instruct-Q4_0_4_4.gguf 3B • Updated Sep 19, 2024 • 11 flyfishstudio/rocket-3b-Q4_0_4_4.gguf 3B • Updated Sep 19, 2024 • 1 flyfishstudio/Gemma-2-Ataraxy-9B-Q4_0_4_4.gguf 9B • Updated Sep 19, 2024
Q4_0_4_8-GGUF GGUF dedicated for ARM i8mm devices / Snapdragon X Elite / Snapdragon 8 Gen 1,2,3 flyfishstudio/Gemma-2-Ataraxy-9B-Q4_0_4_8.gguf 9B • Updated Sep 20, 2024 • 1 flyfishstudio/Hermes-3-Llama-3.1-8B-Q4_0_4_8.gguf 8B • Updated Sep 20, 2024 • 4 • 1 flyfishstudio/llama-2-7b-chat-Q4_0_4_8.gguf 7B • Updated Sep 20, 2024 • 4 flyfishstudio/meta-llama-3.1-8b-instruct-abliterated-Q4_0_4_8.gguf 8B • Updated Sep 20, 2024 • 18
flyfishstudio/meta-llama-3.1-8b-instruct-abliterated-Q4_0_4_8.gguf 8B • Updated Sep 20, 2024 • 18
