Models

mratsim/MiniMax-M2.1-FP8-INT4-AWQ

Text Generation • 39B • Updated 19 days ago • 3.66k • 31

Qwen/Qwen3-32B-AWQ

Text Generation • 33B • Updated May 21, 2025 • 229k • 124

Qwen/Qwen3-8B-AWQ

Text Generation • 8B • Updated May 21, 2025 • 123k • 36

MaziyarPanahi/Mixtral-8x22B-Instruct-v0.1-AWQ

Text Generation • 141B • Updated Apr 18, 2024 • 8.48k • 12

kosbu/Llama-3.3-70B-Instruct-AWQ

Text Generation • 71B • Updated Dec 7, 2024 • 413k • 9

Qwen/Qwen3-14B-AWQ

Text Generation • 15B • Updated May 21, 2025 • 1.12M • 53

mratsim/MiniMax-M2.1-BF16-INT4-AWQ

Text Generation • 39B • Updated 19 days ago • 2.12k • 5

QuantTrio/GLM-4.7-Flash-AWQ

Text Generation • 31B • Updated 12 days ago • 53.5k • 3

QuantTrio/Step3-VL-10B-AWQ

Image-Text-to-Text • 10B • Updated about 10 hours ago • 4.23k • 5

TheBloke/airoboros-mistral2.2-7B-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 14 • 2

TheBloke/Mistral-7B-Instruct-v0.2-AWQ

Text Generation • 7B • Updated Dec 11, 2023 • 16.2k • 52

casperhansen/llama-3-8b-instruct-awq

Text Generation • 8B • Updated Jun 8, 2024 • 47.4k • 28

solidrust/Mistral-7B-Instruct-v0.3-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 331k • 7

solidrust/dolphin-2.9.4-llama3.1-8b-AWQ

Text Generation • 8B • Updated Sep 3, 2024 • 255 • 4

Qwen/Qwen2.5-3B-Instruct-AWQ

Text Generation • 3B • Updated Oct 9, 2024 • 39.6k • 16

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • 8B • Updated Apr 6, 2025 • 635k • 98

Qwen/Qwen2.5-Omni-7B-AWQ

Any-to-Any • 11B • Updated May 15, 2025 • 39.6k • 17

QuantTrio/Qwen3-235B-A22B-Thinking-2507-AWQ

Text Generation • 235B • Updated Sep 5, 2025 • 3.66k • 6

QuantTrio/Qwen3-Coder-30B-A3B-Instruct-AWQ

Text Generation • 31B • Updated Sep 5, 2025 • 10.2k • 6

twhitworth/gpt-oss-120b-awq-w4a16

117B • Updated Aug 19, 2025 • 2.33k • 20

QuantTrio/Qwen3-VL-235B-A22B-Instruct-AWQ

Text Generation • 236B • Updated Oct 8, 2025 • 4.87k • 12

neonconverse/gemma-3-27b-abliterated-awq-4bit

Updated Oct 7, 2025 • 1

QuantTrio/Qwen3-VL-32B-Thinking-AWQ

Image-Text-to-Text • 33B • Updated Dec 3, 2025 • 1.65k • 4

SherlockID365/Qwen3-VL-8B-Instruct-quantized.w4a16

Image-to-Text • 3B • Updated Nov 3, 2025 • 12.8k • 1

QuantTrio/DeepSeek-V3.2-AWQ

Text Generation • 685B • Updated Dec 3, 2025 • 15k • 10

TheHouseOfTheDude/GLM-4.7_Compressed-Tensors

Text Generation • Updated Dec 27, 2025 • 49 • 5

channelcorp/Hana1.1-TTS-8B-v2-AWQ

1B • Updated Dec 31, 2025 • 300 • 1

asfberlin/Llama-3.3-8B-Instruct-awq

Text Generation • 8B • Updated 23 days ago • 47 • 1

casperhansen/mpt-7b-8k-chat-awq

Text Generation • Updated Nov 4, 2023 • 9 • 3

casperhansen/falcon-7b-awq

Text Generation • Updated Nov 4, 2023 • 10 • 1