Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

143

Base only

Active filters: ik_llama.cpp

muzzy/GLM-5.2-GGUF

Text Generation • 753B • Updated 7 days ago • 3.47k • 7

sokann/GLM-5.2-GGUF-2.788bpw

753B • Updated about 12 hours ago • 1.06k • 3

sokann/GLM-5.2-GGUF-2.244bpw

753B • Updated about 11 hours ago • 25.2k • 22

ubergarm/Qwen3-Coder-480B-A35B-Instruct-GGUF

Text Generation • 480B • Updated Aug 28, 2025 • 162 • 17

ubergarm/Devstral-Small-2-24B-Instruct-2512-GGUF

Text Generation • 24B • Updated Dec 25, 2025 • 18 • 2

sokann/Qwen3.6-27B-GGUF-4.256bpw

27B • Updated Apr 30 • 288 • 16

gghfez/MiMo-V2.5-ikllama-GGUF

309B • Updated 7 days ago • 316 • 3

cHunter789/Qwen3.6-27B-i1-IQ4_KS-GGUF

Text Generation • 27B • Updated 26 days ago • 8.19k • 27

sokann/DeepSeek-V4-Flash-GGUF

284B • Updated 16 days ago • 3.32k • 4

sigargv/Laguna-M.1-GGUF

Text Generation • 226B • Updated 26 days ago • 4.53k • 6

SixVolts/GLM-5.2-ewaste-edition-GGUF

Text Generation • 754B • Updated 15 days ago • 3.43k • 13

sokann/GLM-5.2-GGUF-1.630bpw

753B • Updated about 12 hours ago • 2.1k • 4

xero0000/Qwen3.6-35B-A3B-vram13-GGUF

Text Generation • 35B • Updated 6 days ago • 529 • 1

xero0000/Qwen3.6-27B-vram14-GGUF

Text Generation • 27B • Updated 6 days ago • 149 • 1

NexesQuants/Llama-3.3-Nemotron-70B-Instruct-Abliterated-TA_v0.10-iMat-CQ-GGUF

71B • Updated Jul 17, 2025 • 35

ubergarm/DeepSeek-V3-0324-GGUF

Text Generation • 672B • Updated Jul 10, 2025 • 117 • 36

ubergarm/gemma-3-27b-it-qat-GGUF

Text Generation • 27B • Updated Jul 10, 2025 • 31 • 12

tdh111/bitnet-b1.58-2B-4T-GGUF

Text Generation • 3B • Updated May 16, 2025 • 415 • 10

ubergarm/Qwen3-235B-A22B-GGUF

Text Generation • 235B • Updated Jul 22, 2025 • 67 • 29

ArtusDev/Qwen3-235B-A22B-GGUF

Text Generation • 235B • Updated May 2, 2025 • 14 • 2

ubergarm/Qwen3-30B-A3B-GGUF

Text Generation • 31B • Updated Jul 10, 2025 • 36 • 20

ubergarm/DeepSeek-R1T-Chimera-GGUF

Text Generation • 672B • Updated Jul 10, 2025 • 3 • 1

ubergarm/Qwen3-14B-GGUF

Text Generation • 15B • Updated Jul 19, 2025 • 5 • 4

NexesQuants/mistral-small-3.1-24b-instruct-2503-iMat-IKLQ-GGUF

24B • Updated Jul 5, 2025 • 13

ubergarm/DeepSeek-R1-0528-GGUF

Text Generation • 672B • Updated Jul 19, 2025 • 548 • 52

NexesQuants/SicariusSicarii_Nano_Imp_1B-iMat-IKL-NXS-CQ-GGUF

1B • Updated Jul 5, 2025 • 9 • 1

NexesQuants/Gemma-3-4b_X-Ray-Abli_Linear_v1.01-iMat-IKL-NXS-CQ-GGUF

4B • Updated Jul 5, 2025 • 13

anikifoss/DeepSeek-R1-0528-DQ4_K_R4

Text Generation • 672B • Updated Nov 27, 2025 • 52 • 9

NexesQuants/Fallen-Gemma3-27B-v1-Q8_0-iMat-IKL-NXS-GGUF

27B • Updated Jul 5, 2025 • 5

NexesQuants/google_gemma-3-27b-it-qat-q4_0-unquantized-iMat-NXS-GGUF

27B • Updated Jul 5, 2025 • 30