Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

688

Base only

Active filters: pruning

MilyaShams/Qwen3-1.7B-Wanda_unstruct_0.3

2B • Updated May 17 • 2

MilyaShams/Qwen3-1.7B-SparseGPT_unstruct_0.3_bs128_damp0.01

2B • Updated May 17 • 2

MilyaShams/Qwen3-1.7B-AutoRound_W4A16_ign

2B • Updated May 17 • 1

MilyaShams/Qwen3-1.7B-SmoothQuant_0.4_AutoRound_W8A8_ign

2B • Updated May 17 • 2

MilyaShams/Qwen3-1.7B-SmoothQuant_0.6_AutoRound_W8A8_ign

2B • Updated May 17 • 2

exdysa/MiniMax-M2.7-REAP-139B-A10B-MLX-4bit

Text Generation • 139B • Updated May 19 • 139

MilyaShams/Qwen3-1.7B-AutoRound_W8A8_ign

2B • Updated May 23 • 1

MilyaShams/Qwen3-1.7B-SmoothQuant_0.5_PTQ_W4A16

2B • Updated May 23 • 2

MilyaShams/Qwen3-1.7B-SmoothQuant_0.6_PTQ_W4A16

2B • Updated May 23 • 2

MilyaShams/Qwen3-1.7B-SmoothQuant_0.5_GPTQ_W4A16

2B • Updated May 23 • 5

MilyaShams/Qwen3-1.7B-SmoothQuant_0.6_GPTQ_W8A8

2B • Updated May 23 • 5

MilyaShams/Qwen3-1.7B-SmoothQuant_0.5_AWQ_W8A8

2B • Updated May 23 • 4

MilyaShams/Qwen3-1.7B-SmoothQuant_0.5_AWQ_W4A16

2B • Updated May 24 • 2

exdysa/MiniMax-M2.7-REAP-139B-A10B-MLX-5bit

Text Generation • 139B • Updated May 25 • 184

enCoder/qwen3-5-4b-mlp7808-distilled

Text Generation • Updated May 26 • 5

PJRM/MiniMax-M2.5-tiny-24e-IQ4_NL-GGUF

Text Generation • 4B • Updated May 28 • 139 • 1

nadizik/Qwen2.5-1.5B-Instruct-Code-En-GGUF-789MB

Text Generation • 1B • Updated May 30 • 52

potto007/gemma-4-19B-A4B-text-REAP-GGUF

Text Generation • 20B • Updated May 30 • 110

poolside-laguna-hackathon/laguna-martini

Text Generation • Updated May 30

mradermacher/Qwen3-Coder-57B-GGUF

57B • Updated May 31 • 53

mradermacher/Qwen3-Coder-57B-i1-GGUF

57B • Updated May 31 • 335

mradermacher/Qwen3-Coder-64B-GGUF

64B • Updated Jun 1 • 420 • 2

mradermacher/Gemma-4-19B-GGUF

18B • Updated May 31 • 193 • 1

mradermacher/Gemma-4-21B-GGUF

21B • Updated May 31 • 160 • 1

mradermacher/Gemma-4-19B-i1-GGUF

18B • Updated May 31 • 284 • 1

mradermacher/Gemma-4-21B-i1-GGUF

21B • Updated Jun 1 • 299 • 2

mradermacher/Qwen3-Coder-64B-i1-GGUF

64B • Updated Jun 1 • 823 • 1

DjeDjeB/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Jun 1 • 272

SPAISS6F1/qwen-1b-pruned-th

Text Generation • 2B • Updated Jun 6 • 5

SPAISS6F1/gemma-1b-pruned-th

Text Generation • Updated Jun 6 • 4