Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

341

Base only

Active filters: local-llm

yuxinlu1/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF

Text Generation • 12B • Updated Jun 19 • 448k • 1.3k

FINAL-Bench/POCKET-35B-GGUF

Text Generation • 35B • Updated 1 day ago • 7.47k • 48

FINAL-Bench/POCKET-26B-GGUF

Text Generation • 25B • Updated 1 day ago • 875 • 32

FINAL-Bench/POCKET-EN-GGUF

Text Generation • 23B • Updated 1 day ago • 1.49k • 29

yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF

Text Generation • 12B • Updated Jun 19 • 277k • 2.77k

m15dg/local-ai-toolkit

Text Generation • 35B • Updated 9 days ago • 24.2k • 27

FINAL-Bench/POCKET-KR-GGUF

Text Generation • 23B • Updated 1 day ago • 1.22k • 24

FINAL-Bench/POCKET-KR-MLX

Text Generation • 15B • Updated 1 day ago • 473 • 24

vinpix/Ternary-Bonsai-27B-Stock-MTP-GGUF

Text Generation • 29B • Updated about 7 hours ago • 867 • 2

WithinUsAI/Opus4.7-GODs.Ghost.Codex-4B.GGuF

Text Generation • 4B • Updated Jun 19 • 4.71k • 98

TheRofli/qquark-435m

Text Generation • 0.5B • Updated May 30 • 17 • 1

samwang0041/Qwen3.6-27B-MLX-4bit-MTP

Text Generation • 27B • Updated May 16 • 731 • 4

balastml/balastmed-4B

Text Generation • 4B • Updated May 30 • 11 • 2

balastml/balastmed-9B

Text Generation • 9B • Updated May 30 • 24 • 3

yuxinlu1/Mellum2-12B-A2.5B-Claude-4.6-4.8-Opus-Thinking-GGUF

Text Generation • 12B • Updated Jun 9 • 6.47k • 32

autotrust/gpt-oss-120b-Fable-5-Distilled-GGUF

Text Generation • 117B • Updated about 1 month ago • 21.4k • 15

huihui-ai/Huihui-gemma-4-12B-agentic-fable5-abliterated-GGUF

Text Generation • 12B • Updated Jun 22 • 13.6k • 24

neko-legends/Ornith-1.0-35B-AEON-Ultimate-Uncensored-NVFP4-GGUF-MTP

Text Generation • 36B • Updated 26 days ago • 10k • 6

ogbeatzofficial1/Opus4.7-GODs.Ghost.Codex-4B.GGuF

Text Generation • 4B • Updated 24 days ago • 453 • 1

Tendrun/qwen3.6-27b-django-coder-gguf

Text Generation • 27B • Updated 18 days ago • 455 • 1

smarttasks/react-coder-7b-GGUF

Text Generation • 8B • Updated 10 days ago • 188 • 1

SwarmDo/SwarmDo-A1-GGUF

Text Generation • 27B • Updated 5 days ago • 311 • 1

tngtech/Qwen3.6-27B-NVFP4-GGUF

Text Generation • 27B • Updated about 5 hours ago • 2.72k • 2

McaTech/Nonet

Text Generation • 0.1B • Updated Jun 30, 2025 • 224 • 3

seasparks/Llama-3.1-8B-Instruct-LegalCite-gguf

Text Generation • 8B • Updated Apr 7, 2025 • 17

umar141/gemma-3-Baro-finetune-v2-gguf

4B • Updated Apr 13, 2025 • 49 • 1

umar141/gemma-3-Baro-finetune-v3-gguf

4B • Updated Apr 17, 2025 • 174

dwili/gemma3-1b-ringkasan-bahasa-indo-gguf

1.0B • Updated Jun 29, 2025 • 29 • 1

Hussain2050/GGUF-Loader

shiv1119/ollama-model-shiv

Text Generation • Updated Jul 23, 2025