Edit Models filters

Model Tree

google/gemma-2-2b-it

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

139

Base only

Active filters: llama.cpp, google/gemma-2-2b-it

BafS/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 2.57k • 9

google/gemma-2-2b-it-GGUF

3B • Updated Aug 27, 2024 • 131 • 92

Fizzarolli/gemma-2-2b-it-Q8_0-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 12

kaetemi/gemma-2-2b-it-Q4_0-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 32

Wusul/gemma-2-2b-it-Q8_0-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 18

bartowski/gemma-2-2b-it-GGUF

Text Generation • 3B • Updated Aug 5, 2024 • 181k • 100

lmstudio-community/gemma-2-2b-it-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 7.01k • 22

legraphista/gemma-2-2b-it-IMat-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 1.16k • 1

newsletter/gemma-2-2b-it-Q6_K-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 104

roshanai/gemma-2-2b-it-Q6_K-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 71 • 2

NikolayKozloff/gemma-2-2b-it-Q8_0-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 17 • 1

ac3xx/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 32

ac3xx/gemma-2-2b-it-Q6_K-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 20

Kondara/gemma-2-2b-it-Q8_0-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 5

Kondara/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 13

ironlanderl/gemma-2-2b-it-Q5_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 52

polyverse/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 196

second-state/gemma-2-2b-it-GGUF

Text Generation • 3B • Updated Aug 6, 2024 • 301 • 1

gaianet/gemma-2-2b-it-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 43

MaziyarPanahi/gemma-2-2b-it-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 56.7k • 14

mrmage/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 13

joehirstdev/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 14 • 1

mrmage/gemma-2-2b-it-Q3_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 24

qnixsynapse/Gemma-V2-2B-Instruct-GGUF

Text Generation • 3B • Updated Aug 13, 2024 • 19

cha9ro/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 14

wiktorwojcik112/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 29

Sovenok-Hacker/gemma-2-2b-it-Q4_0-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 49 • 1

mrmage/gemma-2-2b-it-Q2_K-GGUF

Text Generation • 3B • Updated Aug 5, 2024 • 8

mrmage/gemma-2-2b-it-IQ3_XXS-GGUF

Text Generation • 3B • Updated Aug 5, 2024 • 13

mrmage/gemma-2-2b-it-IQ3_M-GGUF

Text Generation • 3B • Updated Aug 5, 2024 • 35