Foundation Text-Generation Models Below 360M Parameters - a Felladrin Collection

Felladrin 's Collections

Trained Models 🏋️

Frequently Used Spaces

Foundation Text-Generation Models Below 360M Parameters

Foundation Text-Generation Models Below 360M Parameters

updated May 22

Great candidates for fine-tuning targeting Wllama and Transformers.js for mobile devices, ordered by number of parameters.

HuggingFaceTB/SmolLM2-360M

Text Generation • 0.4B • Updated Feb 6, 2025 • 120k • 118

Note License: apache-2.0 Context Length: 8k
facebook/MobileLLM-R1-360M-base

Text Generation • 0.4B • Updated Nov 10, 2025 • 22 • 14

Note License: fair-noncommercial-research Context Length: 4k
PleIAs/Pleias-350m-Preview

0.4B • Updated Feb 14, 2025 • 8.67k • 27

Note License: apache-2.0 Context Length: 2k
OuteAI/Lite-Oute-1-300M

Text Generation • 0.3B • Updated Aug 24, 2024 • 32 • 9

Note License: apache-2.0 Context Length: 4k
keeeeenw/MicroLlama

Text Generation • 0.3B • Updated Aug 11, 2025 • 484 • 53

Note License: apache-2.0 Context Length: 2k
google/gemma-3-270m

Text Generation • 0.3B • Updated Aug 14, 2025 • 1.89M • 1.05k

Note License: gemma Context Length: 32k
UUFO-Aigis/Pico-OpenLAiNN-250M

0.3B • Updated 11 days ago • 22 • 3

Note License: apache-2.0 Context Length: 2k
upstage/TinySolar-248m-4k

Text Generation • 0.2B • Updated Feb 7, 2024 • 588 • 12

Note License: apache-2.0 Context Length: 4k
M4-ai/TinyMistral-248M-v3

Text Generation • 0.2B • Updated Oct 20, 2024 • 246 • 8

Note License: apache-2.0 Context Length: 2k
MiniLLM/MiniPLM-llama3.1-212M

Text Generation • 0.2B • Updated Mar 25, 2025 • 8 • 6

Note License: apache-2.0 Context Length: 1k
MiniLLM/MiniPLM-Qwen-200M

Text Generation • 0.2B • Updated Oct 27, 2024 • 256 • 9

Note License: apache-2.0 Context Length: 1k
xTimeCrystal/MiniModel-200M-Base

Text Generation • 0.2B • Updated Feb 23 • 130 • 30

Note License: apache-2.0 Context Length: 2k
princeton-nlp/Sheared-Pythia-160m

Text Generation • Updated Dec 4, 2023 • 79 • 4

Note License: apache-2.0 Context Length: 2k
JackFram/llama-160m

Text Generation • 0.2B • Updated Jan 4, 2024 • 279k • 37

Note License: apache-2.0 Context Length: 2k
SmallDoge/Doge-160M

Text Generation • 0.2B • Updated Aug 8, 2025 • 46 • 7

Note License: apache-2.0 Context Length: 2k
EleutherAI/pythia-160m

Text Generation • 0.2B • Updated Jul 9, 2023 • 2.35M • 44

Note License: apache-2.0 Context Length: 2k
facebook/MobileLLM-R1-140M-base

Text Generation • 0.1B • Updated Nov 10, 2025 • 126 • 19

Note License: fair-noncommercial-research Context Length: 4k
openai-community/gpt2

Text Generation • 0.1B • Updated Feb 19, 2024 • 14M • 3.37k

Note License: mit Context Length: 1k
HuggingFaceTB/SmolLM2-135M

Text Generation • 0.1B • Updated Feb 6, 2025 • 1.63M • 217

Note License: apache-2.0 Context Length: 8k
amd/AMD-Llama-135m

Text Generation • 0.1B • Updated Oct 9, 2024 • 5.21k • 120

Note License: apache-2.0 Context Length: 2k
MiniLLM/MiniPLM-Mamba-130M

Text Generation • 0.1B • Updated Mar 25, 2025 • 17 • 4

Note License: apache-2.0 Context Length: 1k
Nikity/lille-130m-base

Text Generation • 0.1B • Updated Sep 4, 2025 • 117 • 17

Note License: apache-2.0 Context Length: 0.5k
EleutherAI/gpt-neo-125m

Text Generation • 0.2B • Updated Jan 31, 2024 • 323k • 228

Note License: mit Context Length: 2k
BEE-spoke-data/smol_llama-101M-GQA

Text Generation • 0.1B • Updated Dec 29, 2025 • 479 • 33

Note License: apache-2.0 Context Length: 1k
UUFO-Aigis/Pico-OpenLAiNN-100M

0.1B • Updated 11 days ago • 36 • 1

Note License: apache-2.0 Context Length: 2k
raincandy-u/Rain-100M

Text Generation • 97.2M • Updated Jan 24 • 30 • 18

Note License: apache-2.0 Context Length: 4k
Felladrin/Qwen2-96M

Text Generation • 96.2M • Updated Mar 15, 2025 • 14 • 3

Note License: apache-2.0 Context Length: 8k
Felladrin/Minueza-2-96M

Text Generation • 96M • Updated Apr 5, 2025 • 18 • 6

Note License: apache-2.0 Context Length: 4k
distilbert/distilgpt2

Text Generation • 88.2M • Updated Feb 19, 2024 • 2.72M • 635

Note License: apache-2.0 Context Length: 1k
weiser/82M-0.4

Text Generation • 82.1M • Updated Nov 12, 2024 • 9

Note License: apache-2.0 Context Length: 1k
BEE-spoke-data/smol_llama-81M-tied

Text Generation • 81.3M • Updated Dec 29, 2025 • 120 • 10

Note License: apache-2.0 Context Length: 1k
EleutherAI/pythia-70m

95.6M • Updated Nov 21, 2023 • 565k • 85

Note License: apache-2.0 Context Length: 2k
JackFram/llama-68m

Text Generation • Updated Jun 5 • 128k • 38

Note License: apache-2.0 Context Length: 2k
OuteAI/Lite-Oute-1-65M

Text Generation • 65M • Updated Aug 25, 2024 • 16 • 12

Note License: apache-2.0 Context Length: 2k
SmallDoge/Doge-60M

Text Generation • 54.6M • Updated Aug 8, 2025 • 125 • 5

Note License: apache-2.0 Context Length: 2k
SupraLabs/Supra-50M-Base

Text Generation • 51.8M • Updated May 27 • 1.1k • 35

Note License: apache-2.0 Context Length: 1k
Felladrin/Minueza-32M-Base

Text Generation • 32.8M • Updated Apr 6, 2025 • 782 • 19

Note License: apache-2.0 Context Length: 2k
GerbilLab/Gerbil-A-32m

Text Generation • Updated Mar 30, 2023 • 6 • 2

Note License: apache-2.0 Context Length: 2k
EleutherAI/pythia-31m-deduped

Text Generation • 55.7M • Updated Feb 12 • 2.03k • 5

Note License: apache-2.0 Context Length: 2k
SmallDoge/Doge-20M

Text Generation • 13.1M • Updated Jun 25, 2025 • 840 • 13

Note License: apache-2.0 Context Length: 2k
EleutherAI/pythia-14m-deduped

Text Generation • 39.2M • Updated Feb 12 • 8.1k • 30

Note License: apache-2.0 Context Length: 2k