juiceb0xc0de/bella-bartender-v2
Text Generation • 9B • Updated • 46
R
juiceb0xc0de
AI & ML interests
You can call me McDreamy M.D. I'll be your attending neural network brain surgeon.
Recent Activity
published a model 4 days ago
juiceb0xc0de/bella-bartender-v2 updated a dataset 6 days ago
juiceb0xc0de/qwen3-8b-base-atlas published a dataset 6 days ago
juiceb0xc0de/qwen3-8b-base-atlasOrganizations
published a
model 4 days ago
updated a
dataset 6 days ago
published a
dataset 6 days ago
updated a
dataset 7 days ago
Pending Access Request to Join HF Blog Explorers
6
#17 opened about 2 months ago
by 
AINovice2005
posted an update 7 days ago
Post
150
😅 You ever fumble on a project? Please someone tell me I'm not alone. I fumbled at step one and remained oblivious for the remainder of the project. Funny story, I was under the assumption that Qwen/Qwen3-8B was the base model that the paired with the Qwen SAE released by Alibaba. I didn't realize there was a Qwen3-8b-Base model until after the 12 hours of independent mapping techniques I had applied to the model that was missing the -Base suffix. 🤗 My bad, I'm just a bartender. I should not be unsupervised.
Not all is lost however. The outcome was a very in depth neural network atlas complete with its own SQLite queryable database for the Qwen3-8B model I can now share with you all. The data base combines these methods for a full in depth dive:
- Neuron Taxonomy
- Category Separation Scoring
- Co-activation Analysis
- Per-Head Decomposition
- Component Comparison
- Attribution Patching
- Sparse Non-negative Matrix Factorization
- NeuronLens
- DAS SVD rotation
- Cross-layer Coherence
- SQLite database
So if you've ever wondered where a specific behaviour or ability lives in the hidden dimensions of Qwen-8B or perhaps wanted to make informed quantization decisions please enjoy the fruits of my ill-informed labour lol. 😂
juiceb0xc0de/qwen3-8b-atlas
Qwen/Qwen3-8B
Not all is lost however. The outcome was a very in depth neural network atlas complete with its own SQLite queryable database for the Qwen3-8B model I can now share with you all. The data base combines these methods for a full in depth dive:
- Neuron Taxonomy
- Category Separation Scoring
- Co-activation Analysis
- Per-Head Decomposition
- Component Comparison
- Attribution Patching
- Sparse Non-negative Matrix Factorization
- NeuronLens
- DAS SVD rotation
- Cross-layer Coherence
- SQLite database
So if you've ever wondered where a specific behaviour or ability lives in the hidden dimensions of Qwen-8B or perhaps wanted to make informed quantization decisions please enjoy the fruits of my ill-informed labour lol. 😂
juiceb0xc0de/qwen3-8b-atlas
Qwen/Qwen3-8B
updated a
dataset 7 days ago
published a
dataset 7 days ago
updated a
dataset 7 days ago
published a
dataset 7 days ago
liked a
model 10 days ago
Apply for a GPU community grant: Personal project
🧠 1
#1 opened 11 days ago
by juiceb0xc0de
liked a
Space 11 days ago
upvoted a changelog 11 days ago
Hugging Face Changelog
Filter Models page by Base Models only
• 144
liked a
Space 11 days ago
updated a
Space 12 days ago
I applaud you in your journey into the void with small models. I too am deeply fascinated with the optimization of smaller models rather than asking for more parameters and terabytes of scraped internet data. I hope to see what you've come up with in a few weeks time.
I just finished designing a sparsity training scheduler that trains on average 35% of a models available weights with almost no hidden dimensions between transformers adjoined and zero throughput while randomizing trainable locations. It cuts VRAM and training time down and the models set higher benchmarks on mathematics than FFT models trained on the same corpus. I discovered this while fucking around for fun.
I don't doubt the discoveries to be made with training smaller architectures have many more surprises in store for us.
updated a
Space 12 days ago
replied to their post 12 days ago
@danielhanchen what happened to this magnificent model!? I had the perfect place to slot it in to my team of AI bros! I would love to see this back on HF. 🤗
liked a
Space 12 days ago