Leanstral-1.5-119B-A6B imatrix Quants

#2663
by wa999 - opened

I guess that's a no?

This model requires conversion before it can be quanted.

hey, it requires manual handling so might take a bit of time, unless someone can provide a link for llamacpp compatible version so I can queue it like a normal model

https://huggingface.co/sahilchachra/Leanstral-1.5-119B-A6B-BF16 may work as it has been converted to Huggingface format.

fix the config to comply with standard please:
sahilchachra/Leanstral-1.5-119B-A6B-BF16: no architectures entry ()

@sahilchachra can you do this please?

Sign up or log in to comment