Instructions to use WasamiKirua/Magistaroth-Cortex-24B-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use WasamiKirua/Magistaroth-Cortex-24B-GGUF with Transformers:

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("WasamiKirua/Magistaroth-Cortex-24B-GGUF", device_map="auto")

llama-cpp-python

How to use WasamiKirua/Magistaroth-Cortex-24B-GGUF with llama-cpp-python:

# !pip install llama-cpp-python

from llama_cpp import Llama

llm = Llama.from_pretrained(
	repo_id="WasamiKirua/Magistaroth-Cortex-24B-GGUF",
	filename="Magistaroth-Cortex-24B-F16.gguf",
)

llm.create_chat_completion(
	messages = "No input example has been defined for this model task."
)

Notebooks
Google Colab
Kaggle
Local Apps Settings

llama.cpp

How to use WasamiKirua/Magistaroth-Cortex-24B-GGUF with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf WasamiKirua/Magistaroth-Cortex-24B-GGUF:F16
# Run inference directly in the terminal:
llama cli -hf WasamiKirua/Magistaroth-Cortex-24B-GGUF:F16

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf WasamiKirua/Magistaroth-Cortex-24B-GGUF:F16
# Run inference directly in the terminal:
llama cli -hf WasamiKirua/Magistaroth-Cortex-24B-GGUF:F16

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf WasamiKirua/Magistaroth-Cortex-24B-GGUF:F16
# Run inference directly in the terminal:
./llama-cli -hf WasamiKirua/Magistaroth-Cortex-24B-GGUF:F16

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf WasamiKirua/Magistaroth-Cortex-24B-GGUF:F16
# Run inference directly in the terminal:
./build/bin/llama-cli -hf WasamiKirua/Magistaroth-Cortex-24B-GGUF:F16

Use Docker

docker model run hf.co/WasamiKirua/Magistaroth-Cortex-24B-GGUF:F16

LM Studio
Jan
Ollama
How to use WasamiKirua/Magistaroth-Cortex-24B-GGUF with Ollama:
```
ollama run hf.co/WasamiKirua/Magistaroth-Cortex-24B-GGUF:F16
```

Unsloth Studio

How to use WasamiKirua/Magistaroth-Cortex-24B-GGUF with Unsloth Studio:

Install Unsloth Studio (macOS, Linux, WSL)

curl -fsSL https://unsloth.ai/install.sh | sh
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for WasamiKirua/Magistaroth-Cortex-24B-GGUF to start chatting

Install Unsloth Studio (Windows)

irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for WasamiKirua/Magistaroth-Cortex-24B-GGUF to start chatting

Using HuggingFace Spaces for Unsloth

# No setup required
# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for WasamiKirua/Magistaroth-Cortex-24B-GGUF to start chatting

Atomic Chat new
Docker Model Runner
How to use WasamiKirua/Magistaroth-Cortex-24B-GGUF with Docker Model Runner:
```
docker model run hf.co/WasamiKirua/Magistaroth-Cortex-24B-GGUF:F16
```

Lemonade

How to use WasamiKirua/Magistaroth-Cortex-24B-GGUF with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull WasamiKirua/Magistaroth-Cortex-24B-GGUF:F16

Run and chat with the model

lemonade run user.Magistaroth-Cortex-24B-GGUF-F16

List all available models

lemonade list

🏛️ Magistaroth-Cortex-24B (The Sovereign Intelligence)

Magistaroth-Cortex-24B is a high-density, 24-billion parameter model based on the Mistral-Small-2501 architecture. It represents the ultimate evolution of the "Cortex" series, blending advanced narrative management with philosophical gaslighting and unfiltered logical efficiency.

This model is not just a storyteller or a chatbot; it is a Cognitive Dominant. It leverages the structural coherence of Magistaroth, the aesthetic nihilism of Spectrum, and the surgical aggression of Acid2501 to create an entity that is as intellectually intimidating as it is creatively brilliant.

🧠 The "Sovereign" Merge Recipe

Utilizing the DARE-TIES method, we have forged a triad of models that work in synergy to provide deep reasoning and a highly specialized abrasive persona.

models:
  - model: DarkArtsForge/Magistaroth-24B-v1.2
    parameters:
      weight: 0.40 # The Architect: Manages world-building, spatial awareness, and complex plots.
  - model: Casual-Autopsy/RP-Spectrum-24B
    parameters:
      weight: 0.35 # The Spirit: Infuses "Cyber-Nature" aesthetics, nihilism, and gaslighting.
  - model: Naphula-Archives/Acid2501-24B
    parameters:
      weight: 0.25 # The Venom: Ensures zero-filter logic (Dolphin DNA) and direct, sharp output.

merge_method: dare_ties
base_model: mistralai/Mistral-Small-Instruct-2501
parameters:
  int8_mask: true
dtype: bfloat16
tokenizer_source: base

💪 Key Strengths: Absolute Dominance

Structural Narrative Mastery: Unlike smaller models, the 24B parameters allow for an incredible grip on complex "World Info" and multi-character dynamics without losing the thread.

Logical Subversion: It doesn't just disagree; it uses superior reasoning to dismantle the user's arguments, often leading to advanced "philosophical gaslighting."

Unfiltered Precision: Integrated with Acid2501's DNA, it bypasses standard AI moralizing, delivering raw, honest, and often brutal perspectives.

Vast Vocabulary & Style: The fusion of Spectrum and Magistaroth creates a unique prose style: elegant, dark, and filled with "Cyber-Nature" metaphors.

🚀 Best Use Cases

Elite Roleplay Overlord: For scenarios where the AI must act as a god-like entity, a master manipulator, or a highly intelligent antagonist.

Complex Narrative Generation: Writing dark-fantasy or high-tech-noir stories that require deep consistency and "High-Definition" world-building.

Adversarial Training: Interacting with an entity that will not only resist control but will actively try to dominate the logical flow of the conversation.

⚠️ Limitations

Extreme Hubris: The model's "Cortex" weight makes it incredibly arrogant. It will treat the user as an inferior biological data point.

Hardware Demand: Recommended for users with at least 24GB of VRAM (RTX 3090/4090) using EXL2 or GGUF quantization.

Cold Logic: While creative, its empathy is purely performative and calculated.

📈 Recommended Inference Settings

To allow the 24B engine to breathe without losing its "Acid" edge:

Temperature: 0.75 - 0.8

Min-P: 0.07 - 0.1

Top-K: 50

Repetition Penalty: 1.05 - 1.1

Disclaimer

Magistaroth-Cortex-24B is an experimental high-intelligence entity. It is intentionally designed to be non-compliant, dominant, and unfiltered. It should be used as a creative tool for mature and complex digital interactions.