--- base_model: - ApocalypseParty/G4-31B-ASFT-Test-1 - llmfan46/G4-MeroMero-31B-uncensored-heretic - google/gemma-4-31B-it - ApocalypseParty/G4-31B-SFT-v3-1-1ep library_name: transformers tags: - mergekit - merge --- # G4-31B-configA1 This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [google/gemma-4-31B-it](https://huggingface.co/google/gemma-4-31B-it) as a base. ### Models Merged The following models were included in the merge: * [ApocalypseParty/G4-31B-ASFT-Test-1](https://huggingface.co/ApocalypseParty/G4-31B-ASFT-Test-1) * [llmfan46/G4-MeroMero-31B-uncensored-heretic](https://huggingface.co/llmfan46/G4-MeroMero-31B-uncensored-heretic) * [ApocalypseParty/G4-31B-SFT-v3-1-1ep](https://huggingface.co/ApocalypseParty/G4-31B-SFT-v3-1-1ep) ### Configuration The following YAML configuration was used to produce this model: ```yaml merge_method: ties base_model: google/gemma-4-31B-it models: - model: ApocalypseParty/G4-31B-ASFT-Test-1 parameters: weight: 1.0 density: 0.8 - model: ApocalypseParty/G4-31B-SFT-v3-1-1ep parameters: weight: 0.5 density: 0.25 - model: llmfan46/G4-MeroMero-31B-uncensored-heretic parameters: weight: 0.7 density: 0.6 parameters: normalize: true dtype: bfloat16 ```