---
title: Gemma-4-12B-it-heretic
canonical_url: "https://www.modelscope.ai/models/SC117/Gemma-4-12B-it-heretic"
md_url: "https://www.modelscope.ai/models/SC117/Gemma-4-12B-it-heretic.md"
repository: SC117/Gemma-4-12B-it-heretic
last_updated: 2026-10-04
license: apache-2.0
model_type:
  - gemma4_unified
architectures:
  - Gemma4UnifiedForConditionalGeneration
base_model:
  - google/gemma-4-12B-it
base_model_relation: finetune
parameters: 12.0B
tensor_type:
  - F16
library_name:
  - transformer
  - safetensors
  - pytorch
frameworks:
  - pytorch
language:
  - en
  - zh
downloads: 136
stars: 0
tags:
  - heretic
  - abliteration
  - uncensored
  - gemma4
  - safetensors
  - multimodal
  - vision
  - audio
---

# Gemma-4-12B-it-heretic

> Gemma-4-12B-it-heretic - An open-source model by SC117 on ModelScope. Safetensors Heretic Multimodal Gemma-4-12B-it-heretic English

SC117/Gemma-4-12B-it-heretic is a 12.0B-parameter machine learning model on ModelScope. licensed under apache-2.0. derived from google/gemma-4-12B-it.

- **Repository**: SC117/Gemma-4-12B-it-heretic
- **License**: apache-2.0
- **Parameters**: 12.0B
- **Base model**: google/gemma-4-12B-it
- **Tags**: heretic, abliteration, uncensored, gemma4, safetensors, multimodal, vision, audio
- **Downloads**: 136
- **Stars**: 0
- **Last updated**: 2026-10-04

Source: https://www.modelscope.ai/models/SC117/Gemma-4-12B-it-heretic

---

<div style="font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, sans-serif; margin-bottom: 30px;">
<div style="background: #f5f5f7; border-radius: 20px; padding: 36px 32px; margin-bottom: 20px; text-align: center; position: relative; overflow: hidden;">
  <div style="position: absolute; top: -30px; right: -30px; width: 120px; height: 120px; background: #dbeafe; border-radius: 50%;"></div>
  <div style="position: absolute; bottom: -20px; left: 40px; width: 80px; height: 80px; background: #bfdbfe; border-radius: 50%;"></div>
  <div style="position: absolute; top: 50%; left: -15px; width: 60px; height: 60px; background: #dbeafe; border-radius: 50%;"></div>
  <div style="display: inline-flex; gap: 8px; margin-bottom: 16px; position: relative; z-index: 1;">
    <span style="background: #2563eb; color: white; font-size: 11px; font-weight: 600; padding: 5px 14px; border-radius: 20px;">Safetensors</span>
    <span style="background: #7c3aed; color: white; font-size: 11px; font-weight: 600; padding: 5px 14px; border-radius: 20px;">Heretic</span>
    <span style="background: #059669; color: white; font-size: 11px; font-weight: 600; padding: 5px 14px; border-radius: 20px;">Multimodal</span>
  </div>
  <h1 style="margin: 0 0 8px 0; font-size: 32px; font-weight: 700; color: #1d1d1f; letter-spacing: -0.5px; border: none; position: relative; z-index: 1;">Gemma-4-12B-it-heretic</h1>
<p style="margin: 8px 0 0 0; font-size: 14px; position: relative; z-index: 1;"><span style="color: #86868b;">English</span> 
</div>
</div>

<div style="font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, sans-serif; display: flex; flex-direction: column; gap: 20px; margin-bottom: 30px;">
    <div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02);">
      <div style="padding: 16px;">
<p style="margin: 0 0 12px 0; font-size: 13px; color: #334155; line-height: 1.7;"><p align="center"></p>
<p style="margin: 0 0 12px 0; font-size: 13px; color: #334155; line-height: 1.7;"><b>🧠 Uncensored · Encoder-Free Multimodal · Vision + Audio</b><br></p>
<p style="margin: 0 0 12px 0; font-size: 13px; color: #334155; line-height: 1.7;"></p></p>
<p style="margin: 0 0 12px 0; font-size: 13px; color: #334155; line-height: 1.7;">Uncensored version of <b>Google Gemma 4 12B IT</b>, processed with <a href="https://github.com/p-e-w/heretic" target="_blank" style="color: #c2410c; text-decoration: none; font-weight: 700;">Heretic</a> ARA+LoRA abliteration. F32 safetensors format for direct use with Transformers.</p>
<p style="margin: 0 0 12px 0; font-size: 13px; color: #334155; line-height: 1.7;"><b>Base model</b>: <a href="https://huggingface.co/google/gemma-4-12B-it" target="_blank" style="color: #c2410c; text-decoration: none; font-weight: 700;">google/gemma-4-12B-it</a> · <b>Parameters</b>: 11.95B · <b>Layers</b>: 48 · <b>Context</b>: 256K · <b>Vocab</b>: 262K</p>
      </div>
    </div>
    <div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02);">
      <div style="background: linear-gradient(135deg, #2563eb 0%, #3b82f6 100%); padding: 12px 16px; color: white; font-weight: 700; font-size: 14px; display: flex; align-items: center; gap: 8px;"><span>📦</span> Files</div>
      <div style="padding: 16px;">
<table style="width: 100%; border-collapse: collapse; font-size: 13px;"><thead><tr style="background: rgba(37,99,235,0.05);">
<th style="padding: 8px 10px; border-bottom: 2px solid #2563eb; text-align: left; color: #1d4ed8; font-weight: bold;">File</th>
<th style="padding: 8px 10px; border-bottom: 2px solid #2563eb; text-align: left; color: #1d4ed8; font-weight: bold;">Size</th>
<th style="padding: 8px 10px; border-bottom: 2px solid #2563eb; text-align: left; color: #1d4ed8; font-weight: bold;">Description</th>
</tr></thead><tbody>
<tr>
<td style="padding: 7px 10px; border-bottom: 1px solid rgba(128,128,128,0.15); color: #334155; text-align: left;">model.safetensors</td>
<td style="padding: 7px 10px; border-bottom: 1px solid rgba(128,128,128,0.15); color: #334155; text-align: left;">23 GB</td>
<td style="padding: 7px 10px; border-bottom: 1px solid rgba(128,128,128,0.15); color: #334155; text-align: left;">F16 model weights</td>
</tr>
<tr>
<td style="padding: 7px 10px; border-bottom: 1px solid rgba(128,128,128,0.15); color: #334155; text-align: left;">config.json</td>
<td style="padding: 7px 10px; border-bottom: 1px solid rgba(128,128,128,0.15); color: #334155; text-align: left;">4.4 KB</td>
<td style="padding: 7px 10px; border-bottom: 1px solid rgba(128,128,128,0.15); color: #334155; text-align: left;">Model config</td>
</tr>
<tr>
<td style="padding: 7px 10px; border-bottom: 1px solid rgba(128,128,128,0.15); color: #334155; text-align: left;">tokenizer.json</td>
<td style="padding: 7px 10px; border-bottom: 1px solid rgba(128,128,128,0.15); color: #334155; text-align: left;">31 MB</td>
<td style="padding: 7px 10px; border-bottom: 1px solid rgba(128,128,128,0.15); color: #334155; text-align: left;">Tokenizer</td>
</tr>
<tr>
<td style="padding: 7px 10px; border-bottom: 1px solid rgba(128,128,128,0.15); color: #334155; text-align: left;">tokenizer_config.json</td>
<td style="padding: 7px 10px; border-bottom: 1px solid rgba(128,128,128,0.15); color: #334155; text-align: left;">2.8 KB</td>
<td style="padding: 7px 10px; border-bottom: 1px solid rgba(128,128,128,0.15); color: #334155; text-align: left;">Tokenizer config</td>
</tr>
<tr>
<td style="padding: 7px 10px; border-bottom: 1px solid rgba(128,128,128,0.15); color: #334155; text-align: left;">generation_config.json</td>
<td style="padding: 7px 10px; border-bottom: 1px solid rgba(128,128,128,0.15); color: #334155; text-align: left;">273 B</td>
<td style="padding: 7px 10px; border-bottom: 1px solid rgba(128,128,128,0.15); color: #334155; text-align: left;">Generation config</td>
</tr>
<tr>
<td style="padding: 7px 10px; border-bottom: 1px solid rgba(128,128,128,0.15); color: #334155; text-align: left;">chat_template.jinja</td>
<td style="padding: 7px 10px; border-bottom: 1px solid rgba(128,128,128,0.15); color: #334155; text-align: left;">18 KB</td>
<td style="padding: 7px 10px; border-bottom: 1px solid rgba(128,128,128,0.15); color: #334155; text-align: left;">Chat template</td>
</tr>
</tbody></table>
      </div>
    </div>
    <div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02);">
      <div style="background: linear-gradient(135deg, #7c3aed 0%, #a855f7 100%); padding: 12px 16px; color: white; font-weight: 700; font-size: 14px; display: flex; align-items: center; gap: 8px;"><span>📦</span> GGUF Quantized Versions</div>
      <div style="padding: 16px;">
<p style="margin: 0 0 12px 0; font-size: 13px; color: #334155; line-height: 1.7;">For inference with llama.cpp / Ollama / LM Studio, use the GGUF versions:</p>
<p style="margin: 0 0 12px 0; font-size: 13px; color: #334155; line-height: 1.7;">• <a href="https://huggingface.co/SC117/Gemma-4-12B-it-heretic-GGUF" target="_blank" style="color: #c2410c; text-decoration: none; font-weight: 700;">SC117/Gemma-4-12B-it-heretic-GGUF</a> — Q4_K_M / Q6_K / Q8_0 / F16</p>
      </div>
    </div>
    <div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02);">
      <div style="background: linear-gradient(135deg, #ea580c 0%, #f97316 100%); padding: 12px 16px; color: white; font-weight: 700; font-size: 14px; display: flex; align-items: center; gap: 8px;"><span>🚀</span> Usage</div>
      <div style="padding: 16px;">
<p style="margin: 0 0 12px 0; font-size: 13px; color: #334155; line-height: 1.7;"></p>
<pre style="background: #1e293b; color: #e2e8f0; padding: 16px; border-radius: 8px; overflow-x: auto; font-size: 12px; line-height: 1.5;"><code>from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained(
    "SC117/Gemma-4-12B-it-heretic",
    torch_dtype=torch.float32,
    device_map="auto",
)
tokenizer = AutoTokenizer.from_pretrained("SC117/Gemma-4-12B-it-heretic")</code></pre>
      </div>
    </div>
    <div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02);">
      <div style="background: linear-gradient(135deg, #4b5563 0%, #6b7280 100%); padding: 12px 16px; color: white; font-weight: 700; font-size: 14px; display: flex; align-items: center; gap: 8px;"><span>📝</span> Notes</div>
      <div style="padding: 16px;">
<p style="margin: 0 0 12px 0; font-size: 13px; color: #334155; line-height: 1.7;">• This is an <b>abliterated</b> (uncensored) model. It may produce content that the original model would refuse. Use responsibly.</p>
<p style="margin: 0 0 12px 0; font-size: 13px; color: #334155; line-height: 1.7;">• Original model: <a href="https://huggingface.co/google/gemma-4-12B-it" target="_blank" style="color: #c2410c; text-decoration: none; font-weight: 700;">google/gemma-4-12B-it</a> (Apache 2.0)</p>
      </div>
    </div>
</div>
</div>

<!-- SC117_SUPPORT_START -->
<div align="center">
  <a href="https://ko-fi.com/sc117">
    <img
      src="https://huggingface.co/SC117/Qwen3.8-Flash-Next-GSQ-RCO-abliterated-GGUF/resolve/main/assets/support-sc117.png"
      alt="Support SC117 on Ko-fi — support is optional and all releases remain freely available."
      width="100%"
    />
  </a>
</div>
<!-- SC117_SUPPORT_END -->
