---
title: QwenPaw-Flash-9B-heretic
canonical_url: "https://www.modelscope.ai/models/SC117/QwenPaw-Flash-9B-heretic"
md_url: "https://www.modelscope.ai/models/SC117/QwenPaw-Flash-9B-heretic.md"
repository: SC117/QwenPaw-Flash-9B-heretic
last_updated: 2026-10-04
license: other
pipeline_tag: text-generation
tasks:
  - text-generation
model_type:
  - qwen3_5
architectures:
  - Qwen3_5ForConditionalGeneration
base_model:
  - Qwen/Qwen3.5-9B
base_model_relation: finetune
parameters: 9.7B
tensor_type:
  - F32
  - BF16
library_name:
  - transformer
  - safetensors
  - pytorch
frameworks:
  - pytorch
language:
  - en
  - zh
downloads: 133
stars: 0
---

# QwenPaw-Flash-9B-heretic

> QwenPaw-Flash-9B-heretic - An open-source model by SC117 on ModelScope. GGUF Heretic QwenPaw-Flash-9B-heretic English | 📖 中文文档

SC117/QwenPaw-Flash-9B-heretic is a 9.7B-parameter text-generation model on ModelScope. licensed under other. derived from Qwen/Qwen3.5-9B.

- **Repository**: SC117/QwenPaw-Flash-9B-heretic
- **License**: other
- **Tasks**: text-generation
- **Parameters**: 9.7B
- **Base model**: Qwen/Qwen3.5-9B
- **Downloads**: 133
- **Stars**: 0
- **Last updated**: 2026-10-04

Source: https://www.modelscope.ai/models/SC117/QwenPaw-Flash-9B-heretic

---

<div style="background: #f5f5f7; border-radius: 20px; padding: 36px 32px; margin-bottom: 24px; text-align: center; position: relative; overflow: hidden; font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, sans-serif;">
<div style="position: absolute; top: -30px; right: -30px; width: 120px; height: 120px; background: #ffedd5; border-radius: 50%;"></div>
<div style="position: absolute; bottom: -20px; left: 40px; width: 80px; height: 80px; background: #fed7aa; border-radius: 50%;"></div>
<div style="position: absolute; top: 50%; left: -15px; width: 60px; height: 60px; background: #ffedd5; border-radius: 50%;"></div>
<div style="display: inline-flex; gap: 8px; margin-bottom: 16px; position: relative; z-index: 1;">
<span style="background: #007aff; color: white; font-size: 11px; font-weight: 600; padding: 5px 14px; border-radius: 20px;">GGUF</span>
<span style="background: #af52de; color: white; font-size: 11px; font-weight: 600; padding: 5px 14px; border-radius: 20px;">Heretic</span>
</div>
<h1 style="margin: 0 0 8px 0; font-size: 32px; font-weight: 700; color: #1d1d1f; letter-spacing: -0.5px; border: none; position: relative; z-index: 1;">QwenPaw-Flash-9B-heretic</h1>
<p style="margin: 8px 0 0 0; font-size: 14px; position: relative; z-index: 1;"><span style="color: #86868b;">English</span> | <a href="https://huggingface.co/SC117/QwenPaw-Flash-9B-heretic/blob/main/README_zh.md" style="color: #007aff; text-decoration: none;">📖 中文文档</a></p>
</div>

<div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02); margin-bottom: 20px;">
<div style="background: linear-gradient(135deg, #ff6b35 0%, #f7931e 100%); padding: 12px 16px; color: white; font-weight: 700; font-size: 14px; display: flex; align-items: center; gap: 8px;"><span>📌</span> Overview</div>
<div style="padding: 16px; font-size: 13px; color: #334155; line-height: 1.7;">
F32 safetensors of **QwenPaw-Flash-9B-heretic**, a 9B dense model fine-tuned with Heretic methodology on Qwen3.5-9B.
</div>
</div>
<div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02); margin-bottom: 20px;">
<div style="background: linear-gradient(135deg, #ff6b35 0%, #f7931e 100%); padding: 12px 16px; color: white; font-weight: 700; font-size: 14px; display: flex; align-items: center; gap: 8px;"><span>🧠</span> Model Details</div>
<div style="padding: 16px; font-size: 13px; color: #334155; line-height: 1.7;">
- **Base model**: Qwen3.5-9B
- **Precision**: F32 (float32 safetensors)
- **Parameters**: ~9B
- **Shards**: model-00001 ~ model-00008 (8 files, F32 main weights)
- **Additional**: model-00009 (BF16, Multi-Token Prediction head extracted from Qwen3.5-9B)
</div>
</div>
<div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02); margin-bottom: 20px;">
<div style="background: linear-gradient(135deg, #ff6b35 0%, #f7931e 100%); padding: 12px 16px; color: white; font-weight: 700; font-size: 14px; display: flex; align-items: center; gap: 8px;"><span>⚡</span> MTP (Multi-Token Prediction)</div>
<div style="padding: 16px; font-size: 13px; color: #334155; line-height: 1.7;">
`model-00009-of-00009.safetensors` contains the MTP head weights extracted from Qwen3.5-9B. MTP enables the model to predict multiple future tokens in a single forward pass, improving generation speed via speculative decoding.

- MTP acceptance rate: ~43%
- Speedup: ~1.5-1.9x decode throughput

For MTP-enabled GGUF inference, see the MTP GGUF repo below.
</div>
</div>
<div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02); margin-bottom: 20px;">
<div style="background: linear-gradient(135deg, #ff6b35 0%, #f7931e 100%); padding: 12px 16px; color: white; font-weight: 700; font-size: 14px; display: flex; align-items: center; gap: 8px;"><span>📦</span> GGUF Quantized Versions</div>
<div style="padding: 16px; font-size: 13px; color: #334155; line-height: 1.7;">
For inference with llama.cpp / Ollama / LM Studio, use the GGUF versions:

- **Standard GGUF** (no MTP): [SC117/QwenPaw-Flash-9B-heretic-GGUF](https://huggingface.co/SC117/QwenPaw-Flash-9B-heretic-GGUF)
- **MTP GGUF** (with Multi-Token Prediction head): [SC117/QwenPaw-Flash-9B-heretic-MTP-GGUF](https://huggingface.co/SC117/QwenPaw-Flash-9B-heretic-MTP-GGUF)
</div>
</div>
<div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02); margin-bottom: 20px;">
<div style="background: linear-gradient(135deg, #ff6b35 0%, #f7931e 100%); padding: 12px 16px; color: white; font-weight: 700; font-size: 14px; display: flex; align-items: center; gap: 8px;"><span>🚀</span> Usage</div>
<div style="padding: 16px; font-size: 13px; color: #334155; line-height: 1.7;">
```python
from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained(
    "SC117/QwenPaw-Flash-9B-heretic",
    torch_dtype=torch.float32,
    device_map="auto",
)
tokenizer = AutoTokenizer.from_pretrained("SC117/QwenPaw-Flash-9B-heretic")
```
</div>
</div>
<div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02); margin-bottom: 20px;">
<div style="background: linear-gradient(135deg, #ff6b35 0%, #f7931e 100%); padding: 12px 16px; color: white; font-weight: 700; font-size: 14px; display: flex; align-items: center; gap: 8px;"><span>📄</span> License</div>
<div style="padding: 16px; font-size: 13px; color: #334155; line-height: 1.7;">
Same as base model (Qwen3.5-9B).
</div>
</div>

<!-- SC117_SUPPORT_START -->
<div align="center">
  <a href="https://ko-fi.com/sc117">
    <img
      src="https://huggingface.co/SC117/Qwen3.8-Flash-Next-GSQ-RCO-abliterated-GGUF/resolve/main/assets/support-sc117.png"
      alt="Support SC117 on Ko-fi — support is optional and all releases remain freely available."
      width="100%"
    />
  </a>
</div>
<!-- SC117_SUPPORT_END -->