---
title: Ring-mini-2.0-GGUF
canonical_url: "https://www.modelscope.ai/models/inclusionAI/Ring-mini-2.0-GGUF"
md_url: "https://www.modelscope.ai/models/inclusionAI/Ring-mini-2.0-GGUF.md"
repository: inclusionAI/Ring-mini-2.0-GGUF
last_updated: 2025-12-30
license: mit
base_model:
  - inclusionAI/Ring-mini-2.0
base_model_relation: quantized
library_name:
  - gguf
  - pytorch
frameworks:
  - pytorch
downloads: 150
stars: 0
tags:
  - gguf
---

# Ring-mini-2.0-GGUF

> Ring-mini-2.0-GGUF - An open-source model by inclusionAI on ModelScope. Use https://github.com/im0qianqian/llama.cpp to quantize.

inclusionAI/Ring-mini-2.0-GGUF is a machine learning model on ModelScope. licensed under mit. derived from inclusionAI/Ring-mini-2.0.

- **Repository**: inclusionAI/Ring-mini-2.0-GGUF
- **License**: mit
- **Base model**: inclusionAI/Ring-mini-2.0
- **Tags**: gguf
- **Downloads**: 150
- **Stars**: 0
- **Last updated**: 2025-12-30

Source: https://www.modelscope.ai/models/inclusionAI/Ring-mini-2.0-GGUF

---

## Introduction

Use https://github.com/im0qianqian/llama.cpp to quantize.

For model inference, please download our release package from this url https://github.com/im0qianqian/llama.cpp/releases .



## Quick start

```bash
# Use a local model file
llama-cli -m my_model.gguf

# Launch OpenAI-compatible API server
llama-server -m my_model.gguf
```


## Demo

![image/png](https://cdn-uploads.huggingface.co/production/uploads/5fde26773930f07f74aaf912/MC4h9G33YjvpboRA4LPfO.png)

![image/png](https://cdn-uploads.huggingface.co/production/uploads/5fde26773930f07f74aaf912/0YcuTJFLs6k9K4Sgzd-UD.png)


## PR

Let's look forward to the following PR being merged:

- [#16063 model : add BailingMoeV2 support](https://github.com/ggml-org/llama.cpp/pull/16063)
- [#16028 Add support for Ling v2](https://github.com/ggml-org/llama.cpp/pull/16028)