Search results

[BUG] "cu_seqlens_q must be on CUDA"

bugSomething isn't workingSomething isn't working

Status: Open.

#1943 In ModelCloud/GPTQModel;

· capybarahero opened on Sep 28, 2025

Support the lm_head of QWEN2.5_OMNI？

Status: Open.

#1841 In ModelCloud/GPTQModel;

· LiMa-cas opened on Sep 22, 2025

Voxtral supported?

model

on-hold

Status: Open.

#1700 In ModelCloud/GPTQModel;

· Nortinwell opened on Aug 21, 2025

[FEATURE] Add FOEM Support

Status: Open.

Feature

#1678 In ModelCloud/GPTQModel;

· sankexin opened on Aug 13, 2025

GPTQV2 for DeepSeekV3

Status: Open.

#1676 In ModelCloud/GPTQModel;

· QingshuiL opened on Aug 12, 2025

[BUG] Tensor mismatch on a lot of models

bugSomething isn't workingSomething isn't working

Status: Open.

#1668 In ModelCloud/GPTQModel;

· AyanJhunjhunwala opened on Aug 3, 2025

TextSummarizationTask module not found

Status: Open.

#1659 In ModelCloud/GPTQModel;

· TianL123 opened on Jul 17, 2025

[BUG] Gemma 3 4b quantization outputs multi-modal config despite it being text only

bugSomething isn't workingSomething isn't working

Status: Open.

#1655 In ModelCloud/GPTQModel;

· ethan-tonic opened on Jul 9, 2025

Quantized QQQ models encountered configuration field exceptions and inference garbled text issues when deployed in vLLM 0.9.1.

Status: Open.

#1654 In ModelCloud/GPTQModel;

· ShiningMaker opened on Jul 9, 2025

[BUG] GPTQ-quantized OVIS 1B model yields poor performance & misaligned outputs in vLLM-0.9.1

bugSomething isn't workingSomething isn't working

Status: Open.

#1653 In ModelCloud/GPTQModel;

· AstonyJ opened on Jul 9, 2025

Feature: Add FSDP Peft/Lora finetuning sample

Status: Open.

#1648 In ModelCloud/GPTQModel;

· Qubitium opened on Jul 3, 2025

Kernels can not be built when I use pip install -v gptqmodel --no-build-isolation

Status: Open.

#1639 In ModelCloud/GPTQModel;

· BUGBOY101 opened on Jul 1, 2025