Skip to content

[MODEL] support Qwen3.8 Flash Next quantization - #3040

Merged
Qubitium merged 1 commit into
mainfrom
zx/qwen4-exp-support
Aug 31, 2026
Merged

[MODEL] support Qwen3.8 Flash Next quantization#3040
Qubitium merged 1 commit into
mainfrom
zx/qwen4-exp-support

Conversation

@ZX-ModelCloud

Copy link
Copy Markdown
Collaborator

Summary

  • add Qwen3.8 Flash Next / qwen4_exp quantization support for sparse attention, linear attention, shared experts, and routed experts
  • reuse the qwen4_exp_text checkpoint conversion mapping and materialize sharded PLE weights on CPU
  • preserve CPU-resident PLE during calibration replay and quantized checkpoint loading to avoid GPU OOM
  • add model registration, eval score coverage, focused unit tests, and README documentation

Tests

  • focused Qwen4-Exp, PLE lazy-load, and forward-placement tests: 10 passed
  • py_compile on all changed Python files
  • ruff check on the changed files, excluding pre-existing repository-wide E402, E701, and F541 findings

Depends on ModelCloud/Defuser#64.

@ZX-ModelCloud ZX-ModelCloud changed the title feat: support Qwen3.8 Flash Next quantization [MODEL] support Qwen3.8 Flash Next quantization Aug 31, 2026
@Qubitium
Qubitium merged commit 07e2bd1 into main Aug 31, 2026
6 checks passed
@Qubitium
Qubitium deleted the zx/qwen4-exp-support branch August 31, 2026 06:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants