Support vLLM v0.28 accelerator memory APIs - #104
Merged
yeahdongcn merged 5 commits intoAug 20, 2026
Conversation
Collaborator
|
@lijing-mt Please be aware of this issue. |
yeahdongcn
reviewed
Aug 20, 2026
Collaborator
|
S5000 merge-readiness validation completed at head |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
torch.accelerator.get_memory_info()totorch.musa.mem_get_info()only on torch_musa versions before2.11.0.post2. The version check strips the local+musa...suffix so post2 and later keep the fixed unified accelerator implementation; missing or malformed versions conservatively retain the workaround.0.1.83across package metadata, runtime version, tests, benchmark history, and documentation.Validation
S5000 / torch_musa 2.11 post1
4357d66fb3f4e8128ae800cf28740294c65a69f3sh-harbor.mthreads.com/mcctest/vllm:v0.24.0-ph1-5.2.0-torch2.11.0.post1-20260820sha256:c9b7268be71cbba113696006fd84b139d7a3a0f7d1ac21b141b1631e2831e67a5.2.0-server2.11.0.post1+musa5.2.0, torchada0.1.83torch.accelerator.get_memory_info()reproducedNotImplementedError: getMemoryInfo is not implemented for this allocator yet; the PR candidate passed and resolved it totorch.musa.mem_get_info.empty_host_cachewas absent from both modules. A real 16 MiB MUSA allocation was reflected bymemory_allocated,memory_stats, peak/reset APIs,empty_cache,synchronize, andget_memory_info.get_memory_infopassed withNone, integer, string, andtorch.devicearguments. Same-name and remapped fallback behavior also passed when the official accelerator API was absent.40 passedwith no skips.test_inplace_porting.py,test_platform.py):26 passed.465 passed, 19 skipped, 11 warningsin 55.43s.Other validation
2.11.0.post2wheel is available.Scope note: this compatibility layer wraps the top-level
torch.accelerator.*API used by vLLM. The separatetorch.accelerator.memory.*submodule is outside this PR's scope.