Repository navigation
AOCL-BLAS can now be selected as a vendor for the existing GGML_BLAS backend
#29789
pradeeptrgit
started this conversation in
Show and tell
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
AOCL-BLAS can now be selected as a vendor for the existing
GGML_BLASbackend.For inference on AMD CPUs, the ZenDNN backend remains the recommended path. This option is for people who want the generic BLAS backend linked against AOCL-BLAS. It applies to large prompt GEMMs. F32 weights go to
cblas_sgemm; other types are converted to F32 first.--list-devicesreports the device asBLAS: AOCL-BLAS.Build and run notes, including the
amd-libs.cfgsetup andBLAS_INCLUDE_DIRS, are in the docs:Change: #29640
All reactions