Skip to content

sycl: dequantize PTQ1_0 and PQ2_0 prompt batches to FP16 (2-3x prompt processing) - #5

Closed
dwymark wants to merge 2 commits into
prismfrom
fp16-prompt-gemm
Closed

sycl: dequantize PTQ1_0 and PQ2_0 prompt batches to FP16 (2-3x prompt processing)#5
dwymark wants to merge 2 commits into
prismfrom
fp16-prompt-gemm

sycl: state the FP16 prompt GEMM rationale in the comment

bd26f01
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar