Skip to content

Avoid unused quantized SDPA scratch allocation - #22417

Draft
JacobSzwejbka wants to merge 1 commit into
perf/cpu-ring-attention-mask-skippingfrom
perf/cpu-sdpa-quant-scratch-allocation
Draft

Avoid unused quantized SDPA scratch allocation#22417
JacobSzwejbka wants to merge 1 commit into
perf/cpu-ring-attention-mask-skippingfrom
perf/cpu-sdpa-quant-scratch-allocation

Allocate quantized SDPA scratch only when needed

64cb0bc
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar