Skip to content

Support fine-tuning released DFlash/DSpark drafters (causal SWA, attention sink, warm start) - #2149

Draft
h-guo18 wants to merge 6 commits into
mainfrom
feat/dspark-causal-swa-sink
Draft

Support fine-tuning released DFlash/DSpark drafters (causal SWA, attention sink, warm start)#2149
h-guo18 wants to merge 6 commits into
mainfrom
feat/dspark-causal-swa-sink