All three have publicly released code (GitHub links are in the “Code & Resources” section of each paper).
The name is used in a handful of recent works that aim at sparse attention patterns while preserving causal (autoregressive) constraints. The two most cited papers are: perverformer scat
The origins of scat singing date back to the early 20th century, when jazz musicians began experimenting with vocal improvisations. One of the earliest recorded examples of scat singing is by Louis Armstrong in the 1920s. However, it's believed that scat singing existed in various forms before its popularity in jazz. All three have publicly released code (GitHub links
Scat singing, also known as scat, is a vocal improvisation technique used by musicians to create melodic lines with their voices, often in a jazz or swing context. This unique skill has been a staple of jazz music for decades, with legendary performers like Louis Armstrong, Ella Fitzgerald, and John Coltrane showcasing their scat singing abilities. One of the earliest recorded examples of scat