"Burn the Witch" is the third single released from Queens of the Stone Age's fourth album, Lullabies to Paralyze. Many of its lyrics run parallel with the dark, folkloristic theme for this album. It has been introduced by Josh Homme when played live as his favorite current song. Along with "You've Got a Killer Scene There, Man...", it borrows heavily from the blues, probably because ZZ Top's guitarist and singer Billy Gibbons appears on lead guitar and backup vocals. Gibbons also plays on a cover of his own band's "Precious and Grace", a bonus track on the album.