One of Us, by Joan Osbourne. Prince did a cover of this on his Emancipation album, and made it sound much, much better than the original.
"Recently, we've been somewhat volatile
And last night it starts with that Joan Osbourne song
I hate it anyway but you made it worse" Arab Strap - Soaps
- Butthole Surfers (originally Donovan)
Touch Me I'm Sick
- Sonic Youth (originally Mudhoney, Sonic Youth only narrowly edges it out)
- Butthole Surfers (originally "Sweet Leaf" by Black Sabbath, for the lulz)