Jon Spencer was primarily known throughout the 1990s and early 2000s as the wild frontman of noise-punks Pussy Galore and then the garage-rock revivalists Jon Spencer Blues Explosion. Guitarist Matt Verta-Ray was known from stints with Madder Rose and Speedball Baby. In 2005, the two combined their mutual love of American roots and blues music to form the rockabilly duo Heavy Trash. Their first, self-titled album was released in 2005 on the Yep Roc label, with GOING WAY OUT WITH TRASH on its heels in 2007.