"All the Right Friends" is one of the earliest songs written by R.E.M., in fact written by Peter Buck and Michael Stipe before they had met their future bandmates, according to the liner notes to the band's In Time compilation album. Like all R.E.M. songs, its composition is credited to all members.