"Never Give Up (Party Party)" was Paul Haig's fifth solo single. It was released in the UK on Island Records licensed through Les Disques du Crépuscule. The track, along with the companion album Rhythm of Life, was recorded in New York with renowned produced Alex Sadkin. A wide range of guest musicians appeared on the album; Tom Bailey of the Thompson Twins, Bernie Worrell of Funkadelic and Anton Fier of The Feelies. In mainland Europe the single and album were released on Les Disques du Crépuscule.