Allin played electric bass for three groups that featured GG Allin: Malpractice, The AIDS Brigade and the third version of The Murder Junkies. He currently continues the Murder Junkies, his brother's final backing band, with original drummer Donald ("Dino Sex") Sachs, and several younger members.

Allin is featured extensively in the documentary film Hated: GG Allin and the Murder Junkies, by future Road Trip andThe Hangover director Todd Phillips.

Allin was also bass player in late 70s Boston punk group Thrills (a.k.a. City Thrills), who released several singles and were the subject of a later CD discography. He subsequently joined the band Cheater Slicks, and played bass guitar on their debut album On Your Knees.

Allin was formerly married to Michelle ('Michie') Allin [maiden name unknown]. Footage of the couple's wedding survives on video. The ceremony is particularly noteworthy for the appearance of Allin's younger brother GG Allin in a concurrent twin role as both best man and maid of honor; to this effect GG appeared sporting a dress, jackboots, with half his face featuring an unkempt beard, the other clean-shaven and fully made-up.

Allin's nickname growing up was Pinky (also spelled Pinkie), a play on 'pinkie' - the term for the smallest finger on the human hand - affectionately making sport of Allin's micropenis; a phenomenon famously shared by his brother GG Allin and exhibited in footage captured in numerous live video recordings. He was also referred to as Pearl (i.e. a pun on 'Perle') during his brief lineage in the GG Allin and the A.I.D.S. Brigade combination.

Allin also appears in the full-length Allin family documentary GG Allin: All in the Family (2018), directed by Sami Saif.