Best-known for its chalky, brittle Necco wafers (or perhaps those "conversation hearts"), the New England Confectionary Co. still cranks out candy buttons, too (0.5 oz.; 99 cents). A previous generation of candy buttons was clingier, I recalled in another context; these pulled free with no trouble.
In addition to novelties, Classics Illustrated magazines (in reproduction), and some sports memorabilia, Starbase stocks an assortment of bargain sweets for a nickel, a dime, or three-for-a quarter. If you consider that 99 cents gets you 96 candy buttons, you could say they still sell penny candy, too.
Starbase Candy Company
141 East Main St., Mt. Kisco, New York
914-241-6969