Button It

Look closely at this stucco covering a house on Elias Street, just east of Adelaide in Old East Village. See the buttons? Local tradition says they came from a nearby button factory. Does anyone know where the factory was and when it operated?