A piece of Bury St Edmunds history has been saved from the potential scrapheap following a SuffolkNews campaign.