Tyson Fury's promoter Bob Arum thinks the former world champion owes it "to himself and his family" to remain retired from boxing.