Victoria's health minister says she rejected advice from the state's chief health officer to bring back mask mandates after speaking to businesses concerned about staff shortages.