Critics say move to hold asylum seekers in centres until their right to stay is determined further isolates the refugees.