Fishing rights continue to be a stumbling block in Brexit trade talks with both sides digging in their heels.