Scandal surrounding treatment of immigrants from the Caribbean has overshadowed this year's meeting of Commonwealth leaders.