Hilary Duff flaunts figure in yellow swimsuit on girls' trip as 'toxic mom group' drama resurfaces