XXX's people would be gathering. YYY had once claimed XXX could carry on naked, and only make those around XXX feel overdressed. XXX was momentarily tempted to test YYY's assertion, but overcame the mordant vision,...
One more hint.
I said the inconsistency could be explained away, but in a very artificial way. The very same words (naked vs feel overdressed)
will not jump to the mind of two different persons to describe two different ones, Even if one is the model (or the father) of the other, the probability is too small.
But if the "overdressed" business had become some kind of joke between Cordelia and Aral, maybe someone, namely YYY, who visited them could have heard it, made it his or her own but applied to XXX rather than Aral, later told it to XXX, and XXX remembers YYY telling it. Possible, but artificial. (I've seen worse interpretations of inconsistencies in the Sherlock Holmes Canon by aficionados.)
So this reduces considerably the number of possibilities for YYY: for instance, Bel Thorne whose personality might well have led it to say that, never went to Barrayar (so I omitted the "its" possessive)! Taura is out, too: the first time she goes to Barrayar is in 'Winterfair Gifts'", long after "Miles Errant".
Just taking pot luck you have a good chance to guess. (With this hint there are really very very few possible choices now...)