I've actually been vaguely wondering if the put Ianto in more colourful shirts when he was more active in an episode. Or maybe it does have something to do with how he interacts with Jack? Because one thing I've noticed, in CoE from the moment they change into the clothes Ianto bought them, Jack and Ianto are completely matched, right down to the colours of Ianto's tie.