It's not something I've done, or even contemplated doing but "E cup" alone doesn't tell you anything about the cup, you need to know the band size as well. If you go up a band size and down a cup size, or vice-versa, you stay with the same volume cup and it's that volume which matters if you want the cup to fit. A 32E cup will be much smaller than, say, a 42E cup.