I think it looks good, especially the bottom half. Are you maybe a slim Pear shape, smaller on top? The sleeves also seem a bit big.
If you're up to it, I would try the same pattern again, one size down on the top, including sleeves.
And I am of the school that A Jacket Over It solves a variety of problems