I would say keep a few key smart pieces, eg a jacket, a pair of trousers and a skirt (if you have one) and some dresses. There are always going to be occasions when you need smart wear, but use them in a different way. Eg, going out for lunch, jeans and the jacket, trousers and a smart cardigan. Going out in the evening, smart trousers and a sparkly top etc. Personally, I'd ditch any blouses as they are too smart IMO, but that is just me!