Certainly there are items in your wardrobe that you don?t wear because of fit or style. (My rule of thumb is that if I haven?t worn something in a year, I probably won?t wear it) Separate those out for donation. Don?t feel bad too about culling the unworn and unwearable. These are things, after all.
Then put your carpentry skills to work on a new wardrobe anyway. You can fill it with your new things.