Suppose you you wear just one or two items to provoke conversation and to feel like you didn't completely sell out, but otherwise dress inconspicuously. Explain to the host that you didn't dress fully because you didn't want t make them feel uncomfortable, but explain in the future you are going to dress fully. If they are a good host, they will tell you to dress however you want in the future...if not, it will be easier to plan a different dinner next time.
