Click again on the lower half.
Think of the little icon as a target. If you click on the body, the body removes clothing, if you click on the legs, you remove pants/skirt .
If you're wearing underwear, click in the same spot again to remove that too. Then click again once you're done to get dressed again.