Wool is only itchy if it's poorly spun, quality wool fabrics with high thread counts work best for quality suits. Cashmere blends are excellent but it's a shame to waste them.

Silk is better suited to ties, dresses and bed sheets. Most silk suits tend towards the fashion disaster end of the spectrum.

Cotton, well, it doesn't have all that much use to those of us without body heat.