@Justicar I used to care only about comfort and practicality as well. I used to wear cargo pants and cotton t-shirts essentially everywhere.
I can't explain my desire for nice clothes over sports wear any more than I can explain my taste for figs over melons, despite the fact that such taste does require more attention like occasional dry cleaning and regular ironing. Good clothing feels amazingly comfortable as well.
When I go grocery shopping in a suit, if I do standout, no one comments.