I don't consider them dressy really. I am a weirdo pretty much because I really don't like jeans. I have issues with the way things feel, I forgot the term for it, but to me, jeans are kind of rough and not that nice. I prefer just cotton pants, or cords.
In fact, the jeans I do have are mostly not standard denim but some blend that makes them softer, not a poly blend but cotton and ramie (I think).
They tend to be this kind of thing too: