Hmmm - this is something I never would have even given a second thought to. I live in Florida, so not much need to wear scarves. I rarely wear any scarves, and would never need an "infinity" scarf. I don't like lots of layers. I usually only wear a scarf on a chilly day when I am out bike riding, and those days are fairly rarely.
If you like scarves, wear 'em, people! Sheesh, I can't believe the things that get some people worked up.