I don't care, but then again I'm not religious.
In fact I avoided the whole trend because I didn't want people to think I was religious but I have to say, it really pulls an outfit together if you're going for that goth/Victorian look.
The cross wasn't always a symbol of religion. I view it the way I view the guillotine.
Many times you can tell if someone is wearing it for fashion purposes or religion.