there used to be a little beach area at Lake Julian.. it's been years though, since we swam there. I dunno if it's still there, but there was one once. Not great swimming, but you'll get wet!
Lake Lure is a better place to swim... really great actually. Have a kids' beach park too. Costs about $8 to get in.