Central Wisconsin has a ton of things to do if you keep an open mind, stay positive and look for interesting events.
Stevens Point is nice but you may want to consider Wausau (just 25 mins North) as a place to live.
I've maintained a residence there for 20 years and like you, I live and work full time in the DC area (Maryland actually). I'll be able to retire by my 44th b-day and move to Wausau full time by the summer of 2013 and I can't wait!
HUGE PLUS: ZEEERRRROOOO Traffic. I've been there when residents are frustrated with traffic and when I look around, it seems like a Vacant Parking Lot! Nooo traffic.
Less crime.
Seasons: Real seasonal change, DC can be sweltering for months...in Wausau, seasons move quickly and there is always something new to do with the new weather.
Good Schools.
Taxation with representation....unlike DC
True, the blue collar job market has suffered some devastating losses recently...not unlike the turn of the last century when the Pinery was almost completely decimated and the lumber industry essentially ceased to exist. Back then, a group of local leaders formed the 'Wausau Group' and re-tooled the economy to focus on something else. This was a success. I personally believe Wausau is nearing another decision point where it can refocus itself for future progress. That's one of the reasons I'm excited to be there.
Let us know of your decision and how things turn out.
Good Luck.
Here's a cheezy (pun intended) video I put together of my future Home Town. Enjoy.
http://www.youtube.com/watch?v=P8fn5FxJWy8