For a pool and tennis club, I'd recommend
The Adirondack Club.
For private country clubs,
Walpole or
Franklin. Franklin would be the more challenging course of the two, It depend's on what your husband would prefer. Walpole CC does not have a pool. There is also
Glenn Ellen in Millis, but that is all public now and I'm not sure what their financial state is.
I have also heard good things about
Hopkinton, as far as it's a fun, social club: It's a little farther away than the others, but they do have both pool and tennis.