I agree with Keeper.
We have a home in another 55+ community about 13 miles south of The Villages. We visit there quite often.
I'd have to side with Kali's Grandma here. When you bought your home in The Villages, you agreed to the HOA rules. It would not be fair to your son, or the other residents to fight the very rule that makes the Villages what it is......a one of a kind place for adults.
You have a few options. I'm not sure what the exact rules you have, but I think kids can live there up to 30 days a year.....and can live there full time at 19 years of age.
You can keep the home as a 2nd home to visit.
You can rent it out to recoup your costs.
You can sell, although this is NOT a good time to try.....
I understand that the "free golf" is only on the executive courses, and you pay a large CDD fee in addition to your HOA fees......You may want to consider moving out of The Villages to a more "multi-age" community close by and still enjoy all that central Florida offers.
I guess I'm baffled as to how you thought you can buy a home there and get around this little snag.....

Even if you did try to fight this "rule" you agreed to, how do you think you would be treated by others there, who would perceive your "fight" as a threat to there lifestyle? They paid dearly for that lifestyle you want to change.......
I remember the story Keeper wrote about. In THAT situation, some felt pity for those people, because the situation was forced upon them....in your case it was not, and I doubt you would find much support.
The Villages has a local forum there, where you would surely get some info.....you can google it....that would be an interesting thread to read.....
Perhaps you can move to the "employee/family section".....one of you may need to become an employee to do it....I'm not sure......the answers you get should be interesting.
Frank D.