I think the tourists/residents comment comes from the fact that during the school year, the Skiddies are a large part of the population. If Skidmore is still a dry campus like back in my day, the students pour into town Tuesday-Sunday, and of course they shop and eat and nurse their hangovers during the day

. When school is out, the track and the summer activies (SPAC) and visitors increase the population. While Skidmore and the summer season are GREAT for the town, local residents can sometimes feel outnumbered.
I have not been in SS for 16 years or so, so I am sure things have changed, but I am also sure they are the same. Skidmore is very vocal about its students respecting the residents, at least they were when I was there, and even the students living off-campus amoung th3e residents were kept in line by the school.
Saratoga is a great town, in a great area. I think newcomers would have a fairly easy time as the town is somewhat used to new people every year
Good luck and enjoy
