I'd try Craigslist for Western MA under Housing/Apts for rent. Search for the terms "house" and "Amherst". If you want to expand your search to other towns and don't mind rural living, keep in mind that Leverett, Pelham, and Shutesbury are the other towns in the Amherst Regional School District. All tiny but beautiful with tight yet welcoming communities. Also keep in mind that in most of America, the word "rural" has become synonymous with "backwater" as these areas become economically marginalized and socially stressed but the Amherst area is a rare exception to that because of all the colleges. So when I say rural yes it is out if the way, though mostly within 15 min of Amherst but with university professors instead of trailers full of rednecks (maybe a redneck professor or two
) as your likely neighbors even in these "rural" outer towns.