Durham is just up the road from my place in Cumberland. Durham is more of a township than a town as there is no village just an intersection between the roads in the pic. A few houses, a firehouse, elementary school and a local convenience store. The one church that I have ever seen is the one on the map and it's small but very nice looking. I assume that's the Methodist church.
As unhappycamper said it's less than 30 min to the towns mentioned plus Pownal, Cumberland and North Yarmouth are 15/20 min away. Except for the traffic, not that bad really it would be a pretty quiet place which might be what your looking for. I always thought of it as a farming community.
