We were subjected to those small-town taxes while living in Purcellville for the last 1.5 years. We now live just outside the town of Lovettsville. I know you are looking "in-town", but thought you might like some thoughts of living outside of town. Well & Septic means no water bills, no small-town taxes, a little-bit more earth to call your own (means you have the advantage of growing a garden and lowering your grocery bill).
My husband travels to Tysons Corner every day. We figured if we were living out away from NoVa and traveling to get AWAY from NoVa, we didn't want to live directly in town. We wanted to live away from all that chaos. We've found our 3 acre haven with mountain views in EVERY direction. Our neighbors all have 3-10 acres so the kids still have friends in walking distance--we aren't isolated, but we aren't on top of one another--I DON'T want to be able to know what my neighbors are having for dinner just because I can SEE my neighbors dinner table from my kitchen window.
We ended up with the same size house that we had in Richmond, VA and we paid the same as what we sold our home for in Richmond 2 years ago (and we sold at the highest point in the market)--so we think we got a good value: same size house, same price as our selling price during the high market, but we also got 2.5+ more acres, an in-ground pool and FANTASTIC mountain views--have I mentioned the gorgeous views here???
We may not be a diverse town--but what exactly is that supposed to mean? Are you putting value in a town based on the COLOR & RACE of the residents (hmmm--I think that may be called racism

) A town will not become "diverse" until people of all likes value the town for what it is--because then people of all likes will want to move there. So--let's look at what you should really value Lovettsville for, shall we?
*The current nearest grocer is in Brunswick, MD just 4 miles away--or you could shop Frederick, MD where they have every store imaginable (YES, this is a good thing--NO FOOD TAX on your groceries). If this is too far for you to travel, you can put your hopes in the planned grocer in the town "squircle"--you know, that square traffic circle in the middle of town.
*The people are genuine and happy to help their neighbors (this is "small town America", people!)
*We have an incredible 3rd of July celebration--and since it is a small town, more than likely your kids will be IN the parade because they participate in SOME sort of town activity or club. (And yes it is on the 3rd, not the 4th)
*We embrace our German roots with an Annual Octoberfest
*You will get to know the lady at the post office and the librarians pretty quickly--as well as any of the other businesses you will frequent--small town

*We've got an awesome swim team--GO Dolphins!
*You can see a bazillion stars out here--we aren't lit up like Purcellville and the rest of NoVa.
*You can swing on your porch swing and listen to cows, horses and crickets--and nothing else!
*You'll quit using your front door--all your friends and neighbors know you well and will use your side door (And we've only lived here for 3 months).
*Your neighbors may let your children ride their horses (ours do)
*You can spend an afternoon just in your small acreage of yard and still see a snapping turtle, a red fox, a buck deer...and then wander up the road to see wild turkeys cross in front of you.
*don't want to fuss with a garden--walk to the farmers market and buy fresh and local--or you might be friends with someone who has too many tomatoes to eat, so he'll be stopping by your house with a bag for you--and no, he doesn't want payment.
*life slows down here and things that were "important" in the city become unimportant--we've lessened our shopping and material desires and we're just enjoying God's goodness in all of His creation. And no, we aren't bored out here--there is too much to discover and enjoy--now, I have to take my children on a nature walk--we saw an Osage Orange tree and have to go check out those "Hedge Apples". Folklore says they keep bugs away (I sense a homeschool science experiment). We also need to check out the 2 inch thorns on those babies--those trees used to be used as hedges around fields before barbwire was invented in the 1880's...oh--but I've digressed...