If you have kids, they'll end up going to brunswick or jefferson elementary and probably brunswick middle/high school.
The town is pretty accepting of all people. We have white, black, asian and all kinds of people. I would recommending driving around like the person above me stated. There's some neat little things here
Taxes are high in Frederick County/MD in general, though living in Knoxville I don't believe you'll have any "city" tax. Can't said my situation would be all that different living in VA though.
Knoxville will give you good access down US 15 to Northern Virginia as well. If you want to hop through West Virginia down Rt 9 to Rt 7 that is an option too.