Based on the criteria that you listed, you actually have a lot of options in Western North Carolina...
Asheville itself is a very nice area. Though it has a great farmers market, there are a
few more people than the 7,200 in your current "downtown"...
For a place that's a little smaller, but still within a reasonable distance from hospitals and the Asheville Regional Airport, I would suggest that you look along I-40 between Asheville and Hickory.
Here are some of the hospitals in the area...
Asheville - Mission & Park Ridge
Marion - Mission
Morganton - Grace (Blue Ridge Health Care)
Hickory - Catawba Memorial & Frye Regional
There are also several medical centers that might be of interest to you
Here are a couple of suggestions of small / medium towns...
Black Mountain - About 15 miles east from the center of Asheville. Population = 7,910. It has a great walkable downtown area with a lot of small "shops". They have a tailgate market every Saturday during the summer months. Several restaurants and parks to choose from.
Old Fort - About 24 miles east of Asheville and 33 miles west of Morganton. Population = 960. This is the smallest of the areas that are listed here. As you can imagine, there are few local amenities, but it's not a complete ghost town. There are some nice restaurants and parks. Though they do have a local grocery store, you would most likely end up shopping in Black Mountain or Marion for groceries etc.
Marion - About 36 miles east of Asheville and 22 miles west of Morganton. Population = 6,998. It has nice walkable downtown area with several small shops. They have a small farmers market every Tuesday and Saturday during the summer months. Several restaurants and parks to choose from.
Old Fort and Marion are in McDowell County... Housing prices and property taxes are a lot lower in this area than those in the surrounding areas.
Morganton - About 23 miles west of Hickory. Population = 17,029. It has a nice walkable downtown area. There is a somewhat large "flea" market / farmers market not too far away.
There are several great parks and outdoor attractions all across Western North Carolina, so no matter where you move to you'll be able to enjoy the outdoors.
My husband and I moved to McDowell County about 4 years ago after researching this same range of locations that I listed above. We chose this area mostly due to its central location to both Asheville and Hickory as it gave me more employment oppotunities to choose from. We really like the area and are still glad that this is where we chose to live.
I hope this helps...