Should it suit
Durango, CO is a lovely place, but in many ways dissimilar to Taos. As you may have gleaned from your visit, Taos is unique unto itself. If Durango is your first love, you might question in which ways Taos will prove the better match. A great place, but not for everyone.
Assuming you've come to terms with the first question, then your biggest challenge likely financial. Real estate in Taos tends to be expensive. With a small job market not adverse to nepotism. You might both find employment in your chosen fields, but probably doing so because determined, with enough perseverance.
If appreciably larger, but still somewhat small, Santa Fe is another option. A different feel, but sharing many of the sensibilities one will find along the Rio Grande of northern New Mexico. It is a world like no other.