I have, as well as other here I'm sure, have made a number of decisions that I've regretted in my career. Of course, it's impossible to tell how it would have turned out if we chose the other way.
If you quit a social worker job to go back to law school to work in corporate law, you have your reasons.
If you quit a job that pays six figures to work the floor at big-box retail, you have your reasons.
Whatever your motivation, once you have made a decision to make a change or head in a direction to make a change, as long as you had some logic behind making that decision, then it really cannot be considered a dumb decision.
Could it in retrospect have been considered the wrong decision? Perhaps, but like I said, there's no way to tell how things would have turned out if you went the other way.
Agree?