Schools in Goshen and Warwick are of about the same quality (excellent) so there's no particular benefit to either.
It will be tough to find a place with enough land in Rockland that won't cost you a fortune to purchase. Warwick is beginning to cost a fortune too, but there are still plenty of places where you could keep a horse. Goshen is about the same, but not as large and has more traffic. Campbell Hall in the town of Hamptonburgh is a great area for horses and convenient to Goshen as well. The village of Florida splits the difference between St. Anthony's and ORMC, but you may find some real bargains out toward the area of Pine Island and you can get to both hospitals from Pine Island within half an hour or less. The village of Warwick has only a tiny number of houses with enough acerage for horses and, in any event, keeping livestock within the village is illegal.
Someplace else you may want to look into is Chester. There is a small section of Chester, part of the charming hamlet of Sugar Loaf, that is within the Warwick school district. The taxes would be less and it would be closer to Route 17 going south (for your husband's commute, IF he commutes) than the rest of Warwick or Goshen. The commute from Warwick is tougher than Goshen and if your husband is a consultant then I expect he'd be driving a great many places south of Orange county.
These are the two hospitals that serve the surrounding area. St. Agony's is the one here in Warwick. ORMC, which everyone still calls Arden Hill, has a campus in Goshen. On the whole, from what I have heard from employees of both, it's much more pleasant to work for St. Agony's than ORMC and particularly ORMC's mental health unit and assisted living facility, Glen Arden.
St. Anthony Community Hospital
Orange Regional Medical Center