Definitely pay out of pocket and perhaps see a different physician and/or use different labs, etc. In addition, depending on the state, one may need to opt out of automatically sharing medical information via an electronic database.
Pharmacies are a bit trickier. I'm not sure how one can limit the sharing of that information. Maybe purchase drugs from a Canadian pharmacy?