Yes. The area, as you probably saw, sits on a huge pile of granite. There are some large cavern areas underneath the county and Exxon back in the day tried to buy most of the ridge land in West Milford and Warwick because of its large uranium supplys. We are in a hot spot for radon, make no mistake. The EPA ranks Orange and the surrounding area as a, "red zone," meaning the average indoor radon screening level is greater than 4 pCi/L (pico curies per liter).
This does not mean that radon can't be controled by proper monitoring and venting. It most certainly can. Uranium is one the most common elements in the environment and properly monitored and addressed, it can be a non-issue in a modern home.
Here's the EPA zone map for New York: