Since you mentioned Brower Park, I am assuming you are looking for something around Brooklyn Avenue. There are some white families that live in that area so that should not be too much of a concern. The houses are beautiful around there but it will all depend on your comfort level. Crown Heights is not the best Brooklyn has to offer nor is it the worst.
North Crown Heights is changing rapidly with the influx of a lot of young couples especially near the border of Prospect Heights and Crown Heights. From my conversations with these newbies

to the neighborhood, they have not mentioned any complaints and tend to like the area and the people in it. There are not many amenities but there has been a change on Franklin Avenue as it has seen more small restaurants open up.
If I may suggest, it might be nice to visit the area and hang out in the local beer garden (Franklin Park) and talk to some of the patrons there. They may be able to offer a better perspective as they are more familiar with what they have experienced moving into Crown Heights.
Like most areas there is your good and your bad. I have not really experienced the bad in Crown Heights since I have been living here (over 13 years) but I am not going to dismiss it. I find it to be a nice neighborhood with decent transportation and close enough to other areas that it is not inconvenient for me to go out, if I want to. I have read posts from others that have lived near me that have had horrible experiences in Crown Heights but I am not sure of the particular reason why their experiences were so bad. All in all, it depends on you and your interaction with any given neighborhood.