I also suggest that you forget about
most of Newark on the basis of safety.
However, the Ironbound section of Newark is actually a safe area and it boasts a significant population of people from Spain & Portugal, so you might feel some affinity for that neighborhood.
Jersey City rents have become quite high in the safer areas of that city, and the areas that are more affordable are not particularly safe.
I think that, in addition to the Ironbound section of Newark, the OP might want to consider the town of Harrison.
Harrison would have the advantages of relative safety and lower rents than the safer areas of Jersey City, plus it is more-or-less midway between Union & Jersey City.
Additionally, Harrison has a station for the PATH train that runs to Jersey City and to NYC.