A few years ago I was in your position - commuting from the New Jersey suburbs to midtown, hating it, and looking for a more convenient place to live.
I found it in Weehawken and wrote details in post 10 of the thread below.
//www.city-data.com/forum/new-j...nion-city.html
I've never done the commute you describe, but the commute is meaningfully quicker - more frequent buses plus shorter bus ride - if you live in the grubbier but improving section of Weehawken near Pleasant Avenue.
Before you decide to move to Port Imperial, why not test out the commute a few times?