Ok- we moved to Ashland from Salem, MA.
Let me give full detail on the commute to and from the North Shore
Swift...
I too work very close to the Financial District in the Seaport District at times and also work on the road visiting clients.
I would leave Salem (26 miles from downtown) at 7:15am and get in right at 9am. 95 and 93 are HORRIBLE. The entire state of New Hampshire commutes in on 93. Bumper to bumper- the whole way- everyday.
Some days I would be out visiting clients and be able to break away early and head north around 2:30-3pm. Guess what?
Traffic! 40-45 minutes to get back to Salem. Ridiculous. And just a tip- NEVER try heading north on 93 at 5-6pm...
Ok...so that is Salem. Well...Newburyport is 45 miles north of downtown. And guess what roads you will have to take in and out of the city? Drum roll.....
95 and 93- the death traps! Oh and not to be a punk, but your colleague that supposedly gets in in 40-45 minutes.....how fast is he driving? Downtown in 45-46 miles from Newburyport. Care to change your answer

Being totally honest- that commute is going to be a minimum of 1.5 hours each way. With accidents and the frequent road work, you're looking at 2 hours easily.
The one point I will agree on is that the town is beautiful. But with your observation that it is a 'destination' town, comes alot of tourism. And that means traffic and yahoos during the summer.
The North Shore also has a complete lack of good shopping. The malls in Peabody are decent, but not great- they are 10 minutes apart from one another.
The other day I left my house at 7:30am (Ashland), went through the drive through at Dunkies, on the Pike at around 7:45am. Thick traffic all the way into the city with it backed up a little at the tolls at the 95 junction. Either way- the traffic is moving at about 45-50mph...so steadily along. I got into the Seaport District which is farther than where you would be going at 8:35am.
Commutes- hands down...Metrowest is much better.
Swifty- I'd be happy to tour you around and show you some of the highlights of the area.
Also- there is a Starbucks and Dunkies right up the road, a Quiznos, Cold Stone Creamery, and a 4-5 star Tuscan restaurant. (Southborough)
We live right on the Southborough border BTW..