I would recommend Benham's Restaurant. It is owned and run by Benham's Catering and it is the most romantic restaurants I have ever been to. Check out their website
Benhams Restaurant and Catering. I notice it did have only lunch hours listed, but call to verify.
It's extremely small compared to other restaurants, but I just remember how elegant everything was, and the music was Mozart...
You would definitely need reservations, and coat and tie is required.
Hope you have a wonderful time, wherever you end up!