Do go along and have a look at St. Stephens pre-school in Millburn Ave, Millburn (opposite Taylor Park). Although it is in the church grounds, it is non-religious and they take infants from 4 months.
My friends had children who went there (they live in Maplewood and their kids are at elementary school now) and I sometimes collected the children; they seemed to be very happy there and it appeared to be a nurturing environment.
I have no idea of the fees, but if you work in the City you could easily walk to the Millburn train station which is about 5-8 minutes away (or park if you are going to be driving anyway).
Saint Stephen's Millburn | Where love begets love