though Greenville isn't exactly on the coast I'd focus your job search on Greenville, south to the border.
From the info you offered in your post, I feel the communities between New Bern going down 70 to Morehead City, then 24 to Jacksonville and New Bern going down 17 to Jacksonville, even on in to Wilmington, would be your prime job search area. This is due to the high number of retirees, and government jobs.
USAJOBS - The Federal Government's Official Jobs Site
Employment Opportunities (http://www.mccscherrypoint.com/employment.htm - broken link)
Marine Corps Community Services, Camp Lejeune: Job Announcements
There's also a job fair coming up for childcare providers and you don't need NC credentials to work on base and starting pay is around $11 which is a lot on the coast and more than enough for a single person who is not living in Wilmington.
http://www.mccslejeune.com/jobs/CYTP%20Job%20Fair%202011%20Half%20Flyer%20Final.pd f (broken link)
edit: additional advice would be to look at online classifieds for newspapers in the area. A lot of local businesses only advertise opening in the classifieds.