Professional Stone and Masonry has cheap mulch (lesser quality though) and fair delivery charges:
Placement on map is approximate
2065 HWY 98 WEST
Louisburg, NC 27549
Also there is a place on US1 right at the Wake/Franklinton Co line that sells both across from CenturyLink.
I will have to look it up, but there is person who owns there own dump truck and will goto the quarry on US1 just south of Franklinton and pickup stone for you. You can't do it cheaper then that and his delivery charge was actually too little. If you are after basic gravel (#57?) let me know and I will get you his contact information.