Cozy East Coast Honeymoon Recommendation for October?

I'm getting married at the end of October and my fiance and I are interested in having our honeymoon on the east coast of the US! Neither one of us knows much about the east coast but we were thinking it would be fun to go somewhere charming, walkable, and not freezing cold but we also don't need it to be warm and tropical (preferably north of Florida but south of anywhere that will probably be snowy). We were hoping for something more relaxing rather than running around sightseeing and making sure we hit all of the important spots, but we still want a few things to do to get us to explore and give us a reason to spend a good 4 or 5 days there. A good food scene would also be a huge plus. Any recommendations? TIA!