Fun Honeymoon Ideas?

SO my fiance and I are doing a very very tiny wedding- you could call it eloping honestly, because there will be only 15 people there (we didn't want a huge wedding being that we're moving into our first home almost immediately after the wedding). So with that, we did agree that instead of having a huge wedding party next year, we should use that money and do a honeymoon trip. We're wanting to keep it within the US being that we will go out of the country to visit his family overseas. But we're completely stuck on ideas?

He originally spent most of his time in New York when he first moved here, and I've never been to NY. Most of everyone told me not to go to NY for a honeymoon but for a weekend trip, which I guess makes sense. I'm from Atlanta, and we've been there already. SO… where in the US can we go for a honeymoon?

Here are some more notes:

• We live in Florida and the beach is just common to us, so we're definitely not a siesta keys, Cali, or miami type.
• We looked into Hawaii, but for the prices and flights, we might as well go overseas.
• I don't want to do anything as far as Hiking or too much of an "outdoors" kinda deal, so things like the grand canyon is a no.
• We are definitely wanting to do more sight seeing.
• Neither one of us drink so anything that includes bar hopping type of excursions are definitely out. .
• Is there a cruise line that only sails within the US from state to state? We were interested in that as well but neither one of us has been on a cruise to know LOL

thank you for dealing with my pickiness hahah!