First Time Travelers / Honeymoon HELP

My husband (31 & 29yo) and I were married in August. We're looking to book a trip in January or February 2026. Neither of us has done much traveling aside from our yearly vacation in South Carolina. We are leaning more towards an all-inclusive resort. We want somewhere warm with a beach and pools. Our main focus is relaxation, good food, and scenery is a plus. Nightlife, clubs, etc., are not important to us, but we would like to enjoy some drinks at our own leisure (swim-up bar sounds cool). We want an adults-only resort. We often get overwhelmed with trying to plan activities so if there are things to do nearby that don't require much thinking or planning, that's a plus.

I have been doing some light research for weeks, but I have gotten so overwhelmed at ALL the options. I've searched through Reddit, and there are SO many different suggestions. I have no idea where to start.

Should I look into a travel agent? Does anyone have any experience with Costco Travel? Is it better to book directly through the resort? We're looking to spend $3-$5k (preferably lower end, but understand it may not be realistic).

Please help…please!!! haha TIA