I've only been to DL twice. The first trip was without the kids (a kind-of anniversary trip in 2010,) and we just got back from the second trip last week with the kids. Here are a few thoughts about the differences:
The 2010 trip was the first time my husband and I had gone on a trip together, just the two of us, since we had kids. Ours were 10, 7, and 3 at the time. I totally get the dilemma of going to DL without the kids(!)--how could we do that to them?--we had a great time, and the kids were okay with it. They got to stay half the week with one set of grandparents and the other half with the other set, both of which spoiled them rotten!
I think the pros, here, outweighed the cons. We were able to ride everything we wanted to ride and to explore the parks at a much faster pace at times and much more slowly at others than the kids would have allowed. Because the trip was less expensive, we were able to spend a little more on table service dining at Blue Bayou and Ariel's Grotto (back when you could get WOC fastpasses there.) It was rather dis-orienting (but wonderful) not to have anybody's food I had to cut! Also, it gave us the opportunity to go on the Walk In Walt's Footsteps Tour and explore all of the awesome Disneyana at the
Disneyland Hotel to our heart's content, neither of which we could've done with the kids. We also enjoyed the just-us time. Of course there were those moments when I wished they could've been with us enjoying DL, too. (Enjoying Trader Sam's on your visit would be way easier without the kids and really is a must-do!)
On our most recent trip a few days ago, we had a great time, and I'm so glad to have experienced DL as a family. Our kids are now 13, 10, and 6. However, there was very little romantic about it. (One big exception is we let our DD13-almost 14 babysit in the room so we could check out Trader Sam's.) I was on full mommy-duty every day: the first to wake up, and the last to be ready, making sure all the ducks were in a row. I also had to balance everybody's moods, thirst, hunger, wants, and needs. We've done lots of WDW trips, so none of this was unexpected; it's just not relaxing. We did not eat table service, and even with all of the food options, our kids were extremely picky. However, it was fun watching the kids get excited about seeing Carsland for the first time, watching the youngest get to ride cool rides she was never tall enough for before, and sharing my love of DL with my kids.
Having done both, I would definitely do the anniversary trip with just my husband and me again in a heart-beat. Either way, though, you'll have a great time!!