I don't think you'll regret it, especially with a disability that causes fatigue and two children in a stroller. I use a walker at DL (multiple autoimmune diseases and major fatigue, plus I get super dizzy and unstable from anemia as an autoimmune complication), and it's so nice to stay at the GCH. I don't love hanging out in hotel rooms, however. Our next stay we've booked a one bedroom suite at the GCH just for the two of us. Sure, it's a splurge, but I think we'll enjoy it more than having a club level room.
I grew up poor (like welfare poor for part of my childhood). Scrimping and saving and never spending an extra penny was how I grew up, and how I lived the first two decades of my adult life. I'd taught myself to get satisfaction from not spending money. Now I'm working on letting money be a tool. We can't take it with us.
You can afford it, so let your money buy you wonderful experiences and yes, the convenience of location. I was so fatigued on our trip in December that I nearly wept in relief when we left DL and all I had to do was walk to the GCH.