no they don't charge you the $20...that's a No-Show fee (not a plate fee.)
If the baby shows up, she's not a "no-show", lol.
If you're really concerned about the possibility of getting charged the no-show fee, call Disney Dining for the reservation & specify one of the persons in the count is an infant.