I can't speak to your Epcot selections but as long as you are good with the flavor profiles (which you already mentioned your family is) I think either H&V or Tusker House will work just fine.
I will second a few points I have seen already brought up. Relatively speaking, for a Disney restaurant, Tusker House feels much more open and easy to navigate. H&V isn't terrible but it's just a bit more what you would expect. DW and I are not huge buffet fans unless it's breakfast, but since DD came along we have done a few for the characters. That being said, I think the food at Tusker is better but H&V is perfectly acceptable. Character interactions could vary from sitting to sitting if you get a different person in the costume or even a handler. We had great experiences at both. One fun point to H&V is that there are often seasonal costumes. When we went over the week of Thanksgiving 2 years ago they had on Christmas costumes which DD and her cousins loved. You'd need to check into that before booking, though.
Neither is a bad choice but I would probably be inclined to agree with what someone else mentioned about getting a break from the crowds and, depending on the time of year, the heat in the middle of the day at HS by choosing lunch at H&V. And, as much as DW and I like to have a TS meal, we both enjoy Satuli canteen so much in AK that we sometimes skip the TS altogether in AK.
Whatever you choose, enjoy!
