Stowe is the ONLY thing close to fully "upscale" you will find on the East Coast. Almost everything else is oriented more towards groups on a budget for a weekend, or day trips from the large cities. Americans who want big and fancy go to the Rockies.
Stowe, Killington, Sugarbush are the largest in the area you seem to be interested in. Mad River, next to Sugarbush, is smaller but absolutely legendary for it's very rustic feel and "ski anything you want" terrain. And no snowboards allowed there. Almost a "must ski" place if you are nearby!
Staying in Waterbury, which is just South of Stowe, puts all of those (except Killington) within 1/2 hour drive.
Whiteface/Lake Placid (1980 Olympics) is a nice town and fun mountain, too, although it's pretty isolated, and if conditions are not good, you may feel stuck.
I like the New Hampshire idea, stay in Jackson (upscale village, very cute inns and restaurants, but not that many), and spend a day at each of Wildcat, Attitash, Waterville (World Cup used to have a stop there), maybe Loon. As other have said, don't discount the fun you can have exploring the nooks and crannies of several local areas, instead of just one place?
Depending on time of year, willingness to hike, and conditions, skiing parts of the original trails around there from the 1930s (look up Sherburne and Tuckerman's Ravine) can be great fun too.