Jester David
Hero
Except this was hyped as a massive public "playtest" not "concept test". Really, playing was actually irrelevant.A playtest and a concept test are not separate things in this case. It was both.
They've had over a year to work the kinks and fine tune how they received feedback and coordinate their staff to read through surveys and find alternate ways of reading the feedback. If this was a priority they could have found a way.The fine-tuning of mechanics will occur in internal testing groups that they have more direct contact with. The structure of a public playtest makes it very difficult to collect actionable information on specific mechanics you're concerned about. Their primary goal with the public testing was to get widespread player feedback on what resonated with people as being appropriate for D&D, and what broad mechanics players found compelling.
Looking at how video game companies handle public betas would be a start.
Which is a huge missed opportunity. The more eyes on a product, the more people looking for abuses, the better. As the Character Op boards have shown, WotC frequently misses abusive combos and mechanics.I'm sure they looked at some balance issues, but probably not much in the way of fine details.
It's a mistake not to employ the people most skilled at finding bugs to find your bugs.
Because they didn't tell us for a start.Why did you feel it was appropriate to call the move stupid?
How many threads have you seen that focused on mechanics? That were dedicated on reccomending small changes or fixing spells or catching errors? How many "playtesters" potentially focused their efforts looking for mechanics to fix rather than just examining broad concepts?
Because WotC didn't clearly explain this was a concept test and not a playtest they reduced their usable feedback and wasted a whole lot of time.
And if they had emphasised it as a concept test they might have attracted more readers who lacked groups to play and test with.
There's also the long delay. There's potentially eleven months before the game is released. A new package will tide people over for a few months but with no new content the game will slip from people's minds. There's no reason to check the website for news. It will be a litte too easy to get involved in new games and campaigns. The wait between 3e and 4e was long and tiring, and that was with surprising news trickling out. 5e doesn't have that any more; after eighteen months they're running low on monster lore and vague mechanical previews.