Mark CMG said:
I don't think this is an argument against so much as a point made about how tough the job would be.
True, and that is pretty much the point I intended to make. I just can't imagine what it would take to have people scroll through the hundreds or thousands of threads on many different boards to try and piece together bits of information that might be consistent and useful. Doing that on ENWorld or the WotC forums alone would be difficult, not to mention all the other rpg sites. And again, how do you assess a level of importance to them? Is ENWorld more relevant than WotC? Or Dragonsfoot? (Of course, the answer is yes.

)
Not to say that it isn't possible, but I just can't really envision it myself.
That would depend on what you deem relevant. Survey data can be as suspect, for many reasons, as can off the cuff remarks.
For sure- especially in the sense that they tend to reflect the bias of the surveyor.
Likely some combination of both gleans the best results.
Yes, I'd agree. I would think there would be some sort of comment box or something on any/all survey types of things they would do.
Heck, Dragon (when it was still run by TSR) ran questions soliciting opinions for 2E and 3E and had many issues' worth of reader commentary (which was in all likelihood merely a small sample of the feedback they got). I was just reading through some of those the other day and noting how many things in 3E were similar to suggestions made by those letters (same with 2E).
I'm sure that, as you suggest, they will be taking into account the additional information afforded by the internet now that wasn't available then, but I just can't see them randomly parsing through forums trying to find enough data to collate into some overall vision of what they will change/update without also having a more formal data gathering process.
Now, they do run a lot of polls periodically on the Wizards' site, and I'm certain that they keep that information somewhere. It may also contribute to whatever comes down the pike eventually, even if not intended to be used for those reasons (or, to jump into the conspiracy theory route for a minute, maybe these various polls are being collectively used to gather data without raising too many bells and whistles at once.)
In any event, I do feel pretty firmly that we will see more formal rumblings at WotC when/if 4E is in the planning stages than we have thus far. And thus my own bias rings clear.
