Chaosmancer
Legend
not really, you can easily fix that by providing anything that is more than an assertion or simple disbelief, I am still waiting for that
Like official company releases? The Lead Designer talking about the process? The successful sales numbers of multiple products that have undergone the survey?
Or do I need internal memos and a full documentation of their internal data?
no, I told you where they are contradictory and you have not yet resolved that, or rather you did in your last post by agreeing with me about something you insisted for days was not the case
You misinterpreted my answers in a way that made them seem contradictory. I've corrected you on that consistently, and you have consistently insisted that I simply don't know what I am talking about.
no, my position is the questions are not good at getting the answers they are looking for, the information we have when answering them is insufficient for our answers to accurately reflect what we want, and the terms used for the different levels are misleading by disagreeing with plain English use of them.
And then we found one person in a handful that was mislead, indicating that this could be a widespread problem, which you then wanted to ignore against all reason, because anything else does not fit your narrative.
And all you have to rebut any of this is 'WotC is big, they have considered all of this, nothing to see here'. You will have to do much better if you want me to take your posts seriously.
Okay. If WoTC isn't getting good data on what makes a successful product from their surveys, why was Tasha's a critical and financial success? Why did Xanathar's win awards for how good it was? Every single product with player facing material WoTC has released, using this survey data which according to you is not well-equipped for getting them accurate and useful data... has been a success.
You are insisting they are Mr. Magoo, blindly wandering around and just stumbling into success after success after success. And this is based solely on... your own personal interpretation of their survey intent and their survey design, which you insist must be correct.
Why do I need more evidence that their surveys are working, than the historical evidence that every time they've used the survey data... it has worked?
No, I only have to do so once you have shown that WotC has a different idea of what good design is. I am saying that for WotC good = popular, there is nothing else to it (apart from balancing it, which WotC does by themselves). If you want me to make a distinction here, then you first have to show that WotC is making a distinction. As long as you cannot show that they make one, I have no reason to make one either.
That is nonsense. And fully irrelevant.
because planning and succeeding are not the same thing, which should be obvious.
So then it would be easy for you to find a design they put out, using the survey data, that was unpopular. Or a design that was universally popular with hundreds of thousands of people (not just your personal echo chamber) that they did not put out.
I am not misunderstanding you, I am rejecting your claim since you provide zero evidence for it. If you could fix that, we would make more progress. I am not granting you things you just assert, that is all.
then explain your position better. I keep asking you things and you fail to answer
I have not failed to answer. I have answered you repeatedly. You just insist I must be wrong.
correlation is not causation, no evidence, we had that already. They are popular despite the playtest method, not because of it. Feel free to actually provide facts to the opposite, as always it is nothing but unsubstantiated claims.
So you can provide evidence of that claim? Evidence that they are popular in spite of the playtest method and not because of it? I'd like to see that evidence. I'm sure it is very strong and not your personal opinion.
they had the most successful RPG for over 30 years before they even started having playtests, how is that possible? The consistent thing here is that they sell better than others, not the playtest part.
If they didn't need the playtest data to improve their game, how come 5th edition, using their playtest method, has succeeded beyond all other editions of the game? And heck, if they are such highly skilled game designer that they can make the most successful RPG of all time with bad data.... why do we want to insist that this bad data is suddenly going to lead to the creating a bad product for the first time in this entire span?
then show that WotC differentiates between the two
How do you propose I do that? Seriously, what evidence are you looking for here? You don't even believe that the sky-high sales of 5e proves it has a solid design, you just seem to think it is because WoTC happens to be making DnD and therefore it would be successful regardless of what they did. It is almost like you believe the success of DnD has absolutely nothing to do with WoTC.
nonsense, I told you that WotC makes no such distinction, so for them good = popular and therefore I do not need to distinguish between the two either. That is not a fallacy. You will have to show that WotC actually does consider these two to be different things, and even then it still is not a fallacy, but at least by then I am wrong.
No, it is still literally a fallacy. Whether or not WoTC is engaging in the same fallacy is immaterial.
no, I am saying that 1) they do not need us for balancing and 2) a balanced design by itself is neither good nor popular
So a balanced design is not a good design. You can't say "no I don't think that" then immediately say it again.
yeah right, it totally is not why they started having playtests right after it bombed, to ensure that they never release something like that again. That absolutely shows two things 1) that for WotC good = popular and 2) they cannot figure out popular by themselves.
...
...
So... an incredibly well-designed game, which was unpopular... does not support the idea that good design and popularity are seperate... because it wasn't successful, and they wanted to make it... popular...
And further, this proves to you that they can't figure out popularity of a product. Which implies the surveys are about the popularity of the product. The thing I keep saying that you keep saying I'm not supporting or saying...
...
...
So you completely agree with my position. Because 4e is the ultimate expression of my position, and you just said it proves to you... my exact position.
I thought you said they are good at designing and do not need the playtest for this... Also, why are you then asking in this very post "And, if WoTC is only planning on putting out designs that are popular, why on this green earth would I even be able to find examples of them putting out unpopular designs?!" Sounds more like you "are just twisting and conflating words to try and "win""...
You thought incorrectly, again. And, again, if something that didn't go through the survey process is your only evidence of something that failed, how does that show the survey process is bad? It would be like claiming that since you made mistakes before using a calculator, that the calculator you are using must be broken. It is nonsensical.
This has gone on long enough, at this point I want exactly two things from you
1) tell me what criteria WotC uses to identify and compare good designs, otherwise stop claiming that good and popular are not the same thing, because all the evidence we have points to exactly that.
You can also just move on from this, as I said this is completely irrelevant to the case I am making, so I am not even sure why you keep bringing it up
I keep bringing it up because it is fundamental to your misunderstanding of the survey. To the point that just above you disproved your own points in the discussion of 4e, and seemingly haven't even realized it.
2) tell me how the way the survey is structured is a great way to get accurate answers by addressing the concerns I raised and show 1) how it is simple for the participants to communicate that they a) like the proposal enough to include it as is, b) like it but want improvements, or c) do not like it and want it thrown out, and 2) how it is easy for WotC to pick up on that (without everyone having to fill out the text box). Same here, if you cannot do that, then all the evidence we have is the problems with it that I brought up.
And all your evidence is nothing except a miniscule number of people insisting it is a problem, because they didn't get the results they wanted.
For all those getting a version of the game they are happy with... the survey is clearly working. And since that large base of people who the survey is trying to appeal to... it is working. I mean, you'd think if the survey WASN'T working, Crawford would have at some point over the last few years made a comment about how the survey data wasn't matching with the reception they were getting.
You keep acting like you have iron-clad evidence that proves WoTC's incompetence, but you just have the natural results of not appealing to everyone all the time.