The Red Priest said:
What is your opinion on materials produced for OOP games?
I have no "special" opinion on them that I am aware of.
How would you evaluate material for systems in which you have zero experience?
Try to get some experience with the system (however minimal). Barring that, try and track down the Core Rules (I'm guessing you are describing a situation with OOP material like you mentioned in the first sentence of your post) and take a look at them.
After over two decades of this, I'm pretty good at grasping rules.
I went out and bought a set of core rules for a supplement that was submitted a few years back. HERO maybe?
Anyway...do whatever I can to familiarize myself with it. A fairly "stock" answer, but the truth nonetheless.
What if any of those systems are highly complex? That is, the rulebooks are very dense and there may be many supplements. This can be the case for games with a long history, as in 15+ years.
Man, if I can successfully wade through
Starfleet Battles' telephone book-sized rules compilations every few years for my buddy Fraser's yearly "weekend-long" games I'm not going to be fazed by RPG complexity
If you do not like a particular system, how will you evaluate supplements/adventures/whatever submitted for that system? Do you think there can be a good adventure for a bad system?
Absolutely. The most recent example of this kind of thing that pops to mind is the
Gamma World Referee's Guide, which I thought was
miles better than it's Core Rules (which, well, were not great).
What barriers are you anticipating in play testing submissions?
Time mostly. I have a gaming group that are pretty charged up this time of year to serve as my Guinea Pigs
Are you thinking ahead to come up with contingencies?
Not really. "Do my best to playtest as necessary" is about my whole plan. I have no plans to playtest every single item that comes through the door, and contingencies would be "over-planning" IMO.