QUOTE(DevliN @ Aug 27 2006, 08:07 PM)
I'm in the same boat as you. I think both of your suggestions are great, though I think the yes/no would work better. Obviously it would still require the elected judges to personally review the maps they're looking at so there's still that aspect of it.
And just like you, I'd elect to do it as well. I don't think any incentive is necessary as Tuxlar puts it. I'd do it even if I got nothing in return. I think its fun, actually.
[right][snapback]552172[/snapback][/right]
I'm not talking about you guys. I'm talking about general public guys. Considering how insanely popular the current map reviews system has turned out being (sarcasm), frankly, you guys are unreliable over the long term. Judges will eventually stagnate or get overwhelmed. We all still have lives outside these forums, after all. Using a system to turn over judges every once in a while might help, but that too requires effort to maintain it.
I'm talking about having a system that'll last long after the stagnation has begun, channeling people who would come to this site from the blue, play a few maps, and decide to review them. If these people can be harnessed and rewarded for doing that, then you'd not only promote better quality reviews
in general from the
general public, but also eleviate the need for designating reviewers. No reason you still couldn't do that too, though (even if the rep system would kinda do that already for those who consistently produce good reviews).
QUOTE
ADDITION, since I didn't see Tux's post until I finished mine: I don't see how you can have an automated system for good reviews and not good reviews, nor do I think it is mandatory. I think we can add a "review this map" feature for every map in the DLDB as well as add in a premium maps forum where people can submit their own maps to be considered for premium map status.
No, it's not manditory. Nor is having map reviews in the first place, while we're at it. But if you're gonna do it, I say do it right. The current system of picking a few stars and leaving some comments is inadequate. A process that can be used to decide if a given person's stars and comments (assuming we'd use that system) were worth something would help a little, but compounded with a system that
actively encourages reviews, it should work very well.
Remember once you have the basis for accurately judging quality, you can begin to form the criteria for whatever you'd want to call "premium". One has to come before the other, though, or it'll just be a system wrought with bias.
If you don't see how you can automate such a system, re-read my first post (solution 3). It wouldn't be unfeasible to implement, but you'd have to put some work into translating it to code. I've seen bigger tasks handled before, though, and with it's return value it would definitely be worth it.