Felhasználónév: Jelszó:
Oldal: 123456789
Szerző
Topic neve: Quiz: the aspects of evaluation
averageChet2ndFérfi
Végzetúr poronty
6 hozzászólás
Profil megtekintése
Re: Quiz: the aspects of evaluation
81. hozzászólás - 2010.03.17. 05:26:22 (Válasz ChaoticGemini #80 hozzászólására.)
Denim pants, which is what they where refered to, where worn as early as you stated, no doubt. My point being, however, is that the concept of denim blue jeans, and them being specifically referred to as that began with Levi Struass and his partner. Once again, simply google who invented denim blue jeans and the answer is there. Perhaps I could have worded the question differently. Oh, well, not that big of deal, but I still disagree with the assesment.
Pontszám: 5
averageViridel
Végzetúr poronty
796 hozzászólás
Profil megtekintése
Re: Quiz: the aspects of evaluation
82. hozzászólás - 2010.03.17. 16:32:44
Badminton is on the Banned Words list...

Really???
Pontszám: 5
popularDenyse
Végzetúr poronty
7 hozzászólás
Profil megtekintése
Re: Quiz: the aspects of evaluation
83. hozzászólás - 2010.03.25. 19:39:04 (Válasz Miklos #1 hozzászólására.)
Just wrote a question and noticed I left a negative (not) out of the question. Any way to recall and correct or do I just wait until it is rejected from review?
Pontszám: 5
much likedChaoticGeminiNő
Végzetúr poronty
583 hozzászólás
Profil megtekintése
Re: Quiz: the aspects of evaluation
84. hozzászólás - 2010.03.25. 21:24:31 (Válasz Denyse #83 hozzászólására.)
There is no way to recall your question. You could try posting it in the quiz errors and if a moderator sees it before it is evaluated, they can correct it.
Pontszám: 5
averageAlcuardFérfi
Végzetúr poronty
3 hozzászólás
Profil megtekintése
Re: Quiz: the aspects of evaluation
85. hozzászólás - 2010.03.26. 18:53:03
Hi!
There's a quiz to search for doomlord ????
HELP ME!!! Should have a mission
Pontszám: 5
averageRumplebum
Végzetúr poronty
1 hozzászólás
Profil megtekintése
Re: Quiz: the aspects of evaluation
86. hozzászólás - 2010.03.26. 21:46:34
I think you european webmasters should check the grammer and spelling on some of the questions that already exist than shutn down a good question for an apostrophy. Some of the questions are horrible english...not to mention that its Col. Mustard in clue not Mr. Mustard....but somehow that went thru
Pontszám: 5
averageAlcuardFérfi
Végzetúr poronty
3 hozzászólás
Profil megtekintése
Re: Quiz: the aspects of evaluation
87. hozzászólás - 2010.03.27. 00:35:13
Someone can give a link? If there is the doomlord open quiz database.
Pontszám: 5
averageZalamaFérfi
Végzetúr poronty
4 hozzászólás
Profil megtekintése
Re: Quiz: the aspects of evaluation
88. hozzászólás - 2010.03.27. 03:07:19
I'm starting to get pissed off by getting shot down by single evaluator that hasn't real general knowledge. I just made one of the most simple quiz that anyone could answer (not only for some 12 years old nerds).

Which one is a main character in The Bold and the Beautiful?

Ridge Forrester <--
Vito Corleone
James Brady
Al Capone

The question is valued as "Bad, incorrect question"!
According to evaluators only a special group of people might know the answer.


Everyone should know even without hearing about this, one of the most famous soap opera, that Vito Corleone (The Godfather) & Al Capone aren't right answers. And no I don't watch this stupid serie but I think it's just general knowledge. James Brady is just made up so it's 50/50 even without knowledge. Are there quiz supposed to test some general knowledge or to be just somekind of bot detection system? Even with this answer you can google it in about 1 minute.

If one person just decides what is good quiz or whats too special question only presents his view of knowledge not general knowledge of people playing it. While there is reward getting quiz approved maybe you should improve evaluation process.
A hozzászólást Zalama módosította 2010.03.27. 10:35:55-kor
Pontszám: 5
very popularStromboliFérfi
Végzetúr poronty
51 hozzászólás
Profil megtekintése
Re: Quiz: the aspects of evaluation
89. hozzászólás - 2010.03.28. 09:55:07
I find the evaluation of quiz questions more confusing the more I present them.

My last one was a fairly straightforward one about "The Simpsons" and was rejected because 'only a special group of people would know the answer'.

I would have thought that "The Simpsons" was a global cartoon series and one that would have been seen by most people playing this game. And you don't need to be special to watch it.

And surely almost EVERY question is one that only a special group of people would know? Around half the questions I have come across can only be answered correctly by those who google or who have specialist knowledge.

I am not complaining that the question was rejected but wondering if it was rejected because the evaluators felt it was 'dumbed down' and trying to work out just what is acceptable and what is not.
Pontszám: 5
very popularStromboliFérfi
Végzetúr poronty
51 hozzászólás
Profil megtekintése
Re: Quiz: the aspects of evaluation
90. hozzászólás - 2010.03.28. 09:59:37
Further to my last post, I have just asked two similar questions about Troy and Gladiator and both were accepted. How are these different?
Pontszám: 5
much likedLydonB
Végzetúr poronty
266 hozzászólás
Profil megtekintése
Re: Quiz: the aspects of evaluation
91. hozzászólás - 2010.03.30. 10:51:52
Don't bother mate. Falls upon deaf ears.

From my experience; evaluators evaluate general knowledge depending whether they or their friends know about it. If they don't it ain't general knowledge.

Some fine examples of "general knowledge" I encountered in this game:

Inner workings of some sort of engine/contraption
Which year did the American/Hungarian team X won against team Y or something else.
What is the name of dinosaur dung
Chemistry/DNA related things

And loads more.


All I have to say is general knowledge my A**, none of the above is general knowledge.

Engine components are general knowledge to grease heads but not to the rest of society.
Sports of country X is general knowledge of the specified country but not to the rest of the world.
Dinosaur dung..? General knowledge...? Really..? Is the person who evaluated that in his/her right mind? Dung/lizard fetish perhaps..?
Chemistry/DNA related stuff is general knowledge? Has earth suddenly undergone some miraculous crash course on "How to be a chemist/scientist/doctor." That's the same sort of "general knowledge" as asking a surgeon a question about Quantum Tunnelling.


What one can say is that general knowledge is based on perspective.

What can be considered general knowledge in your area/work location or interests can likewise be considered as specialist knowledge in a different segment of society and vice-versa. Further analysis on that argument voids over 75% of the current quiz questions since it is area/education based whilst at the same time validates 100% of all the quiz questions present or future since the proper description of general knowledge is "knowledge that is available to anyone (public knowledge)".

Quite a dilemma. The question is? Where does one draw the line?

The current "line" is not clear. The current system doesn't work. All would agree that Google is used heavily when answering the current questions.



This is my opinion anyway.
Pontszám: 5
averageNorachFérfi
Végzetúr poronty
1 hozzászólás
Profil megtekintése
Re: Quiz: the aspects of evaluation
92. hozzászólás - 2010.03.30. 14:39:17 (Válasz LydonB #91 hozzászólására.)
Your quiz question is valued as „Bad question”!
Explanation: According to evaluators only a special group of people might know the answer.

The question was :
10 years before Thermopylae, the Persian's first assault against the Greek city states was twarted away by the Athenian army in battle at ...

Megara
Marathon
Plataies
Babylon

and the right answer is of course (b)

Considering the fact that there is an Olympic event of 40 Kms distance for the past 112 years of world-wide world-known Olympic Games called Marathon Road
the evaluators knowledge is either pretty limited to Madonna music or their way of thinking is simple incomprehensible by me. I simply cannot understand how the above question is more narrowed than the already validated question over which was Madonna's first album.

In any case I rest my case.
Pontszám: 5
much likedImLittleJon
Végzetúr poronty
395 hozzászólás
Profil megtekintése
Re: Quiz: the aspects of evaluation
93. hozzászólás - 2010.03.30. 16:01:56 (Válasz LydonB #91 hozzászólására.)
The quiz feature is a fun aspect of the game. Are there false positives and false negatives in the evaluation process? You bet. Does that make the quiz feature not fun? Not in my opinion. So the question is, is there a better evaluation system that would produce more false positives and false negatives? I can't think of one. Can you? I think the best thing to do is to work within the system to improve it. One way to do that is to report (in a polite tone) every instance of a bad question that made it through. Another way would be to become one of the moderators yourself, though it's not clear how to be chosen for that. (Given how long my current question has been under evaluation, they need to choose some more moderators...) I understand the frustration that the system isn't as good as it might be, but I think it's better than nothing, especially as there isn't likely to be a consensus of where the line should be drawn. Anyway, that's my opinion.
Pontszám: 5
averageViridel
Végzetúr poronty
796 hozzászólás
Profil megtekintése
Re: Quiz: the aspects of evaluation
94. hozzászólás - 2010.03.31. 04:08:27 (Válasz Norach #92 hozzászólására.)
Idézet: Norach - 2010.03.30. 14:39:17
Your quiz question is valued as „Bad question”!
Explanation: According to evaluators only a special group of people might know the answer.

The question was :
10 years before Thermopylae, the Persian's first assault against the Greek city states was twarted away by the Athenian army in battle at ...

Megara
Marathon
Plataies
Babylon

and the right answer is of course (b)

Considering the fact that there is an Olympic event of 40 Kms distance for the past 112 years of world-wide world-known Olympic Games called Marathon Road
the evaluators knowledge is either pretty limited to Madonna music or their way of thinking is simple incomprehensible by me. I simply cannot understand how the above question is more narrowed than the already validated question over which was Madonna's first album.

In any case I rest my case.


Too much of a reading jumble. 10 years & Thermopylae are not assets to the question; "twarted" is misspelled, and an unnecessarily uncommon word (try defeated); and there's no hint in the question as to the answer. Sure Marathon is the right answer - doesn't mean the rest are not possible.

Here's the same question, which would likely (because in quiz review, nothing is certain) be approved:

Which Ancient Greek city had a sport named after it, in celebration of a successful defense against the Persians?
Marathon
Steeplechase
Javelin
Discus

Just my opinion...
Pontszám: 5
averageViridel
Végzetúr poronty
796 hozzászólás
Profil megtekintése
Re: Quiz: the aspects of evaluation
95. hozzászólás - 2010.03.31. 04:15:05 (Válasz ImLittleJon #93 hozzászólására.)
Idézet: ImLittleJon - 2010.03.30. 16:01:56
The quiz feature is a fun aspect of the game. Are there false positives and false negatives in the evaluation process? You bet. Does that make the quiz feature not fun? Not in my opinion. So the question is, is there a better evaluation system that would produce more false positives and false negatives? I can't think of one. Can you? I think the best thing to do is to work within the system to improve it. One way to do that is to report (in a polite tone) every instance of a bad question that made it through. Another way would be to become one of the moderators yourself, though it's not clear how to be chosen for that. (Given how long my current question has been under evaluation, they need to choose some more moderators...) I understand the frustration that the system isn't as good as it might be, but I think it's better than nothing, especially as there isn't likely to be a consensus of where the line should be drawn. Anyway, that's my opinion.



The line should simply be that NO question should be kicked out for being "too specific". But after 10 answers, if 3 or fewer got it right (less than 40%), then it goes to Moderation to determine if it's a fair/reasonable question; and it should be auto-kicked if it's less than 40% accuracy after 50 questions.

The first moderation should only verify the accuracy of the answer and FIX any spelling & grammar errors. That way nobody can get mad that their question got kicked, and if it gets removed later, it's because the user-base of Doomlords said it was too difficult. And really, regardless of the Moderator opinion on the matter, the only people who matter are the users - the current system simply does not represent that.
Pontszám: 5
much likedImLittleJon
Végzetúr poronty
395 hozzászólás
Profil megtekintése
Re: Quiz: the aspects of evaluation
96. hozzászólás - 2010.03.31. 14:06:24 (Válasz Viridel #95 hozzászólására.)
Idézet: Viridel - 2010.03.31. 04:15:05
The line should simply be that NO question should be kicked out for being "too specific". But after 10 answers, if 3 or fewer got it right (less than 40%), then it goes to Moderation to determine if it's a fair/reasonable question; and it should be auto-kicked if it's less than 40% accuracy after 50 questions.

The first moderation should only verify the accuracy of the answer and FIX any spelling & grammar errors. That way nobody can get mad that their question got kicked, and if it gets removed later, it's because the user-base of Doomlords said it was too difficult. And really, regardless of the Moderator opinion on the matter, the only people who matter are the users - the current system simply does not represent that.


I'll buy that as an alternate system. It's at least as good as what's there now, and definitely superior in some respects. I think it would work much better for the moderators to fix spelling and grammar errors, but I think you run afoul of some European countries' laws. My company does some online communities for European divisions of some clients, and I know there are some places where the law is that the original poster completely owns the words they posted, and you are not legally allowed to modify them. You can't even delete them (though you can hide them), as if the user ever asks for all the text they have ever posted, you have to provide it. Maybe it would work for the moderators to submit an alternate corrected version back to the user, who would have to click a button to accept the revisions. That's more complicated to code, though.
Pontszám: 5
averageViridel
Végzetúr poronty
796 hozzászólás
Profil megtekintése
Re: Quiz: the aspects of evaluation
97. hozzászólás - 2010.03.31. 16:51:08 (Válasz ImLittleJon #96 hozzászólására.)
Idézet: ImLittleJon - 2010.03.31. 14:06:24
Idézet: Viridel - 2010.03.31. 04:15:05
The line should simply be that NO question should be kicked out for being "too specific". But after 10 answers, if 3 or fewer got it right (less than 40%), then it goes to Moderation to determine if it's a fair/reasonable question; and it should be auto-kicked if it's less than 40% accuracy after 50 questions.

The first moderation should only verify the accuracy of the answer and FIX any spelling & grammar errors. That way nobody can get mad that their question got kicked, and if it gets removed later, it's because the user-base of Doomlords said it was too difficult. And really, regardless of the Moderator opinion on the matter, the only people who matter are the users - the current system simply does not represent that.


I'll buy that as an alternate system. It's at least as good as what's there now, and definitely superior in some respects. I think it would work much better for the moderators to fix spelling and grammar errors, but I think you run afoul of some European countries' laws. My company does some online communities for European divisions of some clients, and I know there are some places where the law is that the original poster completely owns the words they posted, and you are not legally allowed to modify them. You can't even delete them (though you can hide them), as if the user ever asks for all the text they have ever posted, you have to provide it. Maybe it would work for the moderators to submit an alternate corrected version back to the user, who would have to click a button to accept the revisions. That's more complicated to code, though.


Any website I've seen that you can post on (forums etc) say that "any submitted comments become property of (the site) and may be used or edited blah, blah, blah". Actually I had a typo in a question of mine, "silimar" should have been "similar", and that was corrected by the Mods.
Pontszám: 5
averageViridel
Végzetúr poronty
796 hozzászólás
Profil megtekintése
Re: Quiz: the aspects of evaluation
98. hozzászólás - 2010.03.31. 16:54:01 (Válasz Viridel #95 hozzászólására.)
The line should simply be that NO question should be kicked out for being "too specific". But after 10 answers, if 3 or fewer got it right (less than 40%), then it goes to Moderation to determine if it's a fair/reasonable question; and it should be auto-kicked if it's less than 40% accuracy after 50 questions.

The first moderation should only verify the accuracy of the answer and FIX any spelling & grammar errors. That way nobody can get mad that their question got kicked, and if it gets removed later, it's because the user-base of Doomlords said it was too difficult. And really, regardless of the Moderator opinion on the matter, the only people who matter are the users - the current system simply does not represent that.


Also, Quiz Olympics questions should be taken from the pool of 50+ answers. There is nothing more frustrating in this game than the game having wrong answers in the Quiz Olympics.
Pontszám: 5
much likedImLittleJon
Végzetúr poronty
395 hozzászólás
Profil megtekintése
Re: Quiz: the aspects of evaluation
99. hozzászólás - 2010.03.31. 16:59:50 (Válasz Viridel #97 hozzászólására.)
Idézet: Viridel - 2010.03.31. 16:51:08
Any website I've seen that you can post on (forums etc) say that "any submitted comments become property of (the site) and may be used or edited blah, blah, blah". Actually I had a typo in a question of mine, "silimar" should have been "similar", and that was corrected by the Mods.


Our sites say that too. But the lawyers say that the country's laws do not recognize that as sufficient.
Pontszám: 5
averageViridel
Végzetúr poronty
796 hozzászólás
Profil megtekintése
Re: Quiz: the aspects of evaluation
100. hozzászólás - 2010.04.02. 18:03:01
I sent this straight to the guy running the game, and not surprisingly, have not heard back:

It should simply be that NO question should be kicked out for being "too specific". But after 10 answers, if 3 or fewer got it right (less than 40%), then it goes to Moderation to determine if it's a fair/reasonable question; and it should be auto-kicked if it's less than 40% accuracy after 50 answers.

The first moderation should only verify the accuracy of the answer and FIX any spelling & grammar errors. That way nobody can get mad (or wonder why) their question got kicked, and if it gets removed later, it's because the user-base of Doomlords said it was too difficult. And really, regardless of the Moderator opinion, the only people who matter are the users - the current system simply does not represent that.

Also, Quiz Olympics questions should only be taken from the pool of 50+ answers. There is nothing more frustrating than the game having wrong (or impossible to find) answers in the Quiz Olympics.

No SE would be given until the question has passed the 10-answer test (and it should be increased to 3x to compensate for the time), and we should not be blocked from posting another question while the previous one is under "peer-review".

Ultimately the "hunt quiz" will get more difficult as there WILL be more obscure questions... But ultimately, I don't think anyone will care as much about the several SE lost on the Hunt Bonus when it means that the Quiz Olympics don't have any debatable questions, and that nobody will have to worry about (and get mad when) their questions are rejected for no legitimate reason other than a Mod not liking it. There won't be any point in complaining about a question, as it'll get kicked after 10 answers if it is too difficult!


This would solve ALL complaints (except where the Mod doesn't verify the correct answer), ultimately lessen the workload for the Mods, and the users of the game can dictate when a question is too "specific".


Now, the guy(s) running the game have come right out and told me that they don't monitor the Forums, and they have "lesser admins" for that. This saddens me greatly, as how are the creators of the game supposed to know what us users are thinking if they don't review the Forum, and actually SEE the problems that exist???

As such, if you agree with the above concept, I would suggest you copy it, add your thoughts, and e-mail it to info@doomlord.net

Maybe if they get people e-mailing them directly, something productive may come of it. the Forum clearly isn't the answer for change.
Pontszám: 5
Oldal: 123456789
HKK - Zén minikiegészítő: Zén Legendái: A sötétség gyermekeiAz Idő Kereke tovább forog! Megjelent a befejező trilógia utolsó része!