I don't know what the Anki leaderboard is, but I do know that anything online that vaguely resembles a competition will be gamed/hacked as soon as there is a modicum of attention to be gained.
So far the biggest problem with leaderboards in anti cheating measures is that Anki is a self grading learning app. To develop a truly fair competition system a format like school exams is necessary.
Such a large number of reviews is possible by using a filtered deck (but I don't recommend it because it's not efficient for learning). The Anki leaderboard allows users to freely choose their learning content and review methods so there is almost no limit on the number of reviews, also there is no specific definition of cheating.
No. 80 000 is less than a second for 24hours straigt. It is just not possible. Also the 80000 I had seen was something around 99% retention.
But yes, there I no strict exclusion criteria for cheating that everyone would agree with. But I think some strict inclusion criterias couldd be agreed upon. Like pressing the same button without reading a card, using a macro or robot to press the button or editing the database.
Look at the icon. Look at the leaderboard icon stats and what those minutes icon pic mean. That’s not 23 mins. That’s 23 HOURS! Which I also think is dubious. Like this man spent this whole day on Anki.
Technically there's no way to distinguish between 20+ hours of serious reviews and 20+ hours of cheating, because Anki is not a game or an exam. IMO it's possible that a very small number of Anki users might be able to do such long reviews because Anki is a learning app and has 10+ million users worldwide.
The leaderboard user sorting order can be changed to user preferences via Options, except for leagues. (Reviews, Time, Streaks, 31daysReviews, Retention.)
Some leaderboard users don't want to study so they devise their own rules and diligently patrol the leaderboard looking for cheaters, people love gossip and rumors more than studying.
One fundamental problem with leaderboards is that if learners study effectively their scores decrease, not increase. e.g. when learners create high level cards, study intensely, and manage their time well the number of reviews becomes smaller. Only you can determine whether you are reviewing effectively or not, others or programs cannot make that judgment.
My version of the leaderboard permits the use of cheats (except for server destruction or illegal activities), thus you can use any cheat you want (e.g. fix lost streaks), and all reports or discussions regarding cheating or criticism of other users are prohibited.
If you do not like other users, please address it with these ways.
You can optionally hide distracting users. (Double click on user name -> Hide user)
You can optionally hide all medals.(Config -> Settings tab -> Show league medals next to username)
Create a group and set rules with your trusted friends and compete.
Please note if you call other users’ reviews cheating or criticize how other users review you will be banned, because those aren’t cheats in the first place and you’re the one violating the rules.
I tried such a system before but it didn't work well. Some users prefer reviews under one second, also since cards decrease many users mistake it for a bug. And there's no consensus about the threshold, e.g. some users think it should be one or three seconds while others prefer ten seconds or more. So I think the ideal solution is to separate leagues or servers based on rules and thresholds. e.g. users can choose to join servers with no restrictions or restrictions of 2 seconds, depending on their preferences.
Yep, IMO the important thing with Anki is memorizing cards to acquire knowledge or pass exams, the leaderboard scoring system is merely one tool to help achieve that, it is a means not an end.
Completely pointless system considering no one has the same cards. I make my own medical cards and they aren't the same as those of others so what is the point checking how many reviews I have in comparison to others?
Also no fucking chance anyone can do those many review you cant even tap the space bar that much in 23 minutes 💀 If you tap 5 times / s (which is generous) that would end up at 6.9k so yea I call cap. This dude did those many reviews so double the taps on the spacebar and you end up with 56 taps per/s for that to be possible
I think the optimal way to use the leaderboard is to create a group with trusted friends. In this case users learning content is mostly the same, and you can establish your own rules, it can also be used to check study progress rather than for competition.
Card schedule changes are auto excluded from calculations, so these are possible: Creating filtered decks and repeating them many times, using Auto Advanced or Speed Focus mode. It is common for medical student Anki users to cram using them before exams.
For now it is technically impossible to distinguish users who study for 22 hours from those who cheat, so if you consider them to be cheating please use the option to hide those users.
If Leaderboard is simply drawing from their actual recorded stats (which I think it is), they could have their max answer time set unusually low, so that their answers are recorded as happening in a very short time, regardless of how long it actually takes them to answer.
Or could they be using Grade Now on a bunch of cards (even cards they aren't actually studying), because they care about "winning" a contest for which there is no prize, more than they care about learning or fairness or honesty?
There's lots of ways to cheat if you don't care about the spirit of the "competition."
Grade Now has already excluded them from calculations, these become 0 seconds so it's possible to identify. But developing anti cheat measures is technically impossible with add-ons, if I tried to develop such systems I'd need to switch from self scoring to an exam format and make the app and deck closed source, such programs are not Anki add-ons.
So far competitive systems like leaderboards have the potential to negatively affect learners (e.g. learners may feel compulsive pressure or become demotivated by low scores), so the official Anki developers have not developed such features and only a minority of Anki users who prefer these systems use them.
It's common practice to regulate cheating in typical games, sports, and other leaderboards, so leaderboad users often report reviews that seem like cheating. But IMO such regulations or countermeasures are either inappropriate or impossible for Anki, because Anki is a learning app for individual learners, not a game or competition.
32000 reviews in a day - yeah ridiculous. My issue with the anki leaderboard is the formula over emphasis number of cards done rather than raw time spent which is far too favourable to people studying language vocabulary as opposed to more difficult concepts.
For now the leaderboard is optimized for individual learning rather than fair competition, so users can optionally change the leaderboard sorting order to their preference. (except leagues. e.g. Review, Time, 31days, Streaks.)
I don't know what the Anki leaderboard is, but I do know that anything online that vaguely resembles a competition will be gamed/hacked as soon as there is a modicum of attention to be gained.
Its crazy
Is it though? It's a story as old as the Internet itself, when those flash games had impossible scores on the leaderboards.
Don't forget how Amy Sylvia Smith went all over the country "winning" at all the arcades. Yeah, sure, Amy.
So far the biggest problem with leaderboards in anti cheating measures is that Anki is a self grading learning app. To develop a truly fair competition system a format like school exams is necessary.
I've seen some as high as 80,000 in a day. Cheating most likely.
Such a large number of reviews is possible by using a filtered deck (but I don't recommend it because it's not efficient for learning). The Anki leaderboard allows users to freely choose their learning content and review methods so there is almost no limit on the number of reviews, also there is no specific definition of cheating.
No. 80 000 is less than a second for 24hours straigt. It is just not possible. Also the 80000 I had seen was something around 99% retention.
But yes, there I no strict exclusion criteria for cheating that everyone would agree with. But I think some strict inclusion criterias couldd be agreed upon. Like pressing the same button without reading a card, using a macro or robot to press the button or editing the database.
Yeah I suspected that
adding friends or joining a small or medium sized group is the way to go with this add-on imo
Yup the “global” board is useless
I was thinking the same thing as well
That's definitely true, I think the most popular use is for users to create groups with their friends.
Look at the icon. Look at the leaderboard icon stats and what those minutes icon pic mean. That’s not 23 mins. That’s 23 HOURS! Which I also think is dubious. Like this man spent this whole day on Anki.
Technically there's no way to distinguish between 20+ hours of serious reviews and 20+ hours of cheating, because Anki is not a game or an exam. IMO it's possible that a very small number of Anki users might be able to do such long reviews because Anki is a learning app and has 10+ million users worldwide.
Ik it’s a fun little add on but ranking by # of reviews is just stupid imo, the top 10 will always be cheating.
I think it would be better to rank by time spent studying
The leaderboard user sorting order can be changed to user preferences via Options, except for leagues. (Reviews, Time, Streaks, 31daysReviews, Retention.)
#4 is legit
how absurdly small can the reviews be for that?
Truthfully: I don't pay attention to the details, man's a beast
Who cares really
No one
Some leaderboard users don't want to study so they devise their own rules and diligently patrol the leaderboard looking for cheaters, people love gossip and rumors more than studying.
so at this point it's a competition on who can cheat the most
One fundamental problem with leaderboards is that if learners study effectively their scores decrease, not increase. e.g. when learners create high level cards, study intensely, and manage their time well the number of reviews becomes smaller. Only you can determine whether you are reviewing effectively or not, others or programs cannot make that judgment.
23:00 is not 23 minutes, it is 23 hours. (00:01 -> 1 minute, 01:00 -> 1 hour)
Q. A user is cheating, what should I do?
My version of the leaderboard permits the use of cheats (except for server destruction or illegal activities), thus you can use any cheat you want (e.g. fix lost streaks), and all reports or discussions regarding cheating or criticism of other users are prohibited.
If you do not like other users, please address it with these ways.
Please note if you call other users’ reviews cheating or criticize how other users review you will be banned, because those aren’t cheats in the first place and you’re the one violating the rules.
For a more detailed explanation about this, please read About Cheating Q and A.
Thank you, I should have read about Cheating Q and A before making this post. Nevertheless, thank you so much for this amazing add on
Thanks! This leaderboard is a custom version add-on so most of the code is credited to the original author and contributors.
Ideally, at least 2 seconds should be allowed per card, so those with absurd review/review times wouldn't win medals.
I tried such a system before but it didn't work well. Some users prefer reviews under one second, also since cards decrease many users mistake it for a bug. And there's no consensus about the threshold, e.g. some users think it should be one or three seconds while others prefer ten seconds or more. So I think the ideal solution is to separate leagues or servers based on rules and thresholds. e.g. users can choose to join servers with no restrictions or restrictions of 2 seconds, depending on their preferences.
[deleted]
I also think I need to add a limit for 23 minutes but I think the OP's case is 23 hours.
You have to look at the time spend and the cards complete and then make your own judgement
Yep, IMO the important thing with Anki is memorizing cards to acquire knowledge or pass exams, the leaderboard scoring system is merely one tool to help achieve that, it is a means not an end.
Completely pointless system considering no one has the same cards. I make my own medical cards and they aren't the same as those of others so what is the point checking how many reviews I have in comparison to others?
Also no fucking chance anyone can do those many review you cant even tap the space bar that much in 23 minutes 💀 If you tap 5 times / s (which is generous) that would end up at 6.9k so yea I call cap. This dude did those many reviews so double the taps on the spacebar and you end up with 56 taps per/s for that to be possible
I think the optimal way to use the leaderboard is to create a group with trusted friends. In this case users learning content is mostly the same, and you can establish your own rules, it can also be used to check study progress rather than for competition.
Fair enough that is true I appreciate the input <3
Probably rescheduling cards
This. I think it happened to me once when I reset cards.
Card schedule changes are auto excluded from calculations, so these are possible: Creating filtered decks and repeating them many times, using Auto Advanced or Speed Focus mode. It is common for medical student Anki users to cram using them before exams.
GOAT/ER and Derishmaelite cheat pretty consistently everyday. Like sorry ur not attending school AND studying 22 hours in a day
For now it is technically impossible to distinguish users who study for 22 hours from those who cheat, so if you consider them to be cheating please use the option to hide those users.
Are we de**ass competing for who's better at reviewing 🤦
maybe users who find studying alone boring use it, it's like a library or a cafe.
If Leaderboard is simply drawing from their actual recorded stats (which I think it is), they could have their max answer time set unusually low, so that their answers are recorded as happening in a very short time, regardless of how long it actually takes them to answer.
Or could they be using Grade Now on a bunch of cards (even cards they aren't actually studying), because they care about "winning" a contest for which there is no prize, more than they care about learning or fairness or honesty?
There's lots of ways to cheat if you don't care about the spirit of the "competition."
Grade Now has already excluded them from calculations, these become 0 seconds so it's possible to identify. But developing anti cheat measures is technically impossible with add-ons, if I tried to develop such systems I'd need to switch from self scoring to an exam format and make the app and deck closed source, such programs are not Anki add-ons.
I dont get this. It about ur own personal learning and progress why do they need to make a leaderboard lol
So far competitive systems like leaderboards have the potential to negatively affect learners (e.g. learners may feel compulsive pressure or become demotivated by low scores), so the official Anki developers have not developed such features and only a minority of Anki users who prefer these systems use them.
probably, you can read more about cheating on the add-on's Q&A:
https://shigeyukey.github.io/shige-addons-wiki/anki-leaderboard.html#about-cheating-q-and-a
It's common practice to regulate cheating in typical games, sports, and other leaderboards, so leaderboad users often report reviews that seem like cheating. But IMO such regulations or countermeasures are either inappropriate or impossible for Anki, because Anki is a learning app for individual learners, not a game or competition.
32000 reviews in a day - yeah ridiculous. My issue with the anki leaderboard is the formula over emphasis number of cards done rather than raw time spent which is far too favourable to people studying language vocabulary as opposed to more difficult concepts.
For now the leaderboard is optimized for individual learning rather than fair competition, so users can optionally change the leaderboard sorting order to their preference. (except leagues. e.g. Review, Time, 31days, Streaks.)
It was an issue before you inherited it, I just wouldn't design it like that