lichess.org
Donate

Do any of the reports get reviewed?

@IncontenentiaButtux said in #29:
> What reality do you live in kind sir, what source would talk about this. Did you go to school? Because it's pretty self-explanatory as to how Lichess can't handle reports. Show me a source that in detail proves that they can lol please

I am not making the claim here you claiming that they cant handle it i am just asking for your source.

"Did you go to school? Because it's pretty self-explanatory as to how Lichess can't handle reports"
no its on you think that it would be too much but have no idea how big or small the mod team is or how many reports they got or anything because we are not mod.
@sheckley666 said in #30:
> Very convincing.
I don't have to be, this thought process is logical. I would much rather follow logic than a blind man, especially when the blind man keeps telling me everything is fine as he continues to drive us into a lake repeatedly
@for_cryingout_loud said in #31:
> I am not making the claim here you claiming that they cant handle it i am just asking for your source.
>
> "Did you go to school? Because it's pretty self-explanatory as to how Lichess can't handle reports"
> no its on you think that it would be too much but have no idea how big or small the mod team is or how many reports they got or anything because we are not mod.
Fallacy, you are making a claim just as I am. There's not much to think about. There is nearly constantly about 40000 games being played, meaning that per day we are talking well over a couple million games at the very least. Unless you are using an algorithm or ai, whose parameters you have to set to check all of these, you simply cannot check them. Meaning, even with machine learning, it will always be a cat and mouse game and the side trying to detect sure as hell isn't Jerry
@IncontenentiaButtux said in #23:
> For the most part they can't keep up with the reports, its just a realistic view into the process. Anyone who says otherwise is either lying or has simply been lucky with the Lichess team reviewing their reports. It's statistically impossible for a team like Lichess to correctly evaluate all reports condsidering there are always games going on yet they cannot constantly review games at t
> Fallacy, you are making a claim just as I am. There's not much to think about. There is nearly constantly about 40000 games being played, meaning that per day we are talking well over a couple million games at the very least. Unless you are using an algorithm or ai, whose parameters you have to set to check all of these, you simply cannot check them. Meaning, even with machine learning, it will always be a cat and mouse game and the side trying to detect sure as hell isn't Jerry

Where did you pull this number out of?
Maybe I am wrong, but in the blog post about game compression they said they have 600M games in total.
So 600M games from 2010 circa, I know the growth is not linear, but 2M games each day seems to me a bit to much.

That said also to me is difficult to think they can review all those reports.
In particular because I see no safeguard against rogue reporter.
Well, the database gives 90M+ games per month at the moment, so that's actually 3M games per day.

And the lichess blog contains more numbers: lichess.org/@/lichess/blog/lichess-year-in-review-2023/ZZQVPhAA

That includes cheating and reports:

> In 2023, our team closed over 567,000 reports, including:
>
> 93,000 reports for cheating
> 298,000 reports for communication infractions
> 87,000 reports of sandbagging or boosting
> 89,000 miscellaneous reports
>
> A huge number of these reports came directly from you. We have many automated systems in place, but user participation is > necessary to keep Lichess fun for all. In 2023 alone, we:
>
> flagged 72,000 accounts for cheating using external assistance
> flagged 20,000 accounts for sandbagging or boosting
> sent 176,000 warning messages to users for various infractions
> removed chat permissions from 72,000 accounts
> communicated with users over 36,000 times through our appeals system
>
> The vast majority of players are well-behaved and follow the rules, so thank you!

So maybe this will inspire your confidence in the team and clear things up for you...
@nadjarostowa said in #35:
> Well, the database gives 90M+ games per month at the moment, so that's actually 3M games per day.
>
> And the lichess blog contains more numbers: lichess.org/@/lichess/blog/lichess-year-in-review-2023/ZZQVPhAA
>
> That includes cheating and reports:
>
>
>
> So maybe this will inspire your confidence in the team and clear things up for you...

Wow thanks for the reference. I don't know how it's happening but the blog post I remember was from 2018.. while I remember it as something recent.. hehe

So definitely not a linear growth if jump from 680M in the first 8 years to 5B in just the last 6 years.
Also seems like ~93k cheating report (on average 255 report per day) is by far less than what I expected (that means 255 report per day, every 3M games per day or just a 1/10000 ratio).

Also 255 report diluted over a team of 10-15 people seems perfectly manageable, moreover if review is aided by automatic tools.
Also the fact that 73k users where banned as results of the 93k reports filled for cheating (and consider many reports may be related to the same user) imply a somewhat 1:1 ratio between report and ban.

To be fair this close ratio surprise me, I didn't think either that Lichess users are so good in spot cheater and report only this one (i expect from regular user many more wrong reports, against of other regular users that sometimes play strangely good due to luck), nor the fact that seems by the numbers that cheaters (on average) tend to be reported only once (1.27 times) even if they play for a while (I expect that they still have time to play let say 20-30 games even if Lichess is super fast in banning them)
You guys realise Lichess does not need to read all the reports, as they do have a cheat detection system. You don't need to report them to get them banned.
@zanycolourfulwindow said in #37:
> You guys realise Lichess does not need to read all the reports, as they do have a cheat detection system. You don't need to report them to get them banned.

"A huge number of these reports came directly from you. We have many automated systems in place, but user participation is necessary to keep Lichess fun for all. " (Lichess representatives citation form one year in review 2023)

So it's pretty clear they have other automated sources, but seems to me they appreciate our reports.
It's both. Automated detection for cheap commonplace cheaters, and human reviews of reports for more elaborate ones.
@zanycolourfulwindow said in #37:
> You guys realise Lichess does not need to read all the reports, as they do have a cheat detection system. You don't need to report them to get them banned.
You have reported about 100 players out of rage