lichess.org
Donate

A rant about computer evals

I really enjoyed watching the first game of the World Championship yesterday, even though I'll be the first to admit I'm a complete patzer who didn't really know what was going on half the time. What really annoyed me though, was the number of people in the chat spouting computer suggestions and eval numbers, claiming a player "blundered" if they played anything other than the first best move, and thinking that a position is "won" if a player has a +1 (or -1) advantage.

I was watching the Sesse analysis and it amazed me that a particular thing kept happening: the evaluation would be a number, let's pick 0, and yet Sesse's evaluation for it's best move would be something like 0.67 if it was white to move, or -0.67 if it was black to move. This number would get closer to 0 as the search depth increased. In other words, even a really powerful computer took it's sweet time figuring things out. Yet people expect humans - they are the best human chess players in the world, but they're still humans - to somehow convert this minute "advantage" into a win, when in fact, that number is the result of a "mighty computer" getting its sums wrong, up until a certain depth is reached at which point it adjusts the evaluation accordingly. By this logic, the +0.2 evaluation given by Stockfish at the start of a game "proves" that chess is a forced win for white.

As I said above, I suck at chess.... but I do know that a computer evaluation is not a final verdict, it's a guess. OK, a very well educated guess, but still..... Magnus Carlsen probably did have a winning position at one point, but the road to winning is long and complex, which is why we saw a +4.5 eval and not a "mate in N" eval. So please, if you're going to give computer lines and evaluations, at least learn what they mean.

To draw parallels with other sports, that would be like criticising Messi for missing an "easy" shot by saying "Why didn't he just kick the ball into the goal?". It's a massive oversimplification of a beautifully complex game.

The irony is that if both sides had played perfectly, matching the computer move for move, it would probably have been a draw, and those same people would moan at the players for being "boring".
I guess it is human. If Messi misses a penalty the crowd boos and comments. If he scores a great goal the crowd cheers.

In chess it is more difficult to know what is going on. Computer evaluations at least provide some impartial evaluation. The evaluation is of course inexact. Ideally there would only be win, draw or loss as evaluation, like in endgame tablebases. In practice anything over +1 is usually a win for white with best play from both sides, everything under -1 is usually a loss for white with best play from both sides and anything between -1 and +1 is probably a draw with best play from both sides.
@tpr I agree, but there is a big difference IMO between saying "Carlsen could have played better and won" and saying "Carlsen made loads of horrible blunders because he didn't do the "blindingly obvious" computer line which ran to a depth of 50 ply". A lot of people are jumping to hyperbolic language and extreme conclusions because of small human errors made to look huge by the engines which they are blindly following.
Quoting myself here in the forum:

Some years ago there was an article in the NiC magazine which can be summarized roughly by the following drastic quote:

"Just as the gun enables the inconsequential loner to 'equalize' himself with, say, John Lennon or John F. Kennedy, so the computer enables the talentless to prove themselves 'better" than celebrated grandmasters. And via online comments they can broadcast their superiority to the world."

(Dominic Lawson, President of the English Chess Federation)

Well, everyone can do what he likes to do but I know that the engines won't help you much in your next game. The book which I am reading currently describe this as the biggest problem of all those who want to become master: the ability to think for themselves is lacking.
@Sarg0n How do you always have such good, detailed responses and awesome articles? I've seen you answer so many questions on these forums with amazingly on-point articles and quotes. I'm jealous.
@mCoombes314

Thanks! Actually, I have been in this chess monkey business for about 30 years and I have seen a lot...

This topic has been archived and can no longer be replied to.