Chatgpt is awful with chess stuff
@ilidiomartins a blog post would be the right venue for such an experiment. Not the public forum.
Besides, LLMs not only can hallucinate, but **do mostly hallucinate** whenever they have no clear information available.
The prompt tht is in quotes was generated by Grok. I then used this prompt with a chess game that was previously analysed.
Prompt "Given this pre-engine-analyzed game [table of move#, CPL, top3 moves, depth, time, principles violated/enforced], identify matching human chess principles (e.g., 'pawn structure control', 'piece activity', 'king safety') for the played moves. Flag any that require unlikely depth for the player's level."
Plus the game that was analysed, minus id headers, rename the player names white and black ...
Gemini answers: That's a fantastic request! Analyzing a game for human chess principles, especially around an amateur rating (1500s), provides great insight.
Here is an analysis of the game moves, focusing on common human chess principles, and flagging moves that deviate significantly from those principles or require deep engine analysis (CPL ≥ 100 for an Inaccuracy/Mistake/Blunder, or a top move that requires ≥ 20 depth).
️ Chess Principles Analysis (White 1568 vs. Black 1564)
Opening Principles (Moves 1-9)
Move Player Principle Enforced (+) or Violated (-) Comments/Depth Flags
1. d4 White + Central Control, + Development Classic opening move.
5. Bxf6?! White - Pawn Structure Control Trading the developing Bishop for Black's Knight, which is not fully developed and doesn't threaten anything, gives Black the Bishop pair and a strong pawn center, often leading to a small but lasting advantage.
5... Bxf6 Black + Pawn Structure Control Recaptures toward the center, maintaining a healthy pawn center and the Bishop pair.
7. h4 White - Development, - King Safety A slow flank move that ignores central tension and development. It's often a sign of trying to create complications instead of solving existing ones.
9. Nxc6?! White - Development, - Piece Activity Trading a developed Knight for a Knight that was ready to challenge the center (or trade itself). It simplifies the position but fixes Black's pawn structure (doubled c-pawns are often strong in the KID) and allows Black to centralize their pieces.
9... bxc6 Black + Pawn Structure Control, + Rook Activity Recaptures toward the center, preparing to use the b-file for the Rook later (12... Rb8).
Middlegame Blunders and Miscalculations (Moves 10-25)
Move Player Principle Enforced (+) or Violated (-) Comments/Depth Flags
10. h5?! White - King Safety (Self-inflicted), - Development Continuing the h-pawn storm without any developed pieces or King safety. It weakens the kingside for White (e.g., g3 square).
10... Ba6? Black - Piece Activity, - King Safety Flag: Requires Depth. The engine's top move 10... Qa5 is a clear + Center/Activity principle by attacking the c4 pawn. The played 10... Ba6 is a passive development that misses a clear tactical opportunity and costs -1.3 eval points.
11. hxg6?! White - King Safety (Opening the h-file) Opens the h-file, which can be useful, but the immediate threat is on White's King, not Black's.
11... hxg6?! Black - Pawn Structure Control Flag: Requires Depth. Engine prefers 11... fxg6 to keep the h-file semi-closed and maintain the pawn structure integrity. Capturing with the h-pawn (-0.88) is a Miscalculation that leads to a less favorable position than fxg6 (-1.69).
14. Bd3?? White - Tactical Awareness (Blunder) White ignores the immediate threat to the c4 pawn and plays a developing move, leading to the crushing 14... Rxb2 (not played by Black, but the engine's best move). This is a Blunder of an immediate tactical threat.
14... d5?? Black - Tactical Awareness (Blunder) Flag: Requires Depth. Missing the obvious tactical win 14... Rxb2, which wins a pawn and completely undermines White's position. This is an enormous Blunder (eval swing from -6.68 to -2.42).
15. Bxg6? White - King Safety, - Tactical Awareness White attempts a king-side attack but simply allows another clear win for Black: 15... Rxb2. This is a classic example of over-aggressiveness and ignoring opponent's threats.
15... fxg6?? Black - Tactical Awareness (Blunder) Flag: Requires Depth. Black misses 15... Rxb2 again, this time swinging the eval back to equal (0.00). This is a massive tactical oversight (Blunder) where they ignore a material-winning opportunity to simplify the position.
Moves 16-20 Both - King Safety (White), + King Safety (Black) White focuses entirely on a perpetual check with the Queen, and Black correctly avoids the repetition until move 20. White is violating Material Advantage principle by prioritizing a draw over trying to convert their material lead.
20... Ke6?? Black - King Safety (Blunder) A clear, human King Safety violation. Moving the King out from the back rank and directly into the center without support is almost always a bad idea, even if the engine's best defense is hard to find.
21. cxd5+?? White - Tactical Awareness (Blunder) Flag: Requires Depth (Maybe). While the principle violated is Tactical Awareness, the engine's best move 21. Qg4+ is a very sharp follow-up. White chooses the simpler cxd5+ but misses the forcing checkmate line that Black can now enforce (if Black plays the right defense).
22. Qxg7 White + Material Advantage White captures material and gains a decisive advantage, but misses the best line.
24. Qxf8?? White - Tactical Awareness (Mate in 2 Blunder) This is a crushing Blunder where White misses the Mate in 2 with 24. Rh6+. A classic example of focusing only on material (Qxf8) while ignoring forcing tactical lines (Rh6+).
24... Qxc3+ Black + Tactical Awareness, + Piece Activity The start of a forced checkmate.
25... Qd2# Black + Tactical Awareness (Checkmate) The final move that utilizes piece activity and the exposed White King.
Summary of Flags and Critical Principles
Critical Principle Violations:
White's early 5. Bxf6?! and 9. Nxc6?!: White repeatedly violated the Pawn Structure Control and Piece Activity principles by trading pieces for no tactical or strategic gain, granting Black the Bishop pair and better central control.
White's 7. h4 and 10. h5?!: White grossly violated the Development and King Safety principles by initiating a flank attack without completing development, which ultimately led to their king being exposed later in the game.
Black's missed ...Rxb2 (moves 14 & 15): Black violated the Tactical Awareness principle twice by missing a clear, material-winning opportunity.
Moves Flagged as Requiring Unlikely Depth:
These moves involve large eval swings where the human player failed to find the engine's best move.
10... Ba6? (Black): The top move 10... Qa5 is a clear tactical shot against c4. Missing this is a tactical oversight, but finding the -2.20 to -0.90 swing is deep.
11... hxg6?! (Black): The engine prefers 11... fxg6 for better pawn structure and King safety. Deciding between two captures for a -0.88 difference is an advanced strategic point.
14... d5?? (Black): Missing the absolute crushing 14... Rxb2. This is a tactical blunder, but the resulting position is so complex (eval -6.68) that finding the best defense after the blunder is an engine task.
15... fxg6?? (Black): Missing 15... Rxb2 again. This is a gross tactical oversight, not a depth issue.
21. cxd5+?? (White): Missing the engine's best attacking line 21. Qg4+ to simplify. The depth is needed to evaluate the sharpness of the position.
The game was decided not by deep positional principles but by a series of critical tactical oversights and blunders by both players in a highly volatile middlegame.