Puzzle rating question

Hello there,

I am trying to understand how rating points are calculated for puzzles, and it is ... puzzling.

For example, I chose the hardest difficulty, and lichess gave me this:
https://lichess.org/training/JRTxj
I solved it, and got 7 points added to my rating.

Then I chose the easier level, and solved it again, and got 14 points.

How does this make sense? Shouldn't the harder problems give more points than the easier problems?

I agree also this new beta version is a bit puzzling notably I lost 270 points yesterday with only one puzzle wrong (!) starting from 2818. I suppose it'll be fixed in some days.

In Lichess' blogpost about the new puzzle system they say this:

"The puzzles system on Lichess has always used exactly the same rating system as games, Glicko2. Every puzzle attempt is a “game” between you and the puzzle. If you get it right you win, and take your ratings points as the prize. If you get it wrong, the puzzle walks away victorious. (Note that you will get less rating points from themed puzzles as the theme gives a significant hint.) Puzzles that are brand-new will have volatile ratings, and it may take some time for them to find their level."

So the point here is that puzzles have not just a rating but also a rating deviation which states how stable und trustworthy the puzzles rating is. Also additionaly to your own puzzle rating there exists another rating deviation, altough it is not show anywhere on the page. I assume that the puzzle you mentioned had a volatile rating (maybe still has, as it was played only 18 times by the time of writing) resulting in only a small change of your rating after solving it. This is just like your rating adapting only a little after playing someone who just made one of their first games on Lichess and therefore doesn't have a stable rating.

On the other hand the puzzle's rating will have changed sigificantly and also its rating deviation decreased.
When you then got the puzzle again it had a lower rating deviation and therefore had a higher impact on your own rating.

@marsuplami The enormous rating changes were because our puzzle rating deviations have been reset to a high starting value, just as if we were new players. I myself managed to gain 287 puzzle rating points in 52 exercises, with leaps of more than 50 in the beginning. The rating change per puzzle normalizes to values we are accustomed to after solving a few more puzzles though, as our own rating deviation decreases.

Thanks, Lukasel. So, the rating points given or taken depend not on the difficulty of the puzzle itself, but rather on how rated was the player who played the game from which the puzzle was taken from. Correct? Or is it that the puzzle itself has its own rating, regardless of where it was taken from?

The puzzles themselves have their own rating. You can see it in the top left of the puzzle screen along with its link, how often it has been played and which game it's from. The puzzle's rating and the gamelink are hidden though until you solve the puzzle.

I don't know how a puzzle's initial rating is determined. In the blogpost they thank aimchess for releasing a software that can calculate an initial rating for a puzzle (https://github.com/ieshuaganocry/aimchess-puzzle-rating-prediction), but it appears they havn't used it so far (This software has been released open-source only 10 days ago). They assign the initial puzzle rating depending on puzzle length or with a machine learning model that also uses only the puzzle itself. I assume that the initial puzzle ratings Lichess assigned so far are also independent from the game the puzzle was taken from, but I am not sure about that.

Still a puzzles initial rating is often far off. Therefore puzzles that were not played often enough have a rather small impact on your rating, no matter whether you solve them correctly or not.

Of course the difference between the puzzle's rating and your rating is also important for determining the new rating. From it the rating system derives a base value for the rating change. A puzzle that is rated higher than you will gain you more points if solved correctly and you'll lose less points if you do it wrong. However, this base value is then multiplied by a factor depending on how stable your rating and the puzzle's rating are. The more stable a puzzle's rating is, the higher this factor becomes. On the other hand a puzzle with a volatile rating reduces this factor, meaning a low rating change for you. The same goes for your own rating stablility. If the rating system considers your rating to be stable it will not change much per solved puzzle. If it is volatile it will change in big leaps.
(Please note: This explanation is only an approximation of what really goes on behind the scenes because I wanted to spare you the mathematical technicialitys. You can find the details here http://www.glicko.net/glicko/glicko2.pdf or here https://en.wikipedia.org/wiki/Glicko_rating_system)

Now I got to knew that why people are losing much ,
SECRET : BCZ THE LINK OF THE GAME IS NOW hidden!!

I guess I've done over 100 puzzles...says I'm like 2325. My "real" rating is probably closer to 1600, maybe 1700 on a good day. I gave up trying to figure out the + and - because I only care about one thing....it gets me better, and I still get a lot of puzzles wrong. I liked it when I lost over 100 points on one...motivation.

super excited Lichess is improving the puzzles.

I'm guessing most people have a pretty high puzzle rating....so it's relative.

a rating in puzzles is not that tightly related to your actual chess rating, as it assesses only tactical skills. I have achieved a 2830 in puzzles thx to much attention, but am only about 1950 actually when it comes to 15 minutes games