Developer update: 275% improved game compression

Thanks Revoof and everyone else behind the scenes that work hard to let us play chess for free. You're the best!

this is great! I love hearing and reading about these developer updates too.
@revoof
one question: if 275% improved game compression and an expect save about 70 GB, does that mean that the old database was 110 GB Big and the new database will be 40 GB big ?

I am simply amazed by the engineering quality of this site. I am a developer and seeing this is a great inspiration. Thanks!

@savagechess2k First less than half of those games are rated. But even then the opening explorer is only a sample based on time control and rating (github.com/ornicar/lila/blob/master/modules/explorer/src/main/ExplorerIndexer.scala#L118-L137). With the current number of games it fits on a cheap SSD and is easy to backup and move around if nescessary.

@JuicyKetchup: Ha, awesome! What kind of course is this?

@Cuxhaven Yes, or at least the raw move data. This doesn't include meta data (like players, clock times, results, etc). And it also doesn't include the other database collections. The second biggest one is chat messages. All in all the 480 GB SSDs were just about full.

@revoof
It is essentially CS2, where we teach basic data structures like Lists/Stacks/Queues/Trees and such :]

I don't know anything about coding and such, but what does this mean to the community of lichess?

so how many bytes would a game with 40 moves approximately need?

edit: oh, it's 4-5 bits per move, question withdrawn

@SlicingBishop2006 @Journey_to_NM Sorry, this post was mostly written for developers. The result is that we will have to buy more expensive servers less often, and more importantly that developers can focus elsewhere for now, maybe using the space for some new features :)

as they say;
amazon is a technology company not a retail company
air bnb is a technology company not a room letting company
uber is a technology company not a cab company
LICHESS is a technology site not a chess site!
(and i mean that as the biggest compliment :) )