Long index creation in Opening Explorer & Tablebase

@TotalNoob69
Why is it taking so long for lichess to index the base of a certain player's moves in the opening explorer?
Is there any way to speed up this process?
Where is this indexed database physically stored?
s the index creation speed related to the LiChess Tools extension?
I use Chrome on Windows.
I have to wait a few minutes for a database of moves for 300 games to be created. All this time there is an inscription "indexing NN other players first".
After the first move, it creates the index again for several minutes, although the index was already created before the first move. And so again and again after each move. Why?

@DikiyDrozd the Opening Explorer uses the Lichess database. It is updated, rarely I am afraid.

@TotalNoob69 said in #2:

@DikiyDrozd the Opening Explorer uses the Lichess database. It is updated, rarely I am afraid.

In other words, LiChess Tools does not interfere in this process in any way and there is no way to speed it up somehow due to local caching?

@DikiyDrozd said in #3:

In other words, LiChess Tools does not interfere in this process in any way and there is no way to speed it up somehow due to local caching?

LiChess Tools expands that with values from local computer eval, ChessDb stats, etc. but cannot affect the information stored on the server of Lichess.

@TotalNoob69 said in #4:

LiChess Tools expands that with values from local computer eval, ChessDb stats, etc. but cannot affect the information stored on the server of Lichess.

The progress statistics on the Masters and Lichess Database tabs are displayed without delay. But when you open the Player tab, Lichess thinks for a long time after each move.

And I would like to speed up the study of the moves of the selected player.

A lot of players have complained about this. The logic is that if you look at openings in general, even with some filters, it's something relatively generic, that can be cached and made accessible with ease. But individual player stats are not. That is why whenever you ask for them, a process to extract them is put into a queue and may or may not fully reach you.

You can download all of the games of a person, use PGN Editor to find all kinds of things, but it's cumbersome, not to mention slow.

In order for LiChess Tools to improve this, it would have to have access to the entire Lichess database of games. And while that can be made possible, it's prohibitive in terms of accessibility, maintenance and cost. LiChess Tools works exclusively on your machine, there are no servers for it and I don't plan any anytime soon. And asking people to download the DB on their computer (all 2.1TB of compressed PGNs) and run it is not feasible.

I am planning something that might help with that, a downloadable Windows app that will be able to handle large volumes of data, caching, etc, but I have to make the time for it. Plus I don't think there are enough people interested at the moment.

@TotalNoob69 said in #6:

In order for LiChess Tools to improve this, it would have to have access to the entire Lichess database of games. And while that can be made possible, it's prohibitive in terms of accessibility, maintenance and cost. LiChess Tools works exclusively on your machine, there are no servers for it and I don't plan any anytime soon. And asking people to download the DB on their computer (all 2.1TB of compressed PGNs) and run it is not feasible.

Thank you for your detailed answer!

Overall the problem is clear. There is no need to download the entire 2.1 TB database. I am interested in the moves of one specific player for one color. Usually it is not more than 1k games. In difficult cases 20k games. These 1k or 20k games could be cached.