Is there a data file somewhere containing every single (FIDE) rated game?
What I found out so far
I see many websites with some limited database search capability, or summary statistics, but I couldn't find anywhere to simply download a complete dataset of FIDE games.
Such a dataset would have each row being a new game, and would hopefully also contain who played, who won, when it was played, and other info.
(Very) Rough size estimate
I estimate such a file would be quite large, which I base of some extremely rough estimates
- How many FIDE players? (probably) tens of thousands
- How many games on average per year? Probably hundreds
- Therefore 10000 * 500 = 5m games per year
- 5m games per year * about 100 years comes to about 500m rows
If each row is approximately 1kb, the total file size (uncompressed) would be: half a terabyte!
But still, tools like spark or bigquery could easily handle this, and it would be fun to analyse if it is available somewhere in its entirety.