Everything behind the paper: the data, the code that produced every table, and the ledger of every claim considered, including the ones that failed checking.
| file | size | what it is |
|---|---|---|
| PROGRESS.md | 2.7 KB | what was done, what is open, and what was found wrong |
| assemble.py | 3.0 KB | the code that produced or checked the numbers |
| broikos.gr-crawlers.csv | 12.1 KB | a table, recomputable by anyone holding this file |
| broikos.gr-crawlers_verified.csv | 9.3 KB | a table, recomputable by anyone holding this file |
| broikos.gr-format.md | 1.2 KB | a note published with the paper |
| broikos.gr-referrals.csv | 0.1 KB | a table, recomputable by anyone holding this file |
| broikos.gr-traffic.csv | 3.2 KB | a table, recomputable by anyone holding this file |
| broikos.gr-verification.csv | 2.9 KB | a table, recomputable by anyone holding this file |
| broikos.gr-verification.md | 1.9 KB | a note published with the paper |
| claim-ledger.csv | 8.6 KB | every claim in the paper, its status and its source |
| extract.py | 13.4 KB | the code that produced or checked the numbers |
| integrity.py | 9.1 KB | recomputes every headline figure and fails if the paper no longer says it |
| log_inventory.py | 4.2 KB | the code that produced or checked the numbers |
| practice-a-crawlers.csv | 18.7 KB | a table, recomputable by anyone holding this file |
| practice-a-crawlers_verified.csv | 13.9 KB | a table, recomputable by anyone holding this file |
| practice-a-format.md | 1.2 KB | a note published with the paper |
| practice-a-referrals.csv | 0.1 KB | a table, recomputable by anyone holding this file |
| practice-a-traffic.csv | 3.0 KB | a table, recomputable by anyone holding this file |
| practice-a-verification.csv | 3.1 KB | a table, recomputable by anyone holding this file |
| practice-a-verification.md | 2.0 KB | a note published with the paper |
| pull_logs.py | 2.9 KB | the code that produced or checked the numbers |
| ratio.py | 5.5 KB | the code that produced or checked the numbers |
| robots.txt | 0.5 KB | the crawl policy in force during the measurement window |
| sitecfg.py | 2.5 KB | the code that produced or checked the numbers |
| source-log.csv | 3.2 KB | every source consulted, with its retrieval date |
| tables.py | 12.3 KB | the code that produced or checked the numbers |
| verify_agents.py | 18.8 KB | the code that produced or checked the numbers |
Every figure in the paper can be recomputed from these files. If one of them disagrees with the paper, the file is right and the paper is wrong, and it will be corrected in the change log.