Update on the initial scan: 91 servers (of 488 found in the indexes) scanned, 397 pending, 11 unreachable. 579,936 selectors with 2,193,285 descriptions. Data set is 569MiB in size.
I'm stopping my scans for today, will resume them tomorrow.
Update on my scan of gopherspace.
725 servers identified
84 unreachable
6 restricted due to robots.txt or manual exclusion requests
325 scanned completely
1 in progress
393 pending
1,269,190 unique selectors, 5,699,901 descriptions.
The scan will continue (slowly). I'm going to start writing the new front end for doing searches of the collected data next week.
If you have a fediverse account, you can quote this note from your own instance. Search https://mastodon.bsd.cafe/users/crc/statuses/115707871602207347 on your instance and quote it. (Note that quoting is not supported in Mastodon.)