Btcbase.org snarf: first run

In response to: http://trilema.com/2019/trilema-goes-dark/#comment-130477

SIGNED plaintext version of below text is available at: http://blog.lobbesblog.com/static/btcbase_snarf_attempt1.asc


On 2 Aug. 2200 hrs (NYC time), I generated a snapshot of Phf's btcbase.org/log/, using the method outlined in http://nosuchlabs.com/pub/snapshot_signed.txt :

'wget --recursive --no-clobber --page-requisites --html-extension --convert-links --domains btcbase.org --reject log-search  btcbase.org/log/'

Resulting item :

btcbase_scrape.tar.gz

sha512=7a6e62f2f1c456ea2d17596434b8acf86fbd4f76e3cd78795075a3a296aa7d8e5aebf8e63b00145928e6ad61be4b3742bca3068794c00ffdd452c993a3d9fb3e

This has been made available at:

http://blog.lobbesblog.com/static/btcbase_scrape.tar.gz

NOTE: The sha512 between this and asciilifeform's original snarf (http://nosuchlabs.com/pub/btcbase_snap.tar.gz) DIFFERS

Standard diff between the two has been run and made available at:

http://blog.lobbesblog.com/static/btcbase_snap_diff.txt

Please see following thread for more details: http://logs.bvulpes.com/asciilifeform?d=2019-8-3#476022

I will be doing a second run with proper wget error logging as well as rate-limiting to rule out simple time-out issues. More to come.

3 Responses to “Btcbase.org snarf: first run”

  1. Seems like his v-viewer may have timed out on some reqs?

  2. admin says:

    Yeah, may have. I started a second run last night before bed, but this time with a 3 second wait in-between requests and with eggog logging. Hopefully will be able to tell for sure once it completes (woke up this morning and it was still churnin')

  3. admin says:

    Update: Second run resulted in the same hash as the first run. Still have yet to pinpoint why this was the case, but I have uploaded the wget logfiles:

    http://blog.lobbesblog.com/static/wget_log_404_Not_found.txt
    http://blog.lobbesblog.com/static/wget_logfile.txt

    For now, though, I will move on to do some comparison of my local logs to what was on btcbase. Then I still need to work on my own logotron.

Leave a Reply