How to generate bitcoin-dataset

Requirements

Hardened Bitcoin node (with at least 2TB of SSD storage)
Linux or macOS computer

Caveats

When copy/pasting commands that start with $, strip out $ as this character is not part of the command

Guide

Step 1: create bitcoin-dataset directory

$ mkdir -p /root/bitcoin-dataset

$ cd /root/bitcoin-dataset

Step 2: create bitcoind and electrs archive

$ tar \
  --create \
  --directory /var/lib/bitcoind \
  --use-compress-program=lz4 \
  --verbose \
  anchors.dat \
  blocks \
  chainstate \
  fee_estimates.dat \
  indexes \
  mempool.dat \
  peers.dat | \
  split \
  --bytes 10G \
  --numeric-suffixes \
  - \
  bitcoind.tar.lz4.part

$ tar \
  --create \
  --directory /var/lib/electrs \
  --use-compress-program=lz4 \
  --verbose \
  . | \
  split \
  --bytes 10G \
  --numeric-suffixes \
  - \
  electrs.tar.lz4.part

Step 3: create bitcoind and electrs archive checksums

b3sum \
  bitcoind.tar.lz4.part* \
  electrs.tar.lz4.part* \
  > BLAKE3CHECKSUMS

Step 4: sign checksums

gpg \
  --detach-sig \
  --armor \
  --output \
  BLAKE3CHECKSUMS.asc \
  BLAKE3CHECKSUMS

Step 5: create torrent

$ cd

$ transmission-create \
  --private \
  --tracker https://tracker.sunknudsen.com/announce \
  --outfile bitcoin-dataset.torrent \
  bitcoin-dataset

Step 6: sign torrent

gpg \
  --detach-sig \
  --armor \
  --output \
  bitcoin-dataset.torrent.asc \
  bitcoin-dataset.torrent