[HN Gopher] BitTorrent Site Magnet Database Archives Available v...
       ___________________________________________________________________
        
       BitTorrent Site Magnet Database Archives Available via Torrent and
       Direct DL
        
       Author : metadat
       Score  : 30 points
       Date   : 2022-05-21 19:39 UTC (3 hours ago)
        
 (HTM) web link (archive.org)
 (TXT) w3m dump (archive.org)
        
       | slowbdotro wrote:
       | 2016 database, someone needs to update it. And how does one even
       | get all the magnet links like this?
        
         | nulptr wrote:
         | One way is querying the dht
        
       | 5evOX5hTZ9mYa9E wrote:
       | How is this different from https://torrents-csv.ml/?
        
       | jokoon wrote:
       | Funny, most of those torrent got a __padding_file, which comes
       | from bitcomet, a bad torrent client... I think?
       | 
       | Other thing, I realized that there are less and less torrent
       | indexes those last 5 years, they all end up offline or full of
       | ads.
        
         | banana_giraffe wrote:
         | It's part of BEP-47 [1], an extension meant to make it easier
         | to handle single file downloads and multiple torrents serving
         | the same file. BEP-47 aware clients, which is most of them
         | these days, I think, hide these files from the user.
         | 
         | [1] https://www.bittorrent.org/beps/bep_0047.html
        
         | duskwuff wrote:
         | > Funny, most of those torrent got a __padding_file
         | 
         | Those are supposed to be hidden by clients. They represent
         | "free space" between files, allowing clients to download
         | individual small files without having to also download the
         | files adjacent to them.
        
       | banana_giraffe wrote:
       | A different torrent metadata archive (.torrent files) that's
       | somewhat more up to date:
       | 
       | https://archive.org/details/torrent_metadata_archive_sample
       | 
       | (Though, in practice not as easy to download, you need to
       | download a tar ball for each month, the naming is predictable, so
       | you can at least script the download)
        
       | baobob wrote:
       | Here is one of thepiratebay up to 2019:
       | https://archive.org/details/ThePirateBayMarch2019
        
       | gaius_baltar wrote:
       | Let's not forget one of the best approaches for indexing magnet
       | hashes: https://btdig.com . It basically connects to the DHT and
       | listens to queries. When a new one is found, it downloads the
       | torrent data and indexes it.
        
       ___________________________________________________________________
       (page generated 2022-05-21 23:00 UTC)