[HN Gopher] Fclones - an efficient duplicate file finder and rem...
       ___________________________________________________________________
        
       Fclones - an efficient duplicate file finder and remover
        
       Author : feross
       Score  : 27 points
       Date   : 2022-05-06 18:32 UTC (4 hours ago)
        
 (HTM) web link (github.com)
 (TXT) w3m dump (github.com)
        
       | ZeroGravitas wrote:
       | Coincidentally I was looking through the list of apps that do
       | this the other day, I think I looked at all the other ones they
       | list as competitors.
       | 
       | My particular use case involved images that might be very near
       | duplicates (screenshots of the same web page), which some of the
       | tools cover, though it feels like a slightly seperate task from
       | the exact bit duplicates, so not all do it.
       | 
       | One interesting one I found that wasn't listed in the Readme
       | (edit, it was there, I just didn't spot it on first read through)
       | was:
       | 
       | https://github.com/kornelski/dupe-krill
       | 
       | Which had some notes about their use of BTreehashes to
       | progressively compare files. Not sure how much difference it
       | makes in practice but sounded elegant.
        
       | mastax wrote:
       | I just used fclones the other day on a 20TB archive of mostly
       | videos at work. Saved 1.8TB by hard linking the duplicates.
       | 
       | I like how fclones makes it easy to have a two stage process
       | where you scan for duplicates and populate a text file, that you
       | can then pipe in to take action. You can inspect the paths to
       | make sure it's okay and decide what to do.
        
       ___________________________________________________________________
       (page generated 2022-05-06 23:01 UTC)