Post Akn2eCxnwhXfC4Co8e by lime@hachyderm.io
 (DIR) More posts by lime@hachyderm.io
 (DIR) Post #AkjNL5fi9ZRVTud0L2 by foone@digipres.club
       2024-08-07T17:41:46Z
       
       0 likes, 0 repeats
       
       Moving my sites over to gopher to avoid AI scraping
       
 (DIR) Post #AkjNVEl7DqVSYozhaa by coyoteseattle@mastodon.mechanicalmischief.com
       2024-08-07T17:43:47Z
       
       0 likes, 0 repeats
       
       @foone Ah, finally, people embracing the superior protocol.
       
 (DIR) Post #AkjNh5qACuGiNK0c08 by lime@hachyderm.io
       2024-08-07T17:45:36Z
       
       0 likes, 0 repeats
       
       @foone i'm sort of curious to try the gzipped 20TB robots.txt myself
       
 (DIR) Post #AkjNr0Sh3juuacl3Im by jimp@masto.ai
       2024-08-07T17:47:48Z
       
       0 likes, 0 repeats
       
       @foone It's a shocker that the finger protocol hasn't caught back on for personal info/pages.Especially given how poorly AI handles hands.
       
 (DIR) Post #AkjNyEkwJOhowwjwwK by foolishowl@social.coop
       2024-08-07T17:49:14Z
       
       0 likes, 0 repeats
       
       @foone That's been one of the arguments in favor of Gemini, although that's literally arguing for security through obscurity.
       
 (DIR) Post #AkjOoI8wxmL4VtnBsu by denebeim@mastodon.social
       2024-08-07T17:58:01Z
       
       0 likes, 0 repeats
       
       @foone so are you setting it up so all scrapes send back the script to caddyshack?
       
 (DIR) Post #AkjPp46MkspXCwW5Ca by catbuttes@freeradical.zone
       2024-08-07T18:09:43Z
       
       0 likes, 0 repeats
       
       @foone brb. Moving my AI scraper over to gopher for the superior content… (I joke. Maybe we can encourage AI scrapers to all move to their own protocol and just scrape each others output forever though)
       
 (DIR) Post #AkjQau1HXj6nq4wu3s by benpocalypse@mastodon.social
       2024-08-07T18:17:24Z
       
       0 likes, 0 repeats
       
       @foone Don't forget about Gemini!
       
 (DIR) Post #AkjU6TWtrqKOoKU7aS by sen@hachyderm.io
       2024-08-07T18:57:49Z
       
       0 likes, 0 repeats
       
       @foone Yessss join the almost-hundreds of gopher enthusiasts who are still out here maintaining our gopher holes and interfaces :D
       
 (DIR) Post #AkkNqSqOFAzrU4Xjjk by foone@digipres.club
       2024-08-08T05:21:00Z
       
       0 likes, 0 repeats
       
       @NekoEd yay
       
 (DIR) Post #Akm4E7AIt3tuQnmG80 by prettygood@socially.drinkingatmy.computer
       2024-08-09T00:52:54.291563Z
       
       0 likes, 0 repeats
       
       @lime @foone ... Link? I'll serve this as a middle finger to every single scraper
       
 (DIR) Post #Akml19dOgv42M0S68O by phoenix@chaos.social
       2024-08-09T08:51:04Z
       
       0 likes, 0 repeats
       
       @foone I've heard the cool kids use gemini (protocol not the AI) nowadays.
       
 (DIR) Post #Akn2eCxnwhXfC4Co8e by lime@hachyderm.io
       2024-08-09T06:02:45Z
       
       0 likes, 0 repeats
       
       @prettygood @foone i don't have one made but you can make one with gzip and a hex editor, just compress a file with like 100 of the same character and change the count in the binary
       
 (DIR) Post #Akn2pmftVrq38RLduC by fedops@fosstodon.org
       2024-08-09T10:21:26Z
       
       0 likes, 0 repeats
       
       @prettygood @foone @lime except the really bad ones don't bother with robots.txt. Which is the actual problem.Put a rate-limiting firewall in front of your server. Achieves the same thing (slowing the opponent down) but for every single page load.