Post AadUlIQFKnGCnxF9BQ by cjerrington@mstdn.social
 (DIR) More posts by cjerrington@mstdn.social
 (DIR) Post #AadSnFzN9YB9vcTqs4 by cjerrington@mstdn.social
       2023-10-10T16:44:00Z
       
       0 likes, 1 repeats
       
       What should we do about Robots and AI? https://claytonerrington.com/blog/robots-and-ai#100DaysToOffload
       
 (DIR) Post #AadSrZ4w7UHCIC8Z72 by hyde@lazybear.social
       2023-10-10T18:35:33Z
       
       0 likes, 0 repeats
       
       @cjerrington thanks for the list 🙌 hopefully they won't crawl ... But I have my doubt about that
       
 (DIR) Post #AadUlIQFKnGCnxF9BQ by cjerrington@mstdn.social
       2023-10-10T18:56:46Z
       
       0 likes, 0 repeats
       
       @hyde There is a long history of web crawlers not adhering to the robots.txt file, though. It's always worth adding it for the ones that do.
       
 (DIR) Post #AadVhGdI97Bg3AzJUO by hyde@lazybear.social
       2023-10-10T19:07:18Z
       
       0 likes, 0 repeats
       
       @cjerrington I know ... But, I dont trust any of them to be honest