Post AzHmaVnPL9dkKUi0jQ by jay@mastodon.gamedev.place
(DIR) More posts by jay@mastodon.gamedev.place
(DIR) Post #AzHZAOuh0Xzw3CKqxc by internetarchive@mastodon.archive.org
2025-10-16T23:01:37Z
1 likes, 1 repeats
The web has a memory — and we’ve saved 1 trillion pages of it! 🌐Join the @internetarchive for The Web We’ve Built, a celebration of the people, stories & technology that preserve our digital world.📅 Oct 22 🎟️ In Person in San Francisco & 🖥️ Virtual worldwide ⤵️https://blog.archive.org/event/the-web-weve-built-celebrating-1-trillion-web-pages-archived/ #Wayback1T #Livestream
(DIR) Post #AzHmaVnPL9dkKUi0jQ by jay@mastodon.gamedev.place
2025-10-17T02:11:48Z
0 likes, 0 repeats
@internetarchive I notice my websites are still being scraped by your bots even though I manually denied all bots in my robots.txt files a year or two ago. WayBackMachine was great before the age of modern AI, but not now. I don't want companies using your APIs to scrape my content to train their AI models. I thought I read if I denied bots in robots.txt, you'd automatically pull related website content from your archives... but my content remains on your servers.
(DIR) Post #AzNGJZMQnkvmsVjBR2 by teezeh@ieji.de
2025-10-19T17:38:55Z
0 likes, 0 repeats
@internetarchive I still remember meeting @brewsterkahle early 2000 and writing this afterwards:https://www.computerwoche.de/article/2680190/brewster-kahle-archiviert-das-internet.html