Post AbZAxjsSdFELJ10sHQ by travissouthard@jawns.club
(DIR) More posts by travissouthard@jawns.club
(DIR) Post #AbZAxjsSdFELJ10sHQ by travissouthard@jawns.club
2023-10-02T01:02:50Z
0 likes, 0 repeats
Not sure if I totally trust that it will be effective but I did add a robots.txt file and robots meta tag to my website to tryyyyy to block bots crawling my website to feed AI models.The blog I based my changes on: https://neil-clarke.com/block-the-bots-that-feed-ai-models-by-scraping-your-website/The changes I made: https://github.com/travissouthard/travissouthard.github.io/pull/27#robotstxt #robotsdottxt #webdev #noai #ai
(DIR) Post #AbZAxkox7m1CEQNaS0 by Mojeek@mastodon.social
2023-11-07T13:29:24Z
0 likes, 0 repeats
@travissouthard the meta tag approach needs to be accepted and standardised! we've got an open letter to that effect: https://noml.info/
(DIR) Post #AbZAxlei1LQ0owav7g by iron_bug@friendica.ironbug.org
2023-11-07T14:47:06Z
0 likes, 1 repeats
I think, AIBL (like DNSBL, etc) would be more effective. global IP ban for those who tries to steal data, not respecting robots.txt.
(DIR) Post #AbZQMMvma8lcgsllAm by bonifartius@qoto.org
2023-11-07T17:40:45Z
0 likes, 0 repeats
@iron_bug hoping it doesn't get abused like for mail :) @Mojeek @travissouthard
(DIR) Post #AbZY8laetyH4kVui9o by iron_bug@friendica.ironbug.org
2023-11-07T19:07:31Z
0 likes, 0 repeats
public blacklists exist for ages and don't get abused.
(DIR) Post #AbZeU7myA92pP3EuFU by bonifartius@qoto.org
2023-11-07T20:19:00Z
0 likes, 0 repeats
@iron_bug some of those blacklists hold IP ranges hostage without any sane way of getting removed. i run some rspamd installations and spam almost universally is removed by greylisting (temporarily declining a mail). the blacklists do almost nothing now in my experience.@Mojeek @travissouthard