Post A8bt49LSSbCzNFtdBY by fristi@kartoffel.cafe
(DIR) More posts by fristi@kartoffel.cafe
(DIR) Post #A8bt49LSSbCzNFtdBY by fristi@kartoffel.cafe
2021-06-24T12:00:55.529778Z
0 likes, 0 repeats
dumped a bunch of robots.txt files in my web rootsfuck bots
(DIR) Post #A8bt76XVLea1XbwKrw by fristi@kartoffel.cafe
2021-06-24T12:01:27.530180Z
0 likes, 0 repeats
but fuck semrush shit in particular
(DIR) Post #A8btCVu6TGhxei5c6S by takao@shitposter.club
2021-06-24T12:02:26.185292Z
0 likes, 0 repeats
@fristi please take responsibility in the aftermath though! Through marriage!
(DIR) Post #A8btQfpWMYjcUkhLrE by fristi@kartoffel.cafe
2021-06-24T12:04:57.913150Z
0 likes, 0 repeats
@takao oh I'll take responsibility alright
(DIR) Post #A8bte0aCW0rwcitIIK by akira@enigmatic.observer
2021-06-24T12:04:47.823179Z
0 likes, 0 repeats
@fristi you know that most bots doesn't give a damn about them right?
(DIR) Post #A8bte14KhyyK8AzMGG by fristi@kartoffel.cafe
2021-06-24T12:07:23.076922Z
0 likes, 0 repeats
@akira I know, I'm cataloguing the used ip addresses to see if I can easily rangeban stuff.
(DIR) Post #A8btmstMTmzpNQ5MWG by fristi@kartoffel.cafe
2021-06-24T12:08:59.671704Z
0 likes, 0 repeats
@akira there's two bad offenders at the moment though, that's the semrush bots (which claims to respect the robots.txt file) and the petal bots (which also claim to do so but has already been noted they do not).The petal bots btw are from chinese search engines. Fuck them.
(DIR) Post #A8btwrwcrAPFKnND2u by akira@enigmatic.observer
2021-06-24T12:08:01.286496Z
0 likes, 0 repeats
@fristi geoip block china and russia :akko_giggle:
(DIR) Post #A8btwsLnLaXUar9JHE by fristi@kartoffel.cafe
2021-06-24T12:10:47.114601Z
0 likes, 0 repeats
@akira I more or less have them blocked already, yes.