Post B2vDhUCIeKpdBfot16 by dave@podcastindex.social
(DIR) More posts by dave@podcastindex.social
(DIR) Post #B2vDhUCIeKpdBfot16 by dave@podcastindex.social
2026-02-02T20:29:12Z
0 likes, 0 repeats
Index getting hammered by a new user-agent skirting right under the rate limit sustained. Manual 429 deployed.
(DIR) Post #B2vE3P2iUjezZUmvFw by podhome@podcastindex.social
2026-02-02T20:33:13Z
0 likes, 0 repeats
@dave which one? I’m seeing tons of traffic as well from AI scrapers. It’s a constant battle
(DIR) Post #B2vFBNjFMdFBlc38oS by awoodsnet@phpc.social
2026-02-02T20:45:51Z
0 likes, 0 repeats
@dave try treating the current rate limit as a maximum. Then randomly drop the limit throughout the day by say 40% or some number between those two values. Using easy math lets say 100 has been your default. Pick a random number between 60 and 100 to be the limit every 30 minutes. so it looks something like 72, 64, 91, 83, 70, 85, 61, and and keeps changing until you toggle it off
(DIR) Post #B2vtiuYwJ2o1K0lt7g by russell@podcastindex.social
2026-02-03T04:20:07Z
0 likes, 0 repeats
@dave what is the user-agent please.
(DIR) Post #B2xCd4EHXqEBquznpA by ericpp@podcastindex.social
2026-02-03T19:26:41Z
0 likes, 0 repeats
@dave I have some code to implement a PoW check for the PodcastIndex site if you want. It's on every single API request and could slow things down a tad.Alternatively, I could have it do a longer PoW check when you load the site and then skip checks on each request.