[HN Gopher] ChatGPT creates phisher's paradise by serving the wr...
___________________________________________________________________
ChatGPT creates phisher's paradise by serving the wrong URLs for
major companies
Author : josephcsible
Score : 97 points
Date : 2025-07-04 18:31 UTC (4 hours ago)
(HTM) web link (www.theregister.com)
(TXT) w3m dump (www.theregister.com)
| kristopolous wrote:
| It's wild how many of the links are hallucinations.
|
| Maybe the error rate is consistent with everything else, we just
| eisegesis our way into thinking it's not
| Kesseki wrote:
| This is, in turn, making the world of comment and forum spam much
| worse. Site operators could tag all user-submitted links as
| "nofollow," making their sites useless for SEO spammers. But
| spammers have learned that most LLM content scraper bots don't
| care about "nofollow," so they're back to spamming everywhere.
| mananaysiempre wrote:
| I'm not sure if even for traditional search engines "nofollow"
| means that the scraper doesn't follow the link, or that it just
| does not include it in the PageRank or whatever graph but still
| uses it for to discover new pages. (Of course, LLMs are far too
| impenetrable for such a middle ground to exist.)
| 9283409232 wrote:
| I've been using Phind lately and I think they do a really good
| job avoiding this problem. I don't think I've ever run into a
| fake URL using it. As a search engine, I think I still prefer
| Kagi but Phind is a great if you want a free option.
| ks2048 wrote:
| The study they link to: https://www.netcraft.com/blog/large-
| language-models-are-fall...
|
| It seems they are selling some product to protect against this.
| So, I could believe the headline here, but less confident that
| this is an unbiased look at the problem.
| sublinear wrote:
| > "It's actually quite similar to some of the supply chain
| attacks we've seen before [...] you're trying to trick somebody
| who's doing some vibe coding into using the wrong API."
|
| I have renewed faith in the universe. It totally makes sense that
| vibe coding would be poisoned into useless oblivion so early in
| this game.
| boleary-gl wrote:
| I wonder if Cloudflare's new plan for blocking AI from scraping
| the "real" sites...
| zahlman wrote:
| You wonder if the plan is (or does) _what_?
___________________________________________________________________
(page generated 2025-07-04 23:00 UTC)