Subj : Re: Local host shows as new sign up
To   : Rixter
From : CJ
Date : Wed Aug 07 2024 18:43:00

-=> Rixter wrote to echicken <=-

 >   Re: Local host shows as new sign up
 >   By: Rixter to All on Tue Aug 06 2024 20:46:05


 Ri> My web page is on port 8080 and 23 new users have used it for sign up
 Ri> or browsing. The connection to the imap for 2 1/2 days now is
 Ri> fascinating. What do they do with all that connection time. Lol

To help cut down on some of the webcrawler traffic, create a robots.txt file
and put it in your webroot directory.  If you're using webv4 that would be
/sbbs/webv4/root.  In the robots.txt file, all you need really is three lines:

User-agent: *
User-agent: AdsBot-Google
Disallow: /

It won't eliminate all of the webcrawler traffic as there are some that ignore
it, but it will stop many from indexing everything on your site.



Chris (CJ)
SysOp - CJ's Place BBS

.... Gone crazy, be back later, please leave message.
--- MultiMail/Linux v0.52
 þ Synchronet þ CJ's Place, Orange City, FL - cjsplace.thruhere.net

.