Subj : Re: File base with FTP Name with dot in it?
To   : mark lewis
From : Bj”rn Wiberg
Date : Thu Apr 07 2022 09:50 am

Hello Mark!

Thank you for your reply!

On 06 Apr 2022, mark lewis said the following...
 ml> if the cd succeeds they do an ls to see if there's file and directories
 ml> in it... if there are, they download them and continue walking through
 ml> the directories...

OK! Thanks!

 ml>  BW> or if they just conclude "not a file" and skip it. (According to the
 ml>  BW> spec, they shouldn't look for anything inside that directory, if it
 ml>  BW> exists.)
 ml> 
 ml> what spec is that?

I was thinking of this one:

https://developers.google.com/search/docs/advanced/robots/robots_txt#examples-o
f-valid-robots.txt-urls

http://example.com/folder/robots.txt
"Not a valid robots.txt file. Crawlers don't check for robots.txt files in subdirectories. "

Best regards
Bj”rn

--- Mystic BBS v1.12 A48 2022/03/26 (Linux/64)
 * Origin: Star Collision BBS, Uppsala, Sweden (2:201/137)

.