Information:
Alkaline is a full-featured, stand-alone search-and-index server.
The spider is a fully remote indexing daemon that includes support for all standards, such as robots.txt and "skip" meta tags.
In addition, the program allows for multiple distinct configurations and search groups, tons of options to configure the indexing paths and options for basic authentification.