Perl daemon crawler script
Features of Perl daemon crawler script
The heart of this script is a perl daemon which runs continuously in the background and spiders search results from 10 different search engines.
All the major search engines are efficiently searched using perl LWP and spidering and regex regular expressions
Search engine urls can be added easily.
Admin will be emailed Search results. Mysql Database is used for efficiency and all tables were indexed using mysql guidelines and made faster.
Click for more projects under Spider Pattern Content category