Inout WebCrawler Plus
Inout WebCrawler Plus is a data crawling and web spider script designed for small/medium sized search engines. This powerful script is built on MongoDB and Apache Solr. Inout WebCrawler Plus is capable of crawling and indexing large amounts of data and run queries with high speed and great accuracy. Features include # Scalable Architectural Design # XML Search Output # Intelligent Result Identifier System # Global/Individual Domain Depth Control # Managed/Automated Crawling # Global/Individual Control for Automated Crawling # Search Logs # Statistics