Site Indexing

PhraseFinder is a multi-purpose mini-search engine that searches a directory of your choice for a specific keyword(s). This pretty utility utilizes the use of templates for 100% customization. This is an EXCELLENT tool for catching those warez, or other illegal content, account holders! You'll be cleaning up your server in NO time!

Blackwidow spider engine will index your entire web server and create an ASCII output file of urls. Explores subdirectory structures. URL database is 100% compatible with exploit submission wizard and WAHOO! The script runs and creates a flatfile database of every single url on your server.

Make money by letting your visitors bid on keywords in your search engine. Includes full admin features, signup bonuses, built in affiliate program and receive payments from your advertisers through Click Bank + Pay Pal + 2Checkout.

Douglas Thrift's Search Engine is an indexing search engine for use on small websites such as personal or small business sites. It is designed to be very similar to Google for end users and its output is customizable. For indexing, it supports both the Robots Exclusion Protocol and the Robots META Tag as specified at http://www.robotstxt.org/wc/exclusion.html.

Fastget is the system to organize a large set of information with care and accuracy without expending enormous time and resources. FASTGET is the system to browse a large amount of information in a systematic and direct manner.

Wordindex is a full text indexing suite developed using perl as the backend and PHP as the web based search utility. Any language can be used to search as long as it has access to MySQL databases. Wordindex is capable of indexing huge amounts of data, one production system has indexed over 14GB of textual, PDF, and compressed text files. Searches on that system are still less than a second on a modest server. Wordindex is clusterable, the indexing process which can take a very long time to complete on a huge dataset (meaning ~10G+) can be run over a couple nodes to spread out the load.

Blackwidow spider engine is an internal web spidering utility that will index your entire web server and create an ASCII output file of urls. Explores subdirectory structures. URL database is 100% compatible with exploit submission wizard and WAHOO.