Web Fetching

This is a Perl script that grabs the latest news from Bangkok Post (Thailand) English newspaper and displays it in a web page via SSI (or as a new page - directly linked to the script).

This free perl script will fetch the headlines from MaximumEdge.com and display them with links to their articles on your website. You can choose which categories to display including business, entertainment, health, international, sports, tech, US, and more.

This CGI script lets you extract the local and international Chinese news headlines from Sin Chew Jit Poh newspaper (Malaysia) and display them on your web page.

This is a CGI script that allows you to extract the forex info from The Star newspaper (Malaysia) and display them on your web page.

Display live KLSE stock summary on your web page. To make the stock summary more stable, this program is separated into two scripts.

A CGI script for extracting the news headlines from The Star newspaper (Malaysia) and displaying them on your web page.

NortelNews is a news grabber for Corporate news released by Nortel Networks. Update it once a day or even more often to keep interesting dynamic content on your web site. Its in perl. It is not a CGI but could be converted very easily.

SomeNEWS allows you to check for articles on the net, filter it, take off the HTML, etc. It can be used to make Web portal, or have article locally on you PC, etc.

News Clipper is an application which allows you to integrate information from around the internet into your own personal web page - in your own personal style. It accomplishes this by snipping content from pages that you define and shipping them to destination pages of your design. This automated process is executed at your discretion while you maintain complete control over the content input and output. News Clipper can be used to retrieve information from web pages, Usenet articles, text files on the internet, FTP sites and has the ability to locate hidden text within html pages that wouldn't normally be viewable. You may choose to extend News Clipper to include information stored locally, enabling an intranet integration of an enterprise's own database of information. In addition, News Clipper's unique Handler architecture ensures versatility and future compatibility with the ever-changing World Wide Web.

Sitescooper automatically retrieves the stories from several news websites, trims off extraneous HTML, and converts them into formats you can read on your Palm computing device for later reading on-the-move. It maintains a cache, and will avoid stories you've already read. It can handle 1-page sites, 1-page with diffing, 2-level and 3-level sites, and it's very easy to add a new site to its list. Even if you don't have a Palm handheld, it's still handy for simple website-to-text conversion.

Finance::Quote is a perl module that fetches delayed on-line stock quotes. The Finance::Quote can fetch quote from a variety of sources, including the NYSE, the ASX, and a number of European exchanges.

getstockquote is an embeddable Perl script that fetches stock or mutual fund data from a variety of sources. It uses command line arguments for grabbing data and so can be used in different ways without altering the script itself. It's "embeddable" because it was designed to be run from within another HTML framework such as via server-side execs, regular CGI scripts, or PHP. It gets data from: NYSE quotes, Europe quotes, Fidelity Investments Quotes, T. Rowe Price, Vanguard Group, Australian quotes from ASX, and Annuities from TIAA-CREF.

Trying to browse to a server that's inaccessible to you? This CGI script may be what you need. It acts as an HTTP proxy, and can be a bridge between a browser and an otherwise inaccessible server. It also makes your requests anonymous, so you can set up your own server like The Anonymizer. Very simple to install; runs in either Perl 4 or Perl 5. Configurable options include cookie support, text-only support, simple ad filtering, custom encoding of target URLs, and more.

This script searches in a particular newsgroup for postings and extracts posted urls. newsurl prints a list containing author, subject and posted urls for each posting containing urls. You can specify filters for the subject and/or the author. So you can minimize the download. Optionally a html-output can be generated.

This script allows you to fetch a specified Web page using HTTP, FTP and GOPHER, and parses it for links counting them as it goes. With multiple sites it will calculate the average links per webpage. The script requires the Win32::Internet module.

Webget is a Perl script that downloads a list of specified URLs at night. It is only useful if you do not have to pay on a per-minute scale for your Internet connection; its advantages are that you will reach higher speeds with most ISPs, and you do not have to download while you are using your Internet connection for other things too. It consists of two files: a CGI-script that makes a database from a list of URL's that you enter with your browser, and a Perl-script that parses the database and calls wget to download all files.

This is a simple Perl script that takes a list of books and looks to see if they are considered published on fatbrain. It requires the LWP module.

This simple PHP script allows you to capture the headlines of Geeknews.Org and prints as HTML page.

This is a PHP script that allows you to capture the headlines of Linux-2000.Org and print them right on your Webage.

Retrieve articles from one newsgroup to which no reply has yet been posted. Articles are all printed to the standard output. Progress messages are printed to the standard error handle.