This script pulls down the current list of events on the Bug Jar web site - can be manipulated later to fit into an RSS feed or iCal Calendar (for example).
This script utilizes the excellent Webscrape utility.
Comment on 'Bug Jar Event Scraper'
This script pulls down the current list of events on the George Eastman House web site - can be manipulated later to fit into an RSS feed or iCal Calendar (for example).
This script utilizes the excellent Webscrape utility.
Tags: scrape, events, films, perl
Comment on 'Eastman House Event Scraper'
This application scrapes the excellent anonymous proxy list available at Proxy 4 Free (I use to use Stay Invisible), filters them, and renders them appropriately for most applications. For example, the SwitchProxy extension to Firefox plays nicely with this.
I've made a copy of the program available for all to use, to which the query string options are:
Updated 2005-02-10: Requests are now cached daily. I was afraid that too many requests might upset the server owners, whom provide such an excellent service.
Updated 2005-11-16: Stay Invisible removed their free proxy lists, so I'm now using a different service that seems comparable.
Tags: perl, scrape, proxy, popular
119 Comments on 'Anonymous Proxy List'
There was a post the other day to Boing Boing concerning the fact that Ken Lay is paying to have links to his defense placed on Google and Yahoo. A friend of mine wrote a brief example of how to automatically click the links using Perl and I thought I could probably do better. Below is my attempt at it - uses a proper User Agent, proper referrers and bounces through multiple, anonymous, proxies to get the job done. Thank goodness for WWW::Mechanize.
Tags: corp:google, corp:yahoo, humor, perl, scrape, search
The script scrapes the Yahoo TV web site and converts the results into an RSS feed. You can set the station, channel, and duration in the future.
Additionally, I've set up the script, publically, so that anyone can use it. It can be found a the URL below. The configurable options are:
Tags: convertor, perl, rss, scrape, tv
This script and module are designed to scrape the course section information made available on the RIT Schedule of Courses. The module is a proper Object-Oriented Perl Module which can be easily ported from one application to another. This script is used for the current version of the Schedule Maker.
Tags: module, perl, rit, scrape
This is a partial mirror of one of my favorite Internet pastimes: lowbrow.com. This mirror of over 15,000 entries was made over the course of a night, until I got in trouble by their ISP. Nonetheless, here's the results - plus with the ability to link to a specific post, something the official one lacks.
Tags: db, web, humor, perl, mysql, scrape
This is the script that I wrote to retreive entries from lowbrow.com, one of my favorite Internet pastimes.
The only unmentioned point is that there should be some sort of 'Unique' restriction placed on the database to keep duplicate entries from being entered. The only way to access entries on lowbrow is by randomly retreiving on from the home page - which means lots of duplicates, and it becomes progressively harder to get new entries as you progress.
Comprehensive DOM, Event, Animation, and Ajax JavaScript Library.
The best techniques for professional JavaScript. Published by Apress.
