SeattleJobs.org hired Freelock to implement a system to scrape job listings from their customers' web sites. SeattleJobs.org lists jobs from about 45 member companies. In order for Seattle Jobs to automatically list these jobs, the listings have to be provided in a very specific format.
We developed a system to be able to define different patterns of HTML on each of the clients' web sites to extract the text that represented job listings. Before our project, SeattleJobs.org generally had around 150 individual job listings. With our scraper system complete, there are now over 700 listings. Also, when the format of a web site changes, the system automatically notifies the administrator of a problem!