Re: FN-FORUM script to harvest content

date posted 15th March 2000 08:34

At 08:14 15/03/00 +0000, Mark wrote:
>Apologies if you have read a message similar to this but I am not sure
>whether my mail is getting through.

Read three of them. Not sure whether anyone can help. I certainly not sure
how much help I will be...

>I am trying to use the content provided at
>http://www.guardianunlimited.co.uk/distribution
>the documentation says to
>
>"Set up a script or a manual process to come and 'harvest' content from
>Guardian Unlimited on a regular basis."
>
>Does any one know how I go about this?

I assume you read:

http://www.guardianunlimited.co.uk/Distribution/CDistr_Help/0,5381,,00.html

To do the harvesting I know that my employer uses a VBscript that visits
the Guardian site, collects the HTML pages and throws them into a database.
The pages are then delivered into our template through using ASP. You could
probably do the same with Perl using some of the web module. You'd have to
set up a cron job so that the script runs each day, or whatever, or run it
manually.

All the best,

--
Ian Fenn MA
Member of the International Association of Culinary Professionals
http://www.chopstix.net/ - Chinese cooking on the web!