Re: FN-FORUM script to harvest content

date posted 15th March 2000 10:28

>have a look at:
>http://www.guardian.co.uk/Distribution/CDistr_Help/0,5381,,00.html

Took some finding!

Mark,

I would do it like this:

-Write a script that uses a socket to make an http connection to Guardian
unlimited
-Request the page with the content
-Parse that page, pulling out the content you need
-Write it to an include file
-Display using SSI

Like Ian said, run the script at intervals via cron.

Or - look at moreover.com for a UK-friendly copy and paste news feed service:

http://www.moreover.com

Cheers
Dan

This assumes your serve is UNIX.


Shawn Seabrook wrote:

> Yea, the site could probably use a little tweaking of navigation:
>
> have a look at:
> http://www.guardian.co.uk/Distribution/CDistr_Help/0,5381,,00.html
>
> Seems to have most of the info
>
> Shawn
>
> ----- Original Message -----
> From: "Mark" [EMAIL REMOVED]
> To: "Freelancers" [EMAIL REMOVED]
> Sent: Wednesday, March 15, 2000 8:14 AM
> Subject: FN-FORUM script to harvest content
>
> > Hi All,
> >
> > Apologies if you have read a message similar to this but I am not sure
> > whether my mail is getting through.
> >
> > I am trying to use the content provided at
> > http://www.guardianunlimited.co.uk/distribution
> > the documentation says to
> >
> > "Set up a script or a manual process to come and 'harvest' content from
> > Guardian Unlimited on a regular basis."
> >
> > Does any one know how I go about this?
> >
> > - Mark
> >
> >
> > ============================================================
> >
> > * Free listing for freelancers
> > * Free to advertise jobs
> > * Free jobs distribution service
> > * Free database of 1000 freelancers
> >
> > Freelancers and Freelance Jobs
> > http://www.freelancers.net
> >
> > To post to the Forum:
> > [EMAIL REMOVED]
> >
> > To unsubscribe please email:
> > [EMAIL REMOVED]
> >
> > For further information please visit:
> > http://www.freelancers.net/forum.html
>
> ============================================================
>
> * Free listing for freelancers
> * Free to advertise jobs
> * Free jobs distribution service
> * Free database of 1000 freelancers
>
> Freelancers and Freelance Jobs
> http://www.freelancers.net
>
> To post to the Forum:
> [EMAIL REMOVED]
>
> To unsubscribe please email:
> [EMAIL REMOVED]
>
> For further information please visit:
> http://www.freelancers.net/forum.html