|
|
|
Website Data Collection Script
posted on 28/8/2003I need to collect data records from a website automatically. I need a script that does the following:
1. Does the equivilient of entering a sequential number into a website form and pressing "search"
2. reading the output data which is displayed on the screen (this data is not visable when you do view/source)
3. outputs the required data into a CSV record in a file
4. goes back and searches on the next sequential records
There are approximately 1500 records per day and the script should keep trying the next number until it is not available. Then remember this last number so that it starts from there the next time it is run (when more records are available).
This is an urgent requirement.
We are no longer accepting applications for this project.