Posted by axlq on 08/11/06 00:40

In article <1155245133.537125.73740@74g2000cwt.googlegroups.com>,
joe t. <thookerov@gmail.com> wrote:
>There is a website that requires me to log in using a web-form.
>...
>Those results pages are what i want to get to, but through some kind of
>script that parses the results that get served out, not by user
>interaction.

I once did this to gather a huge amount of historical data from a
horse-racing web site. I had to write the application in Java. It
would log in with my userID and password, submit queries to forms,
save the HTML result pages sent back, then parse the tabular data in
those pages into comma-delimited text data.

It was a much bigger project than I anticipated. I suspect there
are some macro automation tools out there that will let you do it
more easily.

-Alex

[Back to original message]