LWP (Library for WWW in Perl)
If you want to automatically process web pages to extract data, you have a number of tools available. You can bring a web page down to your computer using "curl" or "wget"
curl http:.//aplawrence.com > mysite
If you don't really want the html, use "lynx --dump http://whatever.com > /yourstorage/whatever.txt" to get a text representation of the page. Check the man page for options you might want like "--nolist".
You can also easily be selective and pull only the data you want from a page with simple Perl scripts.
#!/usr/bin/perl use LWP::Simple; $url = '//aplawrence.com"; $content = get $url; print $content;
And then of course you'd process the $content as desired. It's only a little more complex if you are dealing with forms.
A book that covers LWP is reviewed at /Books/webc.html.
Got something to add? Send me email.
(OLDER) <- More Stuff -> (NEWER) (NEWEST)
Printer Friendly Version
Increase ad revenue 50-250% with Ezoic