Add uglydump subcommand to web2text.
* Set a proper user agent, and add a safety valve so infinate recursions don't happen
This will eventually be a web crawler that saves websites in plaintext files. For now please enjoy a few cli tools, written as POC. Comments, compliments, complaints, and pull requests accepted.
Command line tool that does exactly what it says on the tin. Extract the content of a web document to plain text. With a choice of two scraping engines.