Fix bug causing javascript to appear in output, add license file so sourcehut doesn't bug me
Add uglydump subcommand to web2text.
* Set a proper user agent, and add a safety valve so infinate recursions don't happen
Redesign on a more mark/sweep pattern
Add crawler api code
Refactor in preperation building the crawler
Inital Commit