~ols/veri-scrape

Change name in usage
Fix concurrency and read from file

refs

master
browse  log 

clone

read-only
https://git.sr.ht/~ols/veri-scrape
read/write
git@git.sr.ht:~ols/veri-scrape

You can also use your local clone with git send-email.

#veri-scrape

veri-scrape will scrape the content from a given list of URLs. It will not attempt to crawl further than links it retrieves from this first given page

#Usage

% go build -o veri-scrape main.go
% mkdir results
% ./veri-scrape /path/to/links # generated by veri-links