Added README
Added AGPLv3 License
Spider.Moe is a web spider developed and maintained by Ask.Moe, an European non-profit organization.
Spider.Moe will initially be used to crawl data for Ask.Moe's category-specific search engines.
Our long term goal is to build a curated search index, accessible to all.
We greatly appreciate contributions, and there are many ways you might be able to donate time and resources to support our mission.
We need help crawling data for our category-specific search engines.
If you have access to any kind of high quality data then we would love to hear from you. It could be related to sports, gaming, music, travel, or anything else you think might interest us.
We are currently in need of proxies that we can rotate between to avoid being blocked and rate-limited.
We greatly appreciate donations. You can currently donate at Liberapay.