~akspecs/numbeo-scraping

scrape data from numbeo.com
139069be — Rebecca Medrano 5 months ago
spiders/wiki_data.py: adjust toDecimalCoordinate
bf0e1887 — Rebecca Medrano 5 months ago
spiders: update wiki_data location scraping
feaa9a36 — Rebecca Medrano 5 months ago
spiders: scrape location data from wikipedia

refs

master
browse  log 

clone

read-only
https://git.sr.ht/~akspecs/numbeo-scraping
read/write
git@git.sr.ht:~akspecs/numbeo-scraping

You can also use your local clone with git send-email.

#numbeo-scraping

License: AGPL. Discussion on Matrix.

#numbeo-scraping is a set of scrapy spiders that crawl numbeo.com

with the help of a turn-key script, run all of the spiders in numbeo-scraping and create/update the database used by the aqoli front-end!

See numbeo-scraping's features: docs/features.md

Join the aqoli/numbeo scraping discussion room on Matrix: #2021 fall cs195 general:matrix.org

See also: aqoli, a front-end for this scraped data.

#Instances

The official instance is on https://example.com.

Community instances are listed in docs/instances.md. Submit a patch to add your own instance to that list.

#Installing

See docs/installing_basic.md and docs/installing_extended.md.

#Contributing

#Credits & license information

All of aqoli's code uses the AGPL 3.0 license. In short, this means that if you make any modifications to the code and then publish the result (e.g. by hosting the result on a webserver), you must publicly distribute your changes and declare that they also use AGPL 3.0.

The documentation uses the Unlicense.