~amirouche/guile-babelia

demo day is near
import R7RS libraries from arew
87ae25b5 — Amirouche 2 years ago
Makefile: init: add wiredtiger.
e29c0a1e — Amirouche 2 years ago
cosmit
17858c11 — Amirouche 2 years ago
cosmit
d52b9960 — Amirouche 2 years ago
babelia/pool.scm: manage work queue and available workers
1ddc0957 — Amirouche 2 years ago
babelia/pool.scm: stream computation to the worker

Before, the code was trying to submit all the work to the workers and
the mainthread end up blocked for some reason.

This commit will push number of worker MINUS ONE work to the
workers. I am not sure about the MINUS ONE but without it, it doesn't
work.
873c0990 — Amirouche 2 years ago
README++
ae97c0d3 — Amirouche 2 years ago
Makefile: init: add dependencies.
44b81810 — Amirouche 2 years ago
cosmit ftw!

Do a little bit of presentation.
30397619 — Amirouche 2 years ago
babelia crawler run: wip.
d6fac582 — Amirouche 2 years ago
babelia/crawler/uri-join.scm: uri-domain: uri-port can be false.
624ffa78 — Amirouche 2 years ago
babelia/web/server.scm: run-server: add init thunk.

The INIT thunk will allow to spawn fibers concurrent to the web
server.
87d55bba — Amirouche 2 years ago
babelia/crawler/uri-join.scm: uri-domain: add port.
ec392c9f — Amirouche 2 years ago
babelia/okvs/nstore.scm: bugfix.

Handle the case where the pattern has no variables.
22e9b326 — Amirouche 2 years ago
babelia/crawler.scm: touch DOMAIN.
04b35c8d — Amirouche 2 years ago
babelia/crawler.scm: link todo with domain.
ce41dffe — Amirouche 2 years ago
babelia/crawler.scm: rework database model...

... nothing more, nothing less.
2917004d — Amirouche 2 years ago
babelia/crawler.scm: poor man's threadsafe logging.
edb59c27 — Amirouche 2 years ago
babelia/crawler.scm: on add-single-page move url to done.
Next