Commit Graph

4 Commits

Author SHA1 Message Date
Aidan Holm
2dc58c5c8e Fix user agent using hardcoded 1.0 version. 2024-10-30 09:49:33 +00:00
nkanaev
52cc8ecbbd fix encoding 2022-01-24 16:47:32 +00:00
nkanaev
e3e9542f1e fix page crawling encoding 2022-01-24 14:02:21 +00:00
Nazar Kanaev
b40fe94147 refactor crawler 2021-04-02 22:26:44 +01:00