32 Commits

Author SHA1 Message Date
Nazar Kanaev
830248b6ae store feed size 2022-02-10 22:14:47 +00:00
nkanaev
52cc8ecbbd fix encoding 2022-01-24 16:47:32 +00:00
nkanaev
e3e9542f1e fix page crawling encoding 2022-01-24 14:02:21 +00:00
nkanaev
bff7476b58 refactoring 2022-01-24 12:50:52 +00:00
Nazar Kanaev
982c4ebbbc do not convert response to utf8 if charset is not set 2021-06-29 16:43:09 +01:00
Nazar Kanaev
8f36ae013e done 2021-05-28 10:28:23 +01:00
Nazar Kanaev
851aa1a136 rewrite icon crawling 2021-05-28 10:27:56 +01:00
Nazar Kanaev
214c7aacfc fix refresh sync 2021-05-27 11:52:30 +01:00
Nazar Kanaev
883214a740 more todo 2021-04-26 15:22:32 +01:00
Nazar Kanaev
3d9c9d03cc refresh ui hacks 2021-04-07 15:47:47 +01:00
Nazar Kanaev
882be1dbf6 more todos 2021-04-07 10:58:17 +01:00
Nazar Kanaev
42b36965c5 remove error prefixes 2021-04-06 21:48:09 +01:00
Nazar Kanaev
2df2f41516 gofmt -s -w . 2021-04-06 08:43:15 +01:00
Nazar Kanaev
6acf9af887 remove item.date_updated, item.description & item.author fields in storage 2021-04-05 21:30:07 +01:00
Nazar Kanaev
cf5856bdf7 set missing times 2021-04-04 20:42:52 +01:00
Nazar Kanaev
fa92ea16b0 search for icons only during startup and after adding feeds 2021-04-02 22:26:45 +01:00
Nazar Kanaev
b04e8c1e93 reorganizing content-related packages 2021-04-02 22:26:45 +01:00
Nazar Kanaev
91deb41d5b store podcast url 2021-04-02 22:26:44 +01:00
Nazar Kanaev
fe1a1987bd translate urls 2021-04-02 22:26:44 +01:00
Nazar Kanaev
80402943a1 wrap in charset 2021-04-02 22:26:44 +01:00
Nazar Kanaev
b40fe94147 refactor crawler 2021-04-02 22:26:44 +01:00
Nazar Kanaev
a2bfd1682b rewrite worker 2021-04-02 22:26:44 +01:00
Nazar Kanaev
c469749eaa rename packaages 2021-04-02 22:26:44 +01:00
Nazar Kanaev
24a06faa3c fix dates 2021-04-02 22:26:44 +01:00
Nazar Kanaev
9ede816078 rewrite crawler 2021-04-02 22:26:44 +01:00
Nazar Kanaev
5b36530f67 switch to internal feed parser 2021-04-02 22:26:44 +01:00
Nazar Kanaev
aaf0b702a3 remove dead code 2021-04-02 22:26:44 +01:00
Nazar Kanaev
9f376db0f4 gofmt 2021-04-02 22:26:44 +01:00
Nazar Kanaev
e0c4752bbf drop direct goquery dependency 2021-04-02 22:26:44 +01:00
Nazar Kanaev
1f042a8434 separate package for crawler 2021-04-02 22:26:44 +01:00
Nazar Kanaev
fc3383946d crawl 2021-04-02 22:26:44 +01:00
Nazar Kanaev
dfb32d4ebe extract worker & crawler from server 2021-04-02 22:26:43 +01:00