Nazar Kanaev
|
80402943a1
|
wrap in charset
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
b40fe94147
|
refactor crawler
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
e0e6166cdf
|
fix feed sniff reader
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
a2bfd1682b
|
rewrite worker
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
1f393faf79
|
move checker tool to bin
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
c469749eaa
|
rename packaages
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
e0009e4267
|
feed checker tool
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
24a06faa3c
|
fix dates
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
9ede816078
|
rewrite crawler
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
646519e074
|
add charsetreader to xmlreader
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
454eff0155
|
done
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
ebd7f2929c
|
drop gofeed
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
5b36530f67
|
switch to internal feed parser
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
c91b439878
|
tweaks
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
7d61f705bf
|
url fixer
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
9fa8b8440a
|
go fmt ./...
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
9e8837b37d
|
tweaks
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
7ca9415322
|
feed refactoring
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
e78c028d20
|
feed dump
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
cbc75047b8
|
update formats
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
cc6f6d91e1
|
rss parser
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
70e9e1ed3a
|
moar links
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
efafdbebaa
|
remove feed_url references
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
19967ce37c
|
leave comments
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
ce3d6fba37
|
fixes
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
3e14716fc6
|
learn more about formats
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
43620cd9b6
|
basic rdf test
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
e819140f36
|
remove unneeded rss fields
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
f28f0eac1a
|
rdf xml structs
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
ff4abb8dfe
|
another nice parser
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
e2efaddfed
|
rss xml structs
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
b1db6c6fb1
|
add links
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
279fc469ab
|
basic atom 1.0 parser
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
d185fb6dd7
|
handle base url later
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
3a667a3809
|
add date parser
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
a895775f81
|
basic json feed parser
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
0a9beddef9
|
update formats
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
29528e40b0
|
gather info
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
aaf0b702a3
|
remove dead code
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
9f376db0f4
|
gofmt
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
391ce61362
|
opml tweaks & fixes
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
62e2ca4c16
|
switch to new opml
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
ea5af73901
|
remove print
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
7d7feda319
|
rewrite opml
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
1c810f68f8
|
done
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
8528a80d7e
|
minor
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
dd0bf1a012
|
done
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
e0c4752bbf
|
drop direct goquery dependency
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
c896440525
|
find favicons
|
2021-04-02 22:26:44 +01:00 |
|
Nazar Kanaev
|
1f042a8434
|
separate package for crawler
|
2021-04-02 22:26:44 +01:00 |
|