Tao Bojlén
|
3360f4c28e
|
Lint backend
|
2019-08-21 12:30:47 +00:00 |
Tao Bror Bojlén
|
f033b1eec0
|
add friendica crawler
|
2019-08-18 15:27:50 +02:00 |
|
Tao Bror Bojlén
|
2c035892d4
|
add most recent crawl table
|
2019-08-10 16:21:22 +03:00 |
|
Tao Bojlén
|
3320e050c8
|
Revert "add metadata endpoint"
This reverts commit 82153b283b.
|
2019-08-09 16:59:51 +00:00 |
|
Tao Bror Bojlén
|
30c5bbe2b9
|
only save successful crawls in db
|
2019-08-07 22:41:19 +03:00 |
|
Tao Bojlén
|
f0f3f76f6c
|
handle crawl timestamps in db
|
2019-08-07 16:53:34 +00:00 |
|
Tao Bojlén
|
75e66affe3
|
Add misskey crawler
|
2019-08-06 18:04:30 +00:00 |
|
Tao Bror Bojlén
|
76ebf50c40
|
never display opted-out instances anywhere
|
2019-08-03 00:09:09 +03:00 |
|
Tao Bror Bojlén
|
287c7b5624
|
normalize instance names
|
2019-08-02 22:46:40 +03:00 |
|
Tao Bror Bojlén
|
09708e74ab
|
update ES index on crawl
|
2019-08-02 19:03:21 +03:00 |
|
Tao Bror Bojlén
|
ea0fae2152
|
don't add domains to the queue twice
|
2019-07-27 16:22:39 +03:00 |
|
Tao Bror Bojlén
|
74fc30e8a5
|
don't log crawl times with appsignal
|
2019-07-27 13:57:07 +03:00 |
|
Tao Bojlén
|
79257f1cbe
|
Setup appsignal
|
2019-07-27 10:13:42 +00:00 |
|
Tao Bojlén
|
490b518587
|
Save base domain
|
2019-07-25 15:56:03 +00:00 |
|
Tao Bojlén
|
3b515c3a36
|
Color code graph
|
2019-07-24 15:51:44 +00:00 |
|
Tao Bojlén
|
2cae5dccbf
|
check robots.txt for permission to crawl
|
2019-07-19 20:00:28 +00:00 |
|
Tao Bojlén
|
5fafffc404
|
frontend/cytoscape feature parity
|
2019-07-19 18:19:53 +00:00 |
|
Tao Bror Bojlén
|
9478017eb0
|
fix edge generation, serve graph in cytoscape format
|
2019-07-18 13:21:12 +03:00 |
|
Tao Bojlén
|
a37452f138
|
refactor/elixir backend
|
2019-07-14 11:47:06 +00:00 |