Commit Graph

73 Commits

Author SHA1 Message Date
Tao Bror Bojlén 0f01620413
perf and metrics tweaks 2019-07-27 16:22:54 +03:00
Tao Bror Bojlén ea0fae2152
don't add domains to the queue twice 2019-07-27 16:22:39 +03:00
Tao Bror Bojlén 74fc30e8a5
don't log crawl times with appsignal 2019-07-27 13:57:07 +03:00
Tao Bror Bojlén 235952b072
add ES to extra_applications 2019-07-27 13:56:00 +03:00
Tao Bojlén ab5f442074 check for spam less often 2019-07-27 10:32:42 +00:00
Tao Bojlén 79257f1cbe Setup appsignal 2019-07-27 10:13:42 +00:00
Tao Bojlén 5ca8de5dbe add full-text search 2019-07-26 22:30:11 +00:00
Tao Bror Bojlén 5e9b498db0
add missing import in user_email 2019-07-26 17:41:32 +03:00
Tao Bojlén 7b2b3876c6 feature/administration 2019-07-26 14:34:23 +00:00
Tao Bror Bojlén 2f538c9a12
crawl less often 2019-07-25 19:12:16 +03:00
Tao Bojlén 490b518587 Save base domain 2019-07-25 15:56:03 +00:00
Tao Bror Bojlén 99a6dc2023
prepare for 2.2.0 release 2019-07-24 19:37:32 +03:00
Tao Bror Bojlén a615d115fd
show instance type in details 2019-07-24 19:25:20 +03:00
Tao Bojlén 3b515c3a36 Color code graph 2019-07-24 15:51:44 +00:00
Tao Bror Bojlén 2de412bfbb
prepare for 2.1.0 release 2019-07-24 13:19:24 +03:00
Tao Bojlén e490b30ebb experimental mobile support 2019-07-23 16:32:43 +00:00
Tao Bojlén 1ff7cd7290 frontend/search/ui fixes 2019-07-23 14:08:43 +00:00
Tao Bojlén 6673a24466 Refactor graph sidebar, move to backend search 2019-07-23 12:20:34 +00:00
Tao Bojlén 39d279debd add routing support for selected instance 2019-07-21 18:05:07 +00:00
Tao Bojlén 51051d37a0 show robots.txt status in frontend 2019-07-20 17:43:37 +00:00
Tao Bror Bojlén 7aa914ab3f
prepare for 2.0.0 release 2019-07-20 13:01:56 +03:00
Tao Bojlén 2cae5dccbf check robots.txt for permission to crawl 2019-07-19 20:00:28 +00:00
Tao Bojlén 5fafffc404 frontend/cytoscape feature parity 2019-07-19 18:19:53 +00:00
Tao Bojlén 2e61b70602 Hide insular instances 2019-07-18 20:05:16 +00:00
Tao Bojlén 677b984451 add Insularity score 2019-07-18 15:20:09 +00:00
Tao Bror Bojlén 9478017eb0
fix edge generation, serve graph in cytoscape format 2019-07-18 13:21:12 +03:00
Tao Bror Bojlén 82677fcd32
add spam domain to blacklist 2019-07-18 13:21:06 +03:00
Tao Bojlén 4a87c49baf set up sobelow for backend 2019-07-17 16:16:25 +00:00
Tao Bror Bojlén d5b10a6f22
set up migrations on deploy 2019-07-17 14:47:47 +03:00
Tao Bror Bojlén b8c474ca89
fix DATABASE_URL config in phoenix 2019-07-14 14:40:54 +01:00
Tao Bojlén a37452f138 refactor/elixir backend 2019-07-14 11:47:06 +00:00
Tao Bror Bojlén 0cd19e597d
hotfix: blacklist gab.best domains 2019-07-03 12:13:43 +01:00
Tao Bror Bojlén e9b8901aa5
don't display quiet nodes on graph 2019-04-19 15:29:45 +01:00
Tao Bror Bojlén 8d00ba9372
build(react-scripts): move from react-scripts-ts to react-scripts
the latter now supports typescript natively.
2019-04-17 15:44:23 +01:00
Tao Bror Bojlén 884810fa09
set status limit to 40 per page 2019-03-08 16:05:42 +00:00
Tao Bror Bojlén 2534b45487
remove trailing slash from endpoint crawled
this was causing issues on at least one pleroma instance, for some
reason
2019-03-08 15:59:07 +00:00
Tao Bror Bojlén 1770333906
remove whitelist from git 2019-03-08 15:58:43 +00:00
Tao Bror Bojlén 3a66e7464e
fix duplicates in instance peers 2019-03-01 14:42:05 +00:00
Tao Bror Bojlén e52f581067
bump personal instance threshold to 10 2019-02-28 18:06:16 +00:00
Tao Bror Bojlén dfc115f275
lowercase instance names (fix #48) 2019-02-28 18:05:54 +00:00
Tao Bror Bojlén 2e5696962b
only scrape 50 instances in one go 2019-02-28 18:03:08 +00:00
Tao Bror Bojlén 91f326e19b
handle missing data better in API 2019-02-28 17:51:03 +00:00
Tao Bojlén 648f225772 Allow CORS from all fediverse.space subdomains 2019-02-27 09:09:23 +00:00
Tao Bojlén 54b5c9ef2a migrate to caddy server 2019-02-22 15:40:44 +00:00
Tao Bror Bojlén de1cee2015
add www subdomain to CORS whitelist 2019-02-21 14:38:23 +00:00
Tao Bror Bojlén b4ef0793e7
restore original status limit 2019-02-21 12:35:53 +00:00
Tao Bror Bojlén 795ad67e8b
dockerize gephi 2019-02-21 12:32:50 +00:00
Tao Bror Bojlén 1c1f193542
improve handling of cancelled scrape 2019-02-21 10:38:49 +00:00
Tao Bror Bojlén 1b11c70430
simplify folder structure 2019-02-21 10:26:55 +00:00
Tao Bror Bojlén e33c70fa25
improve scraping logic 2019-02-20 22:09:21 +00:00