more crawlers more often

CHANGELOG.md

@@ -11,6 +11,9 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 
 ### Changed
 
+- Update default number of concurrent crawlers
+- Crawl every 30 minutes instead of every hour
+
 ### Deprecated
 
 ### Removed
@@ -22,17 +25,21 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 ## [2.8.5 - 2019-12-25]
 
 ### Fixed
+
 - Fixed link to Mastodon account
 
 ## [2.8.4 - 2019-11-21]
 
 ### Changed
+
 - Update links to @fediversespace Mastodon account
 
 ### Removed
+
 - Remove staging backend server
 
 ### Fixed
+
 - Fixed frontend crash when instance node missing
 
 ## [2.8.3 - 2019-11-19]

backend/config/config.exs

@@ -59,8 +59,8 @@ config :backend, :crawler,
   status_age_limit_days: 28,
   status_count_limit: 5000,
   personal_instance_threshold: 10,
-  crawl_interval_mins: 60,
-  crawl_workers: 20,
+  crawl_interval_mins: 30,
+  crawl_workers: 50,
   blacklist: [
     # spam
     "gab.best",