more crawlers more often

This commit is contained in:
Tao Bror Bojlén 2020-01-16 15:24:36 +00:00
parent 5b54e65827
commit 4b332ba980
No known key found for this signature in database
GPG key ID: C6EC7AAB905F9E6F
2 changed files with 12 additions and 5 deletions

View file

@ -11,6 +11,9 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
### Changed ### Changed
- Update default number of concurrent crawlers
- Crawl every 30 minutes instead of every hour
### Deprecated ### Deprecated
### Removed ### Removed
@ -22,17 +25,21 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
## [2.8.5 - 2019-12-25] ## [2.8.5 - 2019-12-25]
### Fixed ### Fixed
- Fixed link to Mastodon account - Fixed link to Mastodon account
## [2.8.4 - 2019-11-21] ## [2.8.4 - 2019-11-21]
### Changed ### Changed
- Update links to @fediversespace Mastodon account - Update links to @fediversespace Mastodon account
### Removed ### Removed
- Remove staging backend server - Remove staging backend server
### Fixed ### Fixed
- Fixed frontend crash when instance node missing - Fixed frontend crash when instance node missing
## [2.8.3 - 2019-11-19] ## [2.8.3 - 2019-11-19]

View file

@ -59,8 +59,8 @@ config :backend, :crawler,
status_age_limit_days: 28, status_age_limit_days: 28,
status_count_limit: 5000, status_count_limit: 5000,
personal_instance_threshold: 10, personal_instance_threshold: 10,
crawl_interval_mins: 60, crawl_interval_mins: 30,
crawl_workers: 20, crawl_workers: 50,
blacklist: [ blacklist: [
# spam # spam
"gab.best", "gab.best",