inex/index.community
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity

double number of concurrent crawlers

Browse source
This commit is contained in:
Tao Bror Bojlén 2020-02-19 10:11:28 +00:00
parent 41ac4ca9a8
commit 37c00908ec
No known key found for this signature in database
GPG key ID: C6EC7AAB905F9E6F
2 changed files with 2 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
CHANGELOG.md
View file

@ -12,6 +12,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
### Changed ### Changed
- Bring back `develop` staging backup (now managed in DNS) - Bring back `develop` staging backup (now managed in DNS)
- Increase default number of concurrent crawlers to 100
### Deprecated ### Deprecated

2
backend/config/config.exs
View file

@ -60,7 +60,7 @@ config :backend, :crawler,
status_count_limit: 5000, status_count_limit: 5000,
personal_instance_threshold: 10, personal_instance_threshold: 10,
crawl_interval_mins: 30, crawl_interval_mins: 30,
crawl_workers: 50, crawl_workers: 100,
blacklist: [ blacklist: [
# spam # spam
"gab.best", "gab.best",