c89f9cf89d
feature(backups): do not rely on mounting
2023-08-14 12:43:44 +00:00
69f6e62877
test(backups): more checks regarding tmpdirs and mounting
2023-08-14 11:59:44 +00:00
2c9011cc87
fix(backups): robustness against stale locks: everything else
2023-08-09 15:18:20 +00:00
0eb70e1551
fix(backups): robustness against stale locks: snapshot sizing
2023-08-09 14:46:27 +00:00
26ab7b4d7b
fix(backups): robustness against stale locks: is_initted
2023-08-09 14:27:14 +00:00
eca4b26a31
fix(backups): robustness against stale locks: backing up
2023-08-09 13:47:18 +00:00
752a0b807e
feature(backups): lock and unlock at will
2023-08-07 13:33:10 +00:00
52336b885d
fix: check if repo is initted by checking retcode
2023-08-04 14:08:23 +03:00
00317cc7e4
test(backups): erase repos between tests
2023-07-26 16:52:58 +00:00
cfa7f4ae59
feature(backups): add full repo erasure capability
2023-07-26 16:45:08 +00:00
ffec344ba8
test(backups): make the test repo overridable by envs
2023-07-26 14:26:04 +00:00
aa7cc71557
feature(backups):add a function to set provider from env
2023-07-26 11:54:17 +00:00
26488aa12f
fix(backup):force backup function to return same length ids as when getting snapshots
2023-07-21 11:11:24 +00:00
eafc7a412c
fix: timezone awareness of automatic backup task
2023-07-20 19:42:44 +03:00
c9d20e8efd
fix(backups): make datetimes from huey timezone aware
2023-07-20 19:39:10 +03:00
e0a5ecdd9d
style: reformat
2023-07-20 19:37:01 +03:00
0245d629fd
refactor(backups): linting
2023-07-20 18:24:26 +03:00
2df448a4a9
fix(backups): Do not shut down the service during backup
...
We do not want the user to expirience outages during automatic backups.
Generally, they are not even needed.
We should use hooks to service-specific tasks, such as
creating the database dump, so we don't have to shut down Postgres.
2023-07-20 17:11:02 +03:00
f4ac3d29a9
feature(backup):remove code for finegrained autobackup control
2023-07-19 15:36:25 +00:00
466160dbf9
feature(backup):disable finegrain control over services to back up
2023-07-19 15:36:25 +00:00
5253780cc8
style: linting of backups module
2023-07-19 15:59:51 +03:00
3067d353d8
fix(backups): Do not remove failsafe snapshot after recovery
2023-07-19 15:59:29 +03:00
fa53264136
refactor(backup):remove unused verify arg from do_restore
2023-07-19 10:51:36 +00:00
a303e5ce37
Merge branch 'restic-rewrite' of https://git.selfprivacy.org/SelfPrivacy/selfprivacy-rest-api into restic-rewrite
2023-07-19 10:35:30 +00:00
8b504993d0
fix(backups): backup strategies were unused
2023-07-18 20:15:22 +03:00
45011450c5
feature(backup):calculate needed space for inplace restoration
2023-07-17 16:05:00 +03:00
b001e198bf
feature(backups): stop services before restores
2023-07-17 16:05:00 +03:00
40ad1b5ce4
feature(backups): stop services before backups
2023-07-17 16:05:00 +03:00
cacbf8335d
fix(backups): actually mount if asked for an inplace restore
2023-07-17 16:05:00 +03:00
65ce86f0f9
test(backups): test out that pre-restore backup plays nice with jobs
2023-07-17 16:05:00 +03:00
95e4296d0b
feature(backups): implement inplace restore strategy
2023-07-17 16:05:00 +03:00
59fe386463
feature(backups): restore strategies enum
2023-07-17 16:05:00 +03:00
02e3c9bd5e
feature(backups): forgetting snapshots
2023-07-17 16:05:00 +03:00
f361f44ded
feature(backups): check restore exit code
2023-07-17 16:05:00 +03:00
4423db7458
refactor(backups): download a copy before replacing original
2023-07-17 16:05:00 +03:00
9137536294
feature(backups): mounting a repo
2023-07-17 16:05:00 +03:00
9a28c0ebcb
refactor(backups): move syncing (non-restic) into backup utils
2023-07-17 16:05:00 +03:00
7ad5f91be1
refactor(backups): move output yielding into backup utils
2023-07-17 16:05:00 +03:00
1c28984475
feature(backups): a wrapper for rclone sync
2023-07-17 16:05:00 +03:00
21c5f6814c
style: fix styling
2023-07-17 16:05:00 +03:00
0e13e61b73
fix(services): proper backup progress reporting
2023-07-17 16:05:00 +03:00
a7d0f6226f
fix(backups): missing space in rclone args
2023-07-17 16:05:00 +03:00
e8f1f39b18
refactor(backups): rename service_snapshot_size to snapshot_restored_size
2023-07-17 16:05:00 +03:00
f804c88fa6
refactor(backups): remove the by-service getting of cached snapshots
2023-07-17 16:05:00 +03:00
6004977845
refactor(backups): rename force_snapshot_reload to force_snapshot_cache_reload
2023-07-17 16:05:00 +03:00
3551813b34
refactor(backups): merge sync_all_snapshots with force_snapshot_reload
2023-07-17 16:05:00 +03:00
ce55416b26
refactor(backups): straighten get_all_snapshots
2023-07-17 16:05:00 +03:00
16a96fe0fa
refactor(backups): delete sync_service_snapshots
2023-07-17 16:05:00 +03:00
f2161f0532
refactor(backups): privatize assert_restorable and restore_snapshot_from_id
2023-07-17 16:05:00 +03:00
cb2273323f
refactor(backups): group operations together
2023-07-17 16:05:00 +03:00
6369042420
refactor(backups): move reset() to top because toplevel interface
2023-07-17 16:05:00 +03:00
3edb38262f
refactor(backups): make redis and json provider related lowlevels private
2023-07-17 16:05:00 +03:00
3684345c2d
refactor(backups): make construct_provider not public
2023-07-17 16:05:00 +03:00
6b0c55a786
refactor(backups): make lookup_provider not public
2023-07-17 16:05:00 +03:00
dbac010303
refactor(backups): reorder imports
2023-07-17 16:05:00 +03:00
c09f2f393b
refactor(backups): api readability reorg
2023-07-17 16:05:00 +03:00
4b1594ca22
refactoring(backups): backuper -> backupper
2023-07-17 16:05:00 +03:00
4225772573
fix(backups): Providers were not initialized corretly
2023-07-17 16:05:00 +03:00
f27a3df807
refactor(backups): fix typing errors
2023-07-17 16:05:00 +03:00
b78ee5fcca
refactor(api): Group mutations
...
I've learned that there is no problem in grouping mutations like we do with queries.
This is a big mistake from my side, now we have legacy not so conveniently placed endpoints.
I've grouped all mutations, left the copies of old ones flattened in the root for backwards compatibility.
We will migrate to mutation groups on client side, and backups now only use grouped mutations.
Tests are updated.
2023-07-17 16:05:00 +03:00
53dfb38284
test(backups): ensure asking to reload snaps does not explode the server
2023-07-17 16:05:00 +03:00
f829a34dc7
refactor(backups): delete legacy provider setting
2023-07-17 16:05:00 +03:00
9f096ed2c0
feature(backups): actually dealing with situation when the provider is not configured
2023-07-17 16:05:00 +03:00
cd32aa83b7
refactor(backups): NoneBackupper class for those cases when we do not know
2023-07-17 16:05:00 +03:00
a56461fb96
refactor(backups): make a dir for backuppers
2023-07-17 16:05:00 +03:00
806fb3c84b
feature(backups): resetting json config too
2023-07-17 16:05:00 +03:00
1c96743c5d
test(backups): test reinitting repository
2023-07-17 16:05:00 +03:00
38de01da8b
refactor(backups): cleanup localfile-specific logic
2023-07-17 16:05:00 +03:00
8475ae3375
refactor(backups): make localfile repos normal
2023-07-17 16:05:00 +03:00
93b98cd4fd
fix(backups): Handle orphaned snapshots
2023-07-17 16:05:00 +03:00
421c92d12e
fix(backups): return type of encryption key
2023-07-17 16:05:00 +03:00
c603394449
fix(backups): try to actually get backup configuration
2023-07-17 16:05:00 +03:00
42a5b6f70a
test(backups): test backup API - backing up
2023-07-17 16:05:00 +03:00
ad130e392c
feature(backups): check available space before restoring
2023-07-17 16:05:00 +03:00
780c12df6c
refactor(backups): expect one more error of restic json output parsing
2023-07-17 16:05:00 +03:00
6da0791b47
feature(backups): integration between restore and jobs
2023-07-17 16:05:00 +03:00
44e45a5124
BREAKING CHANGE(backups): support only individual service backup requests(combinable)
2023-07-17 16:05:00 +03:00
550f7fa620
refactor(backups): introduce get_all_snapshots()
2023-07-17 16:05:00 +03:00
cc073155db
feature(backups): feature(backups): return a snapshot from start_backup
2023-07-17 16:05:00 +03:00
891993e4cd
feature(backups): a graphql call to invalidate cache
2023-07-17 16:05:00 +03:00
7e022e0cfe
feature(backups): graphql mutation for restore
2023-07-17 16:05:00 +03:00
44ddd27e84
fix(backups): return correct snapshots per service
2023-07-17 16:05:00 +03:00
761b6be4e5
refactor(backups): global snapshots
2023-07-17 16:05:00 +03:00
bdae6cfb75
feature(backups): global init instead of per-service
2023-07-17 16:05:00 +03:00
d0b27da641
feature(backups): init repo mutation
2023-07-17 16:05:00 +03:00
d10bf99927
fix(backups): make sure location and credentials get properly passed around
2023-07-17 16:05:00 +03:00
c8512eacdc
refactor(backups): refactor realtime updating
2023-07-17 16:05:00 +03:00
d38b8180cb
feature(backups): realtime progress updates of backups
2023-07-17 16:05:00 +03:00
afdbf01cfc
refactor(backups): use single repo and multiplex by tags
2023-07-17 16:05:00 +03:00
ecf44e5169
feature(backups): deny adding a backup job if another one is already queued
2023-07-17 16:05:00 +03:00
f116ce1bdb
feature(backups): set job status to error if backup fails
2023-07-17 16:05:00 +03:00
05f2cc3f14
refactor(backups): cleanup unused imports in tasks
2023-07-17 16:05:00 +03:00
f622d617cf
test(backups): test jobs starting and finishing when from Backups
2023-07-17 16:05:00 +03:00
ac6d25c4c1
refactor(backups): make a backup job running when the backup code itself is executed
2023-07-17 16:05:00 +03:00
026d72b551
refactor(backups): delete unused redis import from backups ckass
2023-07-17 16:05:00 +03:00
029cb47db6
feature(backups): also create a job if not called from a task
2023-07-17 16:05:00 +03:00
fa86c45bd0
feature(backups): simplest jobs intergration in tasks: created and finished
2023-07-17 16:05:00 +03:00
4572c00640
feature(backups): restore task
2023-07-17 16:05:00 +03:00
d3f9ce7bf5
test(backups): test local secrets
2023-07-17 16:05:00 +03:00
ebeb76149b
refactor(services): make local secret setting public
2023-07-17 16:05:00 +03:00
Houkime
Inex Code