Houkime
0a852d8b50
fix(backups): consider failing services MORE and not try to stop them
2023-08-23 13:39:12 +00:00
Inex Code
f2c972ed5f
chore: bump version
2023-08-23 14:51:15 +03:00
Inex Code
d6cf2abdc2
style: remove unused imports
2023-08-23 14:51:01 +03:00
Houkime
b2c7e8b73a
feature(backups): caps for autobackups
2023-08-21 12:45:31 +00:00
Houkime
30b62c351a
feature(redis): compatibility with str enums
2023-08-21 11:31:29 +00:00
Houkime
027a37bb47
feature(backup): remember the reason for making a snapshot
2023-08-21 11:11:56 +00:00
Houkime
d621ca6449
refactor(backups): clean up unused mounting tools
2023-08-14 12:50:45 +00:00
Houkime
c89f9cf89d
feature(backups): do not rely on mounting
2023-08-14 12:43:44 +00:00
Houkime
69f6e62877
test(backups): more checks regarding tmpdirs and mounting
2023-08-14 11:59:44 +00:00
Houkime
2c9011cc87
fix(backups): robustness against stale locks: everything else
2023-08-09 15:18:20 +00:00
Houkime
0eb70e1551
fix(backups): robustness against stale locks: snapshot sizing
2023-08-09 14:46:27 +00:00
Houkime
26ab7b4d7b
fix(backups): robustness against stale locks: is_initted
2023-08-09 14:27:14 +00:00
Houkime
eca4b26a31
fix(backups): robustness against stale locks: backing up
2023-08-09 13:47:18 +00:00
Houkime
752a0b807e
feature(backups): lock and unlock at will
2023-08-07 13:33:10 +00:00
Inex Code
52336b885d
fix: check if repo is initted by checking retcode
2023-08-04 14:08:23 +03:00
Inex Code
ff70a3588e
chore: bump version
2023-08-04 12:57:31 +03:00
Inex Code
e6189e4e73
Merge branch 'master' into backups-forget
2023-08-04 12:46:08 +03:00
Inex Code
f4263b0288
style: remove unused imports
2023-08-02 08:54:18 +03:00
Inex Code
f08eafc3d8
refactor(services): extract get_drive to the base Service class
2023-08-02 08:51:42 +03:00
Inex Code
a87889b252
refactor: Change Mail Server id from "mailserver" to "email"
...
Nix config uses "email" so we should too.
2023-08-02 07:41:55 +03:00
Houkime
bba837530a
feature(backups): expose forget to API
2023-07-28 10:40:40 +00:00
Inex Code
88af27a8ba
chore: bump version
2023-07-28 03:20:33 +03:00
Inex Code
641ab26069
fix(storage): fix root device detection and ignore iso9660
2023-07-28 03:14:50 +03:00
Inex Code
6660e1d9d5
fix(services): ocserv and jitsi were returning wrong volumes too
2023-07-28 02:31:28 +03:00
Inex Code
3bff43a6bf
fix(mailserver): Location of the "location" attribute was inconsistent
2023-07-28 02:18:05 +03:00
Houkime
00317cc7e4
test(backups): erase repos between tests
2023-07-26 16:52:58 +00:00
Houkime
cfa7f4ae59
feature(backups): add full repo erasure capability
2023-07-26 16:45:08 +00:00
Houkime
ffec344ba8
test(backups): make the test repo overridable by envs
2023-07-26 14:26:04 +00:00
Houkime
aa7cc71557
feature(backups):add a function to set provider from env
2023-07-26 11:54:17 +00:00
Houkime
d664fcbdc4
refactor(jobs):track 100-on-finished as a progress update
2023-07-21 13:06:18 +00:00
Houkime
26488aa12f
fix(backup):force backup function to return same length ids as when getting snapshots
2023-07-21 11:11:24 +00:00
Inex Code
b01247bc55
refactor: remove legacy backups implementations
2023-07-20 20:11:42 +03:00
Inex Code
413911849d
refactor(backups): remove calls of legacy backups API
2023-07-20 20:06:39 +03:00
Inex Code
eafc7a412c
fix: timezone awareness of automatic backup task
2023-07-20 19:42:44 +03:00
Inex Code
c9d20e8efd
fix(backups): make datetimes from huey timezone aware
2023-07-20 19:39:10 +03:00
Inex Code
e0a5ecdd9d
style: reformat
2023-07-20 19:37:01 +03:00
Inex Code
95dbd4fac2
chore: bump version
2023-07-20 19:35:35 +03:00
Inex Code
4b575b6138
fix(graphql): duplicate imports
2023-07-20 18:25:32 +03:00
Inex Code
0245d629fd
refactor(backups): linting
2023-07-20 18:24:26 +03:00
Inex Code
2df448a4a9
fix(backups): Do not shut down the service during backup
...
We do not want the user to expirience outages during automatic backups.
Generally, they are not even needed.
We should use hooks to service-specific tasks, such as
creating the database dump, so we don't have to shut down Postgres.
2023-07-20 17:11:02 +03:00
Houkime
f4ac3d29a9
feature(backup):remove code for finegrained autobackup control
2023-07-19 15:36:25 +00:00
Houkime
466160dbf9
feature(backup):disable finegrain control over services to back up
2023-07-19 15:36:25 +00:00
Inex Code
5253780cc8
style: linting of backups module
2023-07-19 15:59:51 +03:00
Inex Code
3067d353d8
fix(backups): Do not remove failsafe snapshot after recovery
2023-07-19 15:59:29 +03:00
Houkime
fa53264136
refactor(backup):remove unused verify arg from do_restore
2023-07-19 10:51:36 +00:00
Houkime
a303e5ce37
Merge branch 'restic-rewrite' of https://git.selfprivacy.org/SelfPrivacy/selfprivacy-rest-api into restic-rewrite
2023-07-19 10:35:30 +00:00
Inex Code
8b504993d0
fix(backups): backup strategies were unused
2023-07-18 20:15:22 +03:00
Houkime
45011450c5
feature(backup):calculate needed space for inplace restoration
2023-07-17 16:05:00 +03:00
Houkime
097cf50b37
fix(servers): hopefully fix moving
2023-07-17 16:05:00 +03:00
Houkime
c53f35c947
feature(servers): set default timeout of server operations to 10 min
2023-07-17 16:05:00 +03:00
Houkime
b001e198bf
feature(backups): stop services before restores
2023-07-17 16:05:00 +03:00
Houkime
40ad1b5ce4
feature(backups): stop services before backups
2023-07-17 16:05:00 +03:00
Houkime
a7427f3cb5
test(backups): do not store the status file in backupped folders
2023-07-17 16:05:00 +03:00
Houkime
86c2ae2c1f
refactor(backups): make a StoppedService context manager
2023-07-17 16:05:00 +03:00
Houkime
ea4e53f826
test(backups): make delay settable per dummyservice
2023-07-17 16:05:00 +03:00
Houkime
e2b906b219
test(backups): test async service start n stop simulation
2023-07-17 16:05:00 +03:00
Houkime
d33e9d6335
test(backups): simulating async service start n stop
2023-07-17 16:05:00 +03:00
Houkime
8e29634d02
feature(utils): a hopefully reusable waitloop
2023-07-17 16:05:00 +03:00
Houkime
be95b84d52
feature(backups): expose restore strategies to the API
2023-07-17 16:05:00 +03:00
Houkime
cacbf8335d
fix(backups): actually mount if asked for an inplace restore
2023-07-17 16:05:00 +03:00
Houkime
65ce86f0f9
test(backups): test out that pre-restore backup plays nice with jobs
2023-07-17 16:05:00 +03:00
Houkime
95e4296d0b
feature(backups): implement inplace restore strategy
2023-07-17 16:05:00 +03:00
Houkime
59fe386463
feature(backups): restore strategies enum
2023-07-17 16:05:00 +03:00
Houkime
02e3c9bd5e
feature(backups): forgetting snapshots
2023-07-17 16:05:00 +03:00
Houkime
f361f44ded
feature(backups): check restore exit code
2023-07-17 16:05:00 +03:00
Houkime
4423db7458
refactor(backups): download a copy before replacing original
2023-07-17 16:05:00 +03:00
Houkime
9137536294
feature(backups): mounting a repo
2023-07-17 16:05:00 +03:00
Houkime
9a28c0ebcb
refactor(backups): move syncing (non-restic) into backup utils
2023-07-17 16:05:00 +03:00
Houkime
7ad5f91be1
refactor(backups): move output yielding into backup utils
2023-07-17 16:05:00 +03:00
Houkime
1c28984475
feature(backups): a wrapper for rclone sync
2023-07-17 16:05:00 +03:00
Inex Code
2df930b9ba
feat(backups): Add backup descriptions for UI
2023-07-17 16:05:00 +03:00
Inex Code
2c21bd2a14
feat(backups): expose if the service can be backed up
2023-07-17 16:05:00 +03:00
Inex Code
21c5f6814c
style: fix styling
2023-07-17 16:05:00 +03:00
Houkime
559de63221
fix(jobs): make finishing the job set progress to 100
2023-07-17 16:05:00 +03:00
Inex Code
ba9270755a
feat(jobs): return type_id of the job in graphql api
2023-07-17 16:05:00 +03:00
Houkime
0e13e61b73
fix(services): proper backup progress reporting
2023-07-17 16:05:00 +03:00
Houkime
1fb5e3af97
fix(services): cleanup a stray get_location
2023-07-17 16:05:00 +03:00
Houkime
2dd9da9a96
fix(backups): register the correct tasks
2023-07-17 16:05:00 +03:00
Inex Code
a7d0f6226f
fix(backups): missing space in rclone args
2023-07-17 16:05:00 +03:00
Houkime
e8f1f39b18
refactor(backups): rename service_snapshot_size to snapshot_restored_size
2023-07-17 16:05:00 +03:00
Houkime
f804c88fa6
refactor(backups): remove the by-service getting of cached snapshots
2023-07-17 16:05:00 +03:00
Houkime
6004977845
refactor(backups): rename force_snapshot_reload to force_snapshot_cache_reload
2023-07-17 16:05:00 +03:00
Houkime
3551813b34
refactor(backups): merge sync_all_snapshots with force_snapshot_reload
2023-07-17 16:05:00 +03:00
Houkime
ce55416b26
refactor(backups): straighten get_all_snapshots
2023-07-17 16:05:00 +03:00
Houkime
16a96fe0fa
refactor(backups): delete sync_service_snapshots
2023-07-17 16:05:00 +03:00
Houkime
f2161f0532
refactor(backups): privatize assert_restorable and restore_snapshot_from_id
2023-07-17 16:05:00 +03:00
Houkime
cb2273323f
refactor(backups): group operations together
2023-07-17 16:05:00 +03:00
Houkime
6369042420
refactor(backups): move reset() to top because toplevel interface
2023-07-17 16:05:00 +03:00
Houkime
3edb38262f
refactor(backups): make redis and json provider related lowlevels private
2023-07-17 16:05:00 +03:00
Houkime
3684345c2d
refactor(backups): make construct_provider not public
2023-07-17 16:05:00 +03:00
Houkime
6b0c55a786
refactor(backups): make lookup_provider not public
2023-07-17 16:05:00 +03:00
Houkime
dbac010303
refactor(backups): reorder imports
2023-07-17 16:05:00 +03:00
Houkime
c09f2f393b
refactor(backups): api readability reorg
2023-07-17 16:05:00 +03:00
Houkime
4b1594ca22
refactoring(backups): backuper -> backupper
2023-07-17 16:05:00 +03:00
Houkime
c94b4d07bf
fix(tokens-repo): persistent hashing
2023-07-17 16:05:00 +03:00
Inex Code
4225772573
fix(backups): Providers were not initialized corretly
2023-07-17 16:05:00 +03:00
Inex Code
f27a3df807
refactor(backups): fix typing errors
2023-07-17 16:05:00 +03:00
Inex Code
b78ee5fcca
refactor(api): Group mutations
...
I've learned that there is no problem in grouping mutations like we do with queries.
This is a big mistake from my side, now we have legacy not so conveniently placed endpoints.
I've grouped all mutations, left the copies of old ones flattened in the root for backwards compatibility.
We will migrate to mutation groups on client side, and backups now only use grouped mutations.
Tests are updated.
2023-07-17 16:05:00 +03:00
Houkime
53dfb38284
test(backups): ensure asking to reload snaps does not explode the server
2023-07-17 16:05:00 +03:00
Houkime
ecf72948b1
test(backups): setting autobackup period
2023-07-17 16:05:00 +03:00