Houkime
9a28c0ebcb
refactor(backups): move syncing (non-restic) into backup utils
2023-07-17 16:05:00 +03:00
Houkime
7ad5f91be1
refactor(backups): move output yielding into backup utils
2023-07-17 16:05:00 +03:00
Houkime
1c28984475
feature(backups): a wrapper for rclone sync
2023-07-17 16:05:00 +03:00
Inex Code
2df930b9ba
feat(backups): Add backup descriptions for UI
2023-07-17 16:05:00 +03:00
Inex Code
2c21bd2a14
feat(backups): expose if the service can be backed up
2023-07-17 16:05:00 +03:00
Inex Code
21c5f6814c
style: fix styling
2023-07-17 16:05:00 +03:00
Houkime
559de63221
fix(jobs): make finishing the job set progress to 100
2023-07-17 16:05:00 +03:00
Inex Code
ba9270755a
feat(jobs): return type_id of the job in graphql api
2023-07-17 16:05:00 +03:00
Houkime
0e13e61b73
fix(services): proper backup progress reporting
2023-07-17 16:05:00 +03:00
Houkime
1fb5e3af97
fix(services): cleanup a stray get_location
2023-07-17 16:05:00 +03:00
Houkime
2dd9da9a96
fix(backups): register the correct tasks
2023-07-17 16:05:00 +03:00
Inex Code
a7d0f6226f
fix(backups): missing space in rclone args
2023-07-17 16:05:00 +03:00
Houkime
e8f1f39b18
refactor(backups): rename service_snapshot_size to snapshot_restored_size
2023-07-17 16:05:00 +03:00
Houkime
f804c88fa6
refactor(backups): remove the by-service getting of cached snapshots
2023-07-17 16:05:00 +03:00
Houkime
6004977845
refactor(backups): rename force_snapshot_reload to force_snapshot_cache_reload
2023-07-17 16:05:00 +03:00
Houkime
3551813b34
refactor(backups): merge sync_all_snapshots with force_snapshot_reload
2023-07-17 16:05:00 +03:00
Houkime
ce55416b26
refactor(backups): straighten get_all_snapshots
2023-07-17 16:05:00 +03:00
Houkime
16a96fe0fa
refactor(backups): delete sync_service_snapshots
2023-07-17 16:05:00 +03:00
Houkime
f2161f0532
refactor(backups): privatize assert_restorable and restore_snapshot_from_id
2023-07-17 16:05:00 +03:00
Houkime
cb2273323f
refactor(backups): group operations together
2023-07-17 16:05:00 +03:00
Houkime
6369042420
refactor(backups): move reset() to top because toplevel interface
2023-07-17 16:05:00 +03:00
Houkime
3edb38262f
refactor(backups): make redis and json provider related lowlevels private
2023-07-17 16:05:00 +03:00
Houkime
3684345c2d
refactor(backups): make construct_provider not public
2023-07-17 16:05:00 +03:00
Houkime
6b0c55a786
refactor(backups): make lookup_provider not public
2023-07-17 16:05:00 +03:00
Houkime
dbac010303
refactor(backups): reorder imports
2023-07-17 16:05:00 +03:00
Houkime
c09f2f393b
refactor(backups): api readability reorg
2023-07-17 16:05:00 +03:00
Houkime
4b1594ca22
refactoring(backups): backuper -> backupper
2023-07-17 16:05:00 +03:00
Houkime
c94b4d07bf
fix(tokens-repo): persistent hashing
2023-07-17 16:05:00 +03:00
Inex Code
4225772573
fix(backups): Providers were not initialized corretly
2023-07-17 16:05:00 +03:00
Inex Code
f27a3df807
refactor(backups): fix typing errors
2023-07-17 16:05:00 +03:00
Inex Code
b78ee5fcca
refactor(api): Group mutations
...
I've learned that there is no problem in grouping mutations like we do with queries.
This is a big mistake from my side, now we have legacy not so conveniently placed endpoints.
I've grouped all mutations, left the copies of old ones flattened in the root for backwards compatibility.
We will migrate to mutation groups on client side, and backups now only use grouped mutations.
Tests are updated.
2023-07-17 16:05:00 +03:00
Houkime
53dfb38284
test(backups): ensure asking to reload snaps does not explode the server
2023-07-17 16:05:00 +03:00
Houkime
ecf72948b1
test(backups): setting autobackup period
2023-07-17 16:05:00 +03:00
Houkime
f829a34dc7
refactor(backups): delete legacy provider setting
2023-07-17 16:05:00 +03:00
Houkime
9f096ed2c0
feature(backups): actually dealing with situation when the provider is not configured
2023-07-17 16:05:00 +03:00
Houkime
cd32aa83b7
refactor(backups): NoneBackupper class for those cases when we do not know
2023-07-17 16:05:00 +03:00
Houkime
a56461fb96
refactor(backups): make a dir for backuppers
2023-07-17 16:05:00 +03:00
Houkime
806fb3c84b
feature(backups): resetting json config too
2023-07-17 16:05:00 +03:00
Houkime
1fd5db9ff3
fix(backups): fix output API return types for configuration
2023-07-17 16:05:00 +03:00
Houkime
5d95c1b44e
test(backups): preliminary test of repo reset
2023-07-17 16:05:00 +03:00
Houkime
1c96743c5d
test(backups): test reinitting repository
2023-07-17 16:05:00 +03:00
Houkime
38de01da8b
refactor(backups): cleanup localfile-specific logic
2023-07-17 16:05:00 +03:00
Houkime
8475ae3375
refactor(backups): make localfile repos normal
2023-07-17 16:05:00 +03:00
Houkime
53638b7e06
test(backups): make dummy service more compliant
2023-07-17 16:05:00 +03:00
Inex Code
93b98cd4fd
fix(backups): Handle orphaned snapshots
2023-07-17 16:05:00 +03:00
Inex Code
421c92d12e
fix(backups): return type of encryption key
2023-07-17 16:05:00 +03:00
Inex Code
c603394449
fix(backups): try to actually get backup configuration
2023-07-17 16:05:00 +03:00
Houkime
b04dfc6c4e
fix(backups): register queries
2023-07-17 16:05:00 +03:00
Houkime
42a5b6f70a
test(backups): test backup API - backing up
2023-07-17 16:05:00 +03:00
Inex Code
32a242b560
feat(backups): register backups in GraphQL schema
2023-07-17 16:05:00 +03:00
Inex Code
a4b0e6f208
fix: BackupConfiguration argument order
2023-07-17 16:05:00 +03:00
Houkime
ad130e392c
feature(backups): check available space before restoring
2023-07-17 16:05:00 +03:00
Houkime
780c12df6c
refactor(backups): expect one more error of restic json output parsing
2023-07-17 16:05:00 +03:00
Houkime
6da0791b47
feature(backups): integration between restore and jobs
2023-07-17 16:05:00 +03:00
Houkime
792dcd459d
fix(backups): return one job, not an array of one
2023-07-17 16:05:00 +03:00
Houkime
5100f1a497
fix(backups): return 400, not 300
2023-07-17 16:05:00 +03:00
Houkime
44e45a5124
BREAKING CHANGE(backups): support only individual service backup requests(combinable)
2023-07-17 16:05:00 +03:00
Houkime
0b8f77e6f7
feature(backups): set autobackup period from gql
2023-07-17 16:05:00 +03:00
Houkime
e3545d4541
feature(backups): get all snapshots if requested by api
2023-07-17 16:05:00 +03:00
Houkime
550f7fa620
refactor(backups): introduce get_all_snapshots()
2023-07-17 16:05:00 +03:00
Houkime
cc073155db
feature(backups): feature(backups): return a snapshot from start_backup
2023-07-17 16:05:00 +03:00
Houkime
891993e4cd
feature(backups): a graphql call to invalidate cache
2023-07-17 16:05:00 +03:00
Houkime
7e022e0cfe
feature(backups): graphql mutation for restore
2023-07-17 16:05:00 +03:00
Houkime
44ddd27e84
fix(backups): return correct snapshots per service
2023-07-17 16:05:00 +03:00
Houkime
761b6be4e5
refactor(backups): global snapshots
2023-07-17 16:05:00 +03:00
Houkime
a76b4ac134
feature(backups): start backup graphql API
2023-07-17 16:05:00 +03:00
Houkime
ac9fbbff3e
feature(backups): drop repository call
2023-07-17 16:05:00 +03:00
Houkime
bdae6cfb75
feature(backups): global init instead of per-service
2023-07-17 16:05:00 +03:00
Houkime
e7683352cd
feature(backups): a graphql query to get provider info
2023-07-17 16:05:00 +03:00
Houkime
d0b27da641
feature(backups): init repo mutation
2023-07-17 16:05:00 +03:00
Houkime
d10bf99927
fix(backups): make sure location and credentials get properly passed around
2023-07-17 16:05:00 +03:00
Houkime
c5c41b3ced
refactor(backups): remove extraneous asserts from jobs
2023-07-17 16:05:00 +03:00
Houkime
c8512eacdc
refactor(backups): refactor realtime updating
2023-07-17 16:05:00 +03:00
Houkime
d38b8180cb
feature(backups): realtime progress updates of backups
2023-07-17 16:05:00 +03:00
Houkime
135fb0c42d
feature(backups): job progress logs
2023-07-17 16:05:00 +03:00
Houkime
ca036b294a
refactor(backups): break out job logs status prefix
2023-07-17 16:05:00 +03:00
Houkime
afdbf01cfc
refactor(backups): use single repo and multiplex by tags
2023-07-17 16:05:00 +03:00
Houkime
ecf44e5169
feature(backups): deny adding a backup job if another one is already queued
2023-07-17 16:05:00 +03:00
Houkime
ebff2b308a
test(backups): test that the job has run
2023-07-17 16:05:00 +03:00
Houkime
2a87eb80f9
refactor(backups): quick-expiration logs of jobs status updates
2023-07-17 16:05:00 +03:00
Houkime
f116ce1bdb
feature(backups): set job status to error if backup fails
2023-07-17 16:05:00 +03:00
Houkime
05f2cc3f14
refactor(backups): cleanup unused imports in tasks
2023-07-17 16:05:00 +03:00
Houkime
f622d617cf
test(backups): test jobs starting and finishing when from Backups
2023-07-17 16:05:00 +03:00
Houkime
ac6d25c4c1
refactor(backups): make a backup job running when the backup code itself is executed
2023-07-17 16:05:00 +03:00
Houkime
026d72b551
refactor(backups): delete unused redis import from backups ckass
2023-07-17 16:05:00 +03:00
Houkime
029cb47db6
feature(backups): also create a job if not called from a task
2023-07-17 16:05:00 +03:00
Houkime
fa86c45bd0
feature(backups): simplest jobs intergration in tasks: created and finished
2023-07-17 16:05:00 +03:00
Houkime
4572c00640
feature(backups): restore task
2023-07-17 16:05:00 +03:00
Houkime
d3f9ce7bf5
test(backups): test local secrets
2023-07-17 16:05:00 +03:00
Houkime
ebeb76149b
refactor(services): make local secret setting public
2023-07-17 16:05:00 +03:00
Houkime
592eb1a1f8
refactor(services): use fully generic foldermoves
2023-07-17 16:05:00 +03:00
Houkime
f09d21a031
test(services): test derivation of foldermoves
2023-07-17 16:05:00 +03:00
Houkime
7a5af6af99
test(services): test that we indeed return correct folders and owned folders from real services
2023-07-17 16:05:00 +03:00
Houkime
aca05f26ea
fix(services): folder methods typing
2023-07-17 16:05:00 +03:00
Houkime
92be699031
refactor(services): make a foldermove from owned path
2023-07-17 16:05:00 +03:00
Houkime
71b987da57
refactor(services): add folder owner derivation
2023-07-17 16:05:00 +03:00
Houkime
9f2dbaa98d
refactor(services): add overridable get owner and get group
2023-07-17 16:05:00 +03:00
Houkime
6057e350ef
refactor(services): add OwnedPath struct
2023-07-17 16:05:00 +03:00
Houkime
df5b318fff
refactor(services): remove special storage counting from pleroma
2023-07-17 16:05:00 +03:00
Houkime
f0d6ac624d
refactor(services): remove special storage counting from ocserv
2023-07-17 16:05:00 +03:00