rzerres/dsnap-sync
1
0
Fork 0
Code Issues Pull Requests Releases 1 Activity
301 Commits 3 Branches 1 Tag
19037b63a069ee9f3487867fffec3d822ff8cdb4
Commit Graph

301 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ralf Zerres
19037b63a0 TODO: update list 
Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-22 21:36:05 +02:00
Ralf Zerres
ab4113299b PKGBUILD: debian and ARCH-Linux build-files 
* debian: subdirectory and config-files
* debian: reference update
* arch:   PKGBUILD reference update

Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-22 21:36:05 +02:00
Ralf Zerres
7c82f85585 dsnap-sync: improve handling of btrfs-archive 
* handle mounting of correct volume-name
* get_archive_last_sync_id(): find corresponding synced id
* get_snapper_last_sync_id(): optional search for matching tapeid
* run_config_preparation(): harden init of snapper_target_sync_id
* run_backup():
  - correct itaration in multi config szenario
  - adopt verbosity messages
  - extend logic to eleminate sending of unnecessary streams
  - correct handling of remote transfer of archive streams
* code cleanup

Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-22 21:36:05 +02:00
Ralf Zerres
d4f725d0c9 dsnap-sync: code cleanup 
Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-22 21:36:05 +02:00
Ralf Zerres
e2a324eab7 dsnap-sync: resolve bug when sending incremental snapshots 
* run_backup(): btrfs send needs valid parent
  if last_sync id on target does not match id on source, use a valid
  common sync_id

Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-22 21:36:05 +02:00
Ralf Zerres
c65ed5d4af tape-admin: improve handling while mounting correct media 
* mount_tape(): verbosity messages when mounting mediapool member tapes
* adapt verbosity of ltfs mounts

Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-22 21:36:05 +02:00
Ralf Zerres
f105a525ae tape-admin: binary inclusion 
Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 20:52:22 +02:00
Ralf Zerres
fda862c6e9 Merge: update directory structure 
* remove src
* commit bin, etc

Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 20:16:55 +02:00
Ralf Zerres
71bc32d31b Markdown: remove trailing-whitespace 
Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 20:05:41 +02:00
Ralf Zerres
629786d9ec Merge branch 'wip-d2d' 
Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 19:35:03 +02:00
Ralf Zerres
d6fffcffe6 dsnap-sync: 0.5.9 version bump 
Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 18:12:57 +02:00
Ralf Zerres
156bc7fa9f dsnap-sync: typo cleanup 
Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 17:36:15 +02:00
Ralf Zerres
3469000512 dsnap-sync: cleanup verify_snapper_structure() 
* only create target path, if base_path isn't empty

Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 17:36:15 +02:00
Ralf Zerres
82b698750e Markdown: documentation update 
Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 17:36:06 +02:00
Ralf Zerres
f52ff68318 dsnap-sync: streamline info selection for backup medium 
* get_media_infos(): parse infos for backup medium

Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:59 +02:00
Ralf Zerres
291924df90 dsnap-sync: update handling of incremental snapshot sync 
Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:59 +02:00
Ralf Zerres
c6c12ac9ea dsnap-sync: pseudo array for fs_type adaption 
Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:59 +02:00
Ralf Zerres
a41f00f10e dsnap-sync: adapt dryrun message layout 
Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:59 +02:00
Ralf Zerres
7a5951231e dsnap-sync: introduce ionice 
* use I/O sceduling optons (class and priority)
* make usage optional

Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:59 +02:00
Ralf Zerres
99b4eb728c dsnap-sync: enable remote btrfs-stream to remote tape 
* get_tape_infos()
* run_backup()
* run_finalize()

Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:59 +02:00
Ralf Zerres
a8c00b6c1a dsnap-sync: rework structure for multiple configs 
* minor version bump to 0.5.9.4
* use XDG_RUNTIME_DIR for temp files
* use pseudo array for selected_configs
* update run_backups()

Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:59 +02:00
Ralf Zerres
b3e94be864 dsnap-sync: handle tape attributes 
Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:59 +02:00
Ralf Zerres
c426ca5f6d dsnap-sync: code cleanup 
* get_sanpper_sync_id() (arg: snapper_config, remote)

Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:59 +02:00
Ralf Zerres
a13ed29285 dsnap-sync: support full and incremental updates for btrfs-archive 
* use snapper_sync_id as global variable
* introduce snapper_backup_type
* introduce btrfs streams to be saved on no btrfs filesystems
  use stream files to holding the data
* get_archive_last_sync_id()
* check common snapper sync id's in source and target
* typo cleanup

Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:59 +02:00
Ralf Zerres
3ff5dc380a dsnap-sync: introduce selectable backup type 
* snapper_backup_type (btrfs-snapshot | btrfs-clone | btrfs-archive)
* refine a general target media (disk or LTOFS tape)
* refine a general backup directroy (on disk or on LTOFS tape)
* introduce selectable mediapool
* introduce selectable volumename
* introduce get_tape_infos()
* introduce select_target()
  this obsoletes select_disk_target()
* rename get_snapper_config_type() to get_snapper_backup_type()
* incorporate tape-admin wrapper
* run_backup(): adapt btrfs send to just save the stream to a file on tape

Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:59 +02:00
Ralf Zerres
8b606c90da dsnap-sync: update documentation for tag 0.5.9 
* README.md
* TODO.md
* Examples.md

Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:59 +02:00
Ralf Zerres
3fa9655950 dsnap-sync: 0.5.9 version bump 
Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:58 +02:00
Ralf Zerres
de73cefdd6 Makefile: update default target locations 
Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:58 +02:00
Ralf Zerres
86b3873651 tape-admin: extended functionality 
* check_prerequisites(): test for needed helper programs
* get_mediapool_names(): introduce new function
* get-lastwrite(): introduce new function
* get_poolmember_next(): handle selection of next tape
* mount(): handle ltfs and mtx calls in a correct order
* mount_tape(): check that mounted tape is member of selected mediapool
* ltfs_label(): use mkltfs to format and partitionin a given tape
* update_lastwrite()
* update_retensiondate()
* date_iso_to_seconds(): parse and format date-string
* date_seconds_to_iso(): parse and format date-string
* date_string_to_iso(): parse and format date-string
* typo cleanups
* update sample MediaPools.json file

Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:58 +02:00
Ralf Zerres
3a33a8f83e tape-admin: rename tape-changer/ltfs administration wrapper 
Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:58 +02:00
Ralf Zerres
ec121aecd1 type_admin: introduce media-changer / tape admin wrapper 
- tape_admin: helper script to handle common tape handling routines
- mtx: is used for media-changer functions
- json: define media-pools, corresponding volume-names and attributes

Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:58 +02:00
Ralf Zerres
cf2de4d984 dsnap-sync: align calulation for size in GiB 
Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:58 +02:00
Ralf Zerres
afb7702391 dsnap-sync: btrfs send/receive 
* asure we have matching source and target subvol id's
  if we want to send only the differences

Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:58 +02:00
Ralf Zerres
adef351e9d dsnap-sync: refine eval calls 
Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:58 +02:00
Ralf Zerres
36a0c57971 dsnap-sync: make btrfs_quota usage an option 
Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:58 +02:00
Ralf Zerres
293dfba348 dsnap-sync: 0.5.8 version bump 
Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:58 +02:00
Ralf Zerres
37264eb4f5 dsnap-sync: inculde btrfs quota check 
* get size of snapshot from 'btrfs qgroup show' function
* precise size information needs sync, which can take a while
  but is far cheeper then du --sum on big subvolume

Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:58 +02:00
Ralf Zerres
c4244cb34d dsnap-sync: be more precise on completion message 
Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:58 +02:00
Ralf Zerres
831544f86d dsnap-sync: btrfs send/recieve pipe update 
* always use btrfs with '-p flag' for sending incremental streams
  Andrei: https://www.spinics.net/lists/linux-btrfs/msg69369.html

Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:58 +02:00
Ralf Zerres
a8b609ce94 dsnap-sync: correct lookup for common sync_id 
Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:58 +02:00
Ralf Zerres
a433ee1a9b dsnap-sync: verbosity level update 
- v1: Basic messages (main function calls)
- v2: Notice messages (feedback from main functions)
- v3: Informaional messages (feedback from helper functions)

Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:57 +02:00
Ralf Zerres
3403ddc235 dsnap-sync: update pv handling 
Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:57 +02:00
Ralf Zerres
75c4f8c5bb dsnap-sync: function updates 
* verify_structure() stat function evaluation cleanup
* get_disk_info() cmd alingnment

Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:57 +02:00
Ralf Zerres
7e6ec2a997 dsnap-sync: cleanup global variable assignment 
* declare defaults
* assign integer values
* evaluate command

Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:57 +02:00
Ralf Zerres
b910ca6086 dsnap-sync: update btrfs type handling 
* adapt dry-run output
* differenciate handling for btrfs-snapshot, btrfs-clone and btrfs-archive

Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:57 +02:00
Ralf Zerres
9b39792fb9 dsnap-sync: automounter handling update 
- use systemd unit and stat the file-system

Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:57 +02:00
Ralf Zerres
9c2c9c6194 dsnap-sync: code identation update 
Signed-off-by: Ralf Zerres <ralf.zerres@networkx.de>
 2018-09-21 15:53:57 +02:00
Ralf Zerres
d3b6c972c5 Markdown: introduce language specific versions 
* new subdir lang to hold the language specific code
* introduce german README.md
 2018-09-21 15:53:44 +02:00
Ralf Zerres
9628a9a623 Markdown: update markup text to reflact changes for verson 0.5.7 
* Basic description in README.md
* Example section in /usr/share/doc/Examples.md
 2018-07-17 01:03:19 +02:00
Ralf Zerres
f461599b2e dsnap-sync: 0.5.7 version bump 2018-07-17 01:03:19 +02:00