Job servicevm incremental backup

genialweb 2017-10-27 06:18:53 UTC #1

Good morning,
I set a Job on the ServiceVM to back up images overnight to an external NAS.
Job generates a large amount of network traffic and it takes almost 11 hours to complete it because the images are transferred in full.

Currently the parameters are as follows: -hHxv --inplace --block-size = 128000

Is it possible to do this Job incrementally?

In the event it was not possible, I tried to exclude the images by inserting a TAG in the images themselves, but they are copied in any case … can you help me?

cordially

cdaffara 2017-10-27 08:30:42 UTC #2

The current backup script uses rsync; so it is incremental if the destination supports native rsync.
A full incremental and deduplicated backup target is being worked on.

penzoiders 2017-10-27 08:41:25 UTC #3

To have real rsync speedup you should use an SSH server (with rsync binary installed on it) with as backup endpoint.
On NFS and CIFS you won’t have any speedup since on the backup endpoint there’s no rsync process that is able to read the file in place, thus the backup process is forced to send the whole file.

genialweb 2017-10-27 08:53:25 UTC #4

Thanks Penzoiders,

The destination is a QNAP NAS that I find to have RSYNC service … can I set it effectively with nodewever?

penzoiders 2017-10-27 09:16:10 UTC #5

no, those would be rsyncd enpoints. you should look a way to log in to your QNAP using SSH with rsa-key auth.
Take a look here:

if you have issues with QNAP on ssh rsa-key login refer to their documentation or support forum/staff.

cheers

genialweb 2017-10-27 09:20:47 UTC #6

Ok Grazie ora guardo.
GT

genialweb 2017-10-27 21:23:31 UTC #7

Good evening, would you like to see an example of an incremental SSH incremental JOB RSYNC?
A configurational type of the form

genialweb 2017-11-02 10:14:40 UTC #8

hi, can not anyone help me?

stefanomassarotti 2017-11-22 08:06:56 UTC #9

Main information to create a backup job to a NAS (mounting the share locally)

Title
Description
Crontab rule
Type of Job : Backup on CIFS/ NFS share
Snapshot directory (to read from)
Mount connection type : CIFS or NFS
Backup TO (NAS IP)
Share directory TO (NAS share with complete path, for example for QNAP /share/)
Target subdirectory (optional)
User /password /domain (for CIFS)
User (for NFS)
Email for log

genialweb 2017-11-22 09:38:55 UTC #10

Thank you, Mr Stefano,
but these settings make an INCREMENTAL backup?

These are the settings that I used earlier, but the backup of the datastore is too long and it takes 14/16 hours to end … I have only 8 hours of quietness at night, and at 06.00 the client re-runs the production.
Making the transfer during production creates too much network slowdown … that’s why I insist on incremental backup if possible …

genialweb 2017-11-22 10:25:12 UTC #11

AN UPDATE

QNap’s new firmware version has introduced a new console that allows bi-directional or unidirectional synchronization to efficiently backup the Qnap over many protocols … Rsync RTRR CIFS SMB FTP

Is it possible to enable synchronization of NW image folders managed by the QNAP? what is the folder path? is there a specific user and password for accessing those folders?

Thanks, see you soon