Speeding up rsync

ROOT
1

Hello,

I produce a number of root files (containing histograms) remotely, hadd them, then rsync them to my laptop for analysis. It appears that even a minor change (a title, for instance) causes rsync to pull the entire file instead of just the delta.

Are there options I can pass to either hadd or rsync to try and minimize the required bytes to transfer? Is there perhaps a better way to do this?

Thanks,
Andrew

2

Hi Andrew,

this looks like a problem which cannot be solved on the ROOT side.
I can propose two options:

  1. Read the files over the network. With ROOT you can read files on eos, files served via a web server …
  2. Try the “–inplace” option of rsync

I suspect you are aiming to a local analysis setup but I thought it was worth to mention 1).

Cheers,
Danilo