Hadd 100 GB TTree

Hi,

I have to merge different .root files using hadd but I am getting the following error :

DYLD_INSERT_LIBRARIES=startup_C.so hadd -k All.root ttbarsample*

hadd Target file: All.root
hadd compression setting for all output: 1
hadd Source file 1: ttbarsample10.root
hadd Source file 2: ttbarsample11.root
hadd Source file 3: ttbarsample12.root
hadd Source file 4: ttbarsample13.root
hadd Source file 5: ttbarsample14.root
hadd Source file 6: ttbarsample15.root
hadd Source file 7: ttbarsample16.root
hadd Source file 8: ttbarsample17.root
hadd Source file 9: ttbarsample18.root
hadd Source file 10: ttbarsample19.root
hadd Source file 11: ttbarsample1.root
hadd Source file 12: ttbarsample20.root
hadd Source file 13: ttbarsample21.root
hadd Source file 14: ttbarsample2.root
hadd Source file 15: ttbarsample3.root
hadd Source file 16: ttbarsample4.root
hadd Source file 17: ttbarsample5.root
hadd Source file 18: ttbarsample6.root
hadd Source file 19: ttbarsample7.root
hadd Source file 20: ttbarsample8.root
hadd Source file 21: ttbarsample9.root
hadd Target path: All.root:/
Fill: Switching to new file: All_1.root
Fatal in <TFileMerger::RecursiveRemove>: Output file of the TFile Merger (targeting All.root) has been deleted (likely due to a TTree larger than 100Gb)
aborting

#0 0x00007fd62fa32bbc in waitpid () from /lib64/libc.so.6
#1 0x00007fd62f9b0ea2 in do_system () from /lib64/libc.so.6
#2 0x00007fd630b3e533 in TUnixSystem::StackTrace() () from /cvmfs/sft.cern.ch/lcg/releases/LCG_96b/ROOT/6.18.04/x86_64-centos7-gcc8-opt/lib/libCore.so
#3 0x00007fd630a2bd21 in DefaultErrorHandler(int, bool, char const*, char const*) () from /cvmfs/sft.cern.ch/lcg/releases/LCG_96b/ROOT/6.18.04/x86_64-centos7-gcc8-opt/lib/libCore.so
#4 0x00007fd630a2b80a in ErrorHandler () from /cvmfs/sft.cern.ch/lcg/releases/LCG_96b/ROOT/6.18.04/x86_64-centos7-gcc8-opt/lib/libCore.so
#5 0x00007fd630a3f084 in TObject::Fatal(char const*, char const*, ...) const () from /cvmfs/sft.cern.ch/lcg/releases/LCG_96b/ROOT/6.18.04/x86_64-centos7-gcc8-opt/lib/libCore.so
#6 0x00007fd630aa925b in THashList::RecursiveRemove(TObject*) () from /cvmfs/sft.cern.ch/lcg/releases/LCG_96b/ROOT/6.18.04/x86_64-centos7-gcc8-opt/lib/libCore.so
#7 0x00007fd6309fc120 in TROOT::RecursiveRemove(TObject*) () from /cvmfs/sft.cern.ch/lcg/releases/LCG_96b/ROOT/6.18.04/x86_64-centos7-gcc8-opt/lib/libCore.so
#8 0x00007fd630a3eaa8 in TNamed::~TNamed() () from /cvmfs/sft.cern.ch/lcg/releases/LCG_96b/ROOT/6.18.04/x86_64-centos7-gcc8-opt/lib/libCore.so
#9 0x00007fd6312323f9 in TFile::~TFile() [clone .localalias.203] () from /cvmfs/sft.cern.ch/lcg/releases/LCG_96b/ROOT/6.18.04/x86_64-centos7-gcc8-opt/lib/libRIO.so
#10 0x00007fd632f9088e in TTree::ChangeFile(TFile*) () from /cvmfs/sft.cern.ch/lcg/releases/LCG_96b/ROOT/6.18.04/x86_64-centos7-gcc8-opt/lib/libTree.so
#11 0x00007fd632f976a8 in TTree::CopyEntries(TTree*, long long, char const*) () from /cvmfs/sft.cern.ch/lcg/releases/LCG_96b/ROOT/6.18.04/x86_64-centos7-gcc8-opt/lib/libTree.so
#12 0x00007fd632f963f0 in TTree::Merge(TCollection*, TFileMergeInfo*) () from /cvmfs/sft.cern.ch/lcg/releases/LCG_96b/ROOT/6.18.04/x86_64-centos7-gcc8-opt/lib/libTree.so
#13 0x00007fd631220520 in TFileMerger::MergeRecursive(TDirectory*, TList*, int) () from /cvmfs/sft.cern.ch/lcg/releases/LCG_96b/ROOT/6.18.04/x86_64-centos7-gcc8-opt/lib/libRIO.so
#14 0x00007fd63121ea17 in TFileMerger::PartialMerge(int) () from /cvmfs/sft.cern.ch/lcg/releases/LCG_96b/ROOT/6.18.04/x86_64-centos7-gcc8-opt/lib/libRIO.so
#15 0x0000000000406f9d in main::{lambda(TFileMerger&, int, int)#2}::operator()(TFileMerger&, int, int) const [clone .constprop.183] ()
#16 0x0000000000405080 in main ()
Aborted (core dumped)

I am aware that this error is already posted :

https://root-forum.cern.ch/t/root-6-04-14-hadd-100gb-and-rootlogon/24581

But the solution did not work for me.

Thanks for your help
Best wishes
TNOURJI Abdellah.


Please read tips for efficient and successful posting and posting code

ROOT Version: Not Provided
Platform: Not Provided
Compiler: Not Provided


May be @pcanal has an idea.

1 Like

Are you running on MacOS or Linux?

Hi, i am using macOS and if this this will helps: i am connecting to the ssh server of the lab.

Cheers,

hummm since you are “connecting to the ssh server of the lab.”, the shell in which you executed ROOT is likely running on a Linux OS, so you need:

LD_PRELOAD=startup_C.so hadd -k All.root ttbarsample*
1 Like

Hi,

I got the same error :

LD_PRELOAD=./startup_C.so hadd -k All.root ttbarsample*

hadd Target file: All.root

hadd compression setting for all output: 1

hadd Source file 1: ttbarsample10.root

hadd Source file 2: ttbarsample11.root

hadd Source file 3: ttbarsample12.root

hadd Source file 4: ttbarsample13.root

hadd Source file 5: ttbarsample14.root

hadd Source file 6: ttbarsample15.root

hadd Source file 7: ttbarsample16.root

hadd Source file 8: ttbarsample17.root

hadd Source file 9: ttbarsample18.root

hadd Source file 10: ttbarsample19.root

hadd Source file 11: ttbarsample1.root

hadd Source file 12: ttbarsample20.root

hadd Source file 13: ttbarsample21.root

hadd Source file 14: ttbarsample2.root

hadd Source file 15: ttbarsample3.root

hadd Source file 16: ttbarsample4.root

hadd Source file 17: ttbarsample5.root

hadd Source file 18: ttbarsample6.root

hadd Source file 19: ttbarsample7.root

hadd Source file 20: ttbarsample8.root

hadd Source file 21: ttbarsample9.root

hadd Target path: All.root:/

Warning in <TTree::ChangeFile>: file All_1.root already exist, trying with 2 underscores

Fill: Switching to new file: All__1.root

Fatal in <TFileMerger::RecursiveRemove>: Output file of the TFile Merger (targeting All.root) has been deleted (likely due to a TTree larger than 100Gb)

aborting

#0 0x00007f37e9c60bbc in waitpid () from /lib64/libc.so.6

#1 0x00007f37e9bdeea2 in do_system () from /lib64/libc.so.6

#2 0x00007f37ead6c533 in TUnixSystem::StackTrace() () from /cvmfs/sft.cern.ch/lcg/releases/LCG_96b/ROOT/6.18.04/x86_64-centos7-gcc8-opt/lib/libCore.so

#3 0x00007f37eac59d21 in DefaultErrorHandler(int, bool, char const*, char const*) () from /cvmfs/sft.cern.ch/lcg/releases/LCG_96b/ROOT/6.18.04/x86_64-centos7-gcc8-opt/lib/libCore.so

#4 0x00007f37eac5980a in ErrorHandler () from /cvmfs/sft.cern.ch/lcg/releases/LCG_96b/ROOT/6.18.04/x86_64-centos7-gcc8-opt/lib/libCore.so

#5 0x00007f37eac6d084 in TObject::Fatal(char const*, char const*, ...) const () from /cvmfs/sft.cern.ch/lcg/releases/LCG_96b/ROOT/6.18.04/x86_64-centos7-gcc8-opt/lib/libCore.so

#6 0x00007f37eacd725b in THashList::RecursiveRemove(TObject*) () from /cvmfs/sft.cern.ch/lcg/releases/LCG_96b/ROOT/6.18.04/x86_64-centos7-gcc8-opt/lib/libCore.so

#7 0x00007f37eac2a120 in TROOT::RecursiveRemove(TObject*) () from /cvmfs/sft.cern.ch/lcg/releases/LCG_96b/ROOT/6.18.04/x86_64-centos7-gcc8-opt/lib/libCore.so

#8 0x00007f37eac6caa8 in TNamed::~TNamed() () from /cvmfs/sft.cern.ch/lcg/releases/LCG_96b/ROOT/6.18.04/x86_64-centos7-gcc8-opt/lib/libCore.so

#9 0x00007f37eb4603f9 in TFile::~TFile() [clone .localalias.203] () from /cvmfs/sft.cern.ch/lcg/releases/LCG_96b/ROOT/6.18.04/x86_64-centos7-gcc8-opt/lib/libRIO.so

#10 0x00007f37ed1be88e in TTree::ChangeFile(TFile*) () from /cvmfs/sft.cern.ch/lcg/releases/LCG_96b/ROOT/6.18.04/x86_64-centos7-gcc8-opt/lib/libTree.so

#11 0x00007f37ed1c56a8 in TTree::CopyEntries(TTree*, long long, char const*) () from /cvmfs/sft.cern.ch/lcg/releases/LCG_96b/ROOT/6.18.04/x86_64-centos7-gcc8-opt/lib/libTree.so

#12 0x00007f37ed1c43f0 in TTree::Merge(TCollection*, TFileMergeInfo*) () from /cvmfs/sft.cern.ch/lcg/releases/LCG_96b/ROOT/6.18.04/x86_64-centos7-gcc8-opt/lib/libTree.so

#13 0x00007f37eb44e520 in TFileMerger::MergeRecursive(TDirectory*, TList*, int) () from /cvmfs/sft.cern.ch/lcg/releases/LCG_96b/ROOT/6.18.04/x86_64-centos7-gcc8-opt/lib/libRIO.so

#14 0x00007f37eb44ca17 in TFileMerger::PartialMerge(int) () from /cvmfs/sft.cern.ch/lcg/releases/LCG_96b/ROOT/6.18.04/x86_64-centos7-gcc8-opt/lib/libRIO.so

#15 0x0000000000406f9d in main::{lambda(TFileMerger&, int, int)#2}::operator()(TFileMerger&, int, int) const [clone .constprop.183] ()

#16 0x0000000000405080 in main ()

Aborted (core dumped)

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.