I am waiting to see if this resolves the issue. I will report back whether or not this resolves it, but any feedback before or after the macro ends would be appreciated.
Can you share also your ROOT files so one can run the macro and reproduce the problem.
Probably you can try run it with the minimal amount of data needed
Thank you for the reply. The files used are all rather large, ranging on the order of tens of MB to tens of GB. I am able to run the macro with files corresponding to decimated samples of these larger files. This is something I meant to suggest through this post’s title.
As not everything is being used in these files, it makes me think that a possible workaround could be to create files which copy over only the variables being used?
What I will try and do here is copy over and upload one of the smaller decimated files, on the off chance that the problem could be due to file structure.
Unfortunately, the other type of file from which variables are pulled all appear to be too large to upload here, the smallest of these decimated files appears to be 4.2 MB.
If structure isn’t the problem, might I ask for a recommendation on how I can share the files in question? Files containing one set of variables total 34 G, while files containing the other set of variables total 642 G. The corresponding decimated versions of these file total 7.8 G and 119 G, respectively.
Hi,
I will check the structure of the file. Thank you for uploading this smaller one.
For sharing the large file, if you have a CERN account you could use cernbox, there a user should have a space of around 1TB.
I see also the crash is happening in the function TTreeFormula::LoadCurrentDim() that is called by TTreeFormulaManager::GetNdata(bool) .
Maybe @pcanal is having an idea what could be the problem
The first of the files contains the first few entries of the file I already attached earlier. The other, larger, file contains other variables corresponding to these entries. Opening this other file, ROOT may complain about custom classes, but the file should be readable. If not, it should become readable after git cloneing the repository https://github.com/anitaNeutrino/anitaBuildTool, and then running ./buildAnita.sh from within the anitaBuildTool directory.
Thank you John, I will try with those file.
For the CERN account, if you don’t have an association or collaboration with CERN, then it is unfortunatly not possible to get it. And I guess sharing tools like Google drive or dropbox don’t allow free sharing of such large files.
I hope we can solve the problem looking at the small files.
Best,