Identify file being read by RDataFrame at time of crash

jcatmore · August 24, 2022, 8:40am

Hi,

I’m processing a large number of files with RDataFrame, and encounter an error whilst plotting a specific branch:

InDetTrackParticlesAuxDyn.chiSquared ROOT::VecOps::RVec<float>
Plotting InDetTrackParticlesAuxDyn.chiSquared
Error in <TTreeReader::SetEntryBase()>: There was an error while notifying the proxies.
Warning in <TTreeReader::SetEntryBase()>: Unexpected error '-6' in TChain::LoadTree
terminate called after throwing an instance of 'std::runtime_error'
  what():  An error was encountered while processing the data. TTreeReader status code is: 9
Aborted (core dumped)

Since I can plot a randomly selected file from the long list without problems, my guess is that one of the files has been corrupted. My question is, how do I find which one it is without individually testing each one? Is there a straightforward way of getting RDataFrame to print which file it is currently processing, hopefully such that it prints the name immediately before it crashes?

Thanks for any advice!

My code is below should you be interested, but I think the problem is fairly generic (in the end I’m just plotting variables).

Best wishes,

James Catmore

#include <ROOT/RDataFrame.hxx>
#include <TROOT.h>
#include <TStyle.h>
#include "TCanvas.h"
#include "TH1D.h"
#include "TF1.h"
#include "TRatioPlot.h"
#include <iostream>
#include <string>
#include <algorithm>

// Intersection of two lists of vectors, needed to get the variables that are common to both samples
std::vector<std::string> intersection(std::vector<std::string> &v1,
                                      std::vector<std::string> &v2){
    std::vector<std::string> v3;

    std::sort(v1.begin(), v1.end());
    std::sort(v2.begin(), v2.end());

    std::set_intersection(v1.begin(),v1.end(),
                          v2.begin(),v2.end(),
                          back_inserter(v3));
    // Alphabetical order while we're at it
    std::sort(v3.begin(), v3.end(), [](const std::string & a, const std::string & b) -> bool
    {
        return a < b;
    });

    return v3;
}


int main()
{
    // Run in batch mode - output is pdf
    gROOT->SetBatch(kTRUE);
    // No stats box
    gStyle->SetOptStat(0);
    // Parallel processing where possible
    //ROOT::EnableImplicitMT(4);

    // Create RDataFrame
    ROOT::RDataFrame refr("CollectionTree", "./data18_13TeV_p5267/*.pool.root.1");
    ROOT::RDataFrame test("CollectionTree", "./data18_13TeV_p5271/*.pool.root.1");

    // Event count and ratio
    auto refrEvents{refr.Count()};
    auto testEvents{test.Count()};
    float ratio{(float)refrEvents.GetValue() / (float)testEvents.GetValue()};
    std::cout << "========================" << std::endl;
    std::cout << "Reference events: " << refrEvents.GetValue() << std::endl;
    std::cout << "Test events: " << testEvents.GetValue() << std::endl;
    std::cout << "Ratio: " << ratio << std::endl;
    std::cout << "========================" << std::endl;


    // Get column names for each file and then the intersection
    auto colNamesRefr = refr.GetColumnNames();
    auto colNamesTest = test.GetColumnNames();
    auto colNames = intersection(colNamesRefr,colNamesTest);
    // Loop over column names and get a list of the required columns
    std::vector<std::string> requiredColumns;
    for (auto &&colName : colNames) {
        if ((colName.find("InDetTrackParticlesAuxDyn") != std::string::npos) && // include
            (colName.find("Trig") == std::string::npos) && // exclude, not meaningful
            (colName.find("Link") == std::string::npos) && // exclude, elementlinks
            (colName.find("m_persIndex")  == std::string::npos) && // exclude, elementlinks
            (colName.find("m_persKey")  == std::string::npos) && // exclude, elementlinks
            (colName.find("Parent")  == std::string::npos) && // exclude, elementlinks
            (colName.find("original")  == std::string::npos) && // exclude, elementlinks
            (colName.find("EventInfoAuxDyn.detDescrTags")  == std::string::npos) && // exclude, std::pair
            (refr.GetColumnType(colName).find("xAOD") == std::string::npos) && // exclude, needs ATLAS s/w
            (refr.GetColumnType(colName) != "ROOT::VecOps::RVec<string>") && // exclude, needs ATLAS s/w
            (refr.GetColumnType(colName).find("vector") == std::string::npos)) { // exclude, needs unwrapping
            requiredColumns.push_back(colName);
            std::cout << colName << " " << refr.GetColumnType(colName) << std::endl;
        }
    }

    // Create canvas
    auto c1 = new TCanvas("c1", "DAOD comparison");

    // Loop over the required columns and plot them for each sample along with the ratio
    // Write resulting plots to a pdf file
    std::string outputPDF{"data18_p5267_p5271.pdf"};
    const char * firstString = (outputPDF+"[").c_str();
    for (auto colName = requiredColumns.begin(); colName != requiredColumns.end(); ++colName) {
        const char * colNameCh = colName->c_str();
        std::cout << "Plotting " << *colName << std::endl;
        auto max = refr.Max(colNameCh).GetValue();
        auto min = refr.Min(colNameCh).GetValue();
        auto href = refr.Histo1D({colNameCh,colNameCh,128, min, max}, colNameCh);
        auto htst = test.Histo1D({colNameCh,colNameCh,128, min, max}, colNameCh);
        href->GetXaxis()->SetTitle(colNameCh);
        htst->GetYaxis()->SetTitle("Count");
        auto h1 = href.GetPtr();
        auto h2 = htst.GetPtr();
        h2->Scale(ratio);
        h2->SetMarkerStyle(20);
        auto rp = new TRatioPlot(h1,h2);
        c1->SetTicks(0, 1);
        rp->Draw();
        rp->GetLowerRefGraph()->SetMinimum(0.5);
        rp->GetLowerRefGraph()->SetMaximum(1.5);
        rp->GetLowYaxis()->SetNdivisions(505);
        c1->Update();
        if (colName==requiredColumns.begin()) {
            c1->Print((outputPDF+"[").c_str());
            c1->Clear();
        }
        if (colName != requiredColumns.begin() && (std::next(colName) != requiredColumns.end())) {
            c1->Print(outputPDF.c_str());
            c1->Clear();
        }
        if (std::next(colName) == requiredColumns.end()) {
            c1->Print((outputPDF+"]").c_str());
        }
        delete rp;
    }

    return(0);
}

Please read tips for efficient and successful posting and posting code

ROOT Version: 6.26/04
Platform: CentOS8
Compiler: gcc8.5

eguiraud · August 24, 2022, 9:42am

Hello James,

activating RDF logs should do the trick, see here.

Cheers,
Enrico

jcatmore · August 24, 2022, 10:20am

Hi Enrico,

thanks for the suggestion. I tried this but it dumped out all of the filenames at once, I guess because behind the scenes they’re chained up together.

In the meantime, I tried another approach, which was to create in a loop an RDataFrame for each file and then test each one with the problematic variable. This smoked out the problem quite quickly (ironically it was in the second file in the list out of 200!) Of course, I needed to write a new program to do this.

I’ve listed what I got from the logs below, FYI.

Thanks again!

James.

Plotting InDetTrackParticlesAuxDyn.chiSquared
Info in <[ROOT.RDF] Info /home/sftnight/build/ws/BUILDTYPE/Release/LABEL/ROOT-centos8/V/6-26/root/tree/dataframe/src/RLoopManager.cxx:747 in void ROOT::Detail::RDF::RLoopManager::Run()>: Starting event loop number 1.
Info in <[ROOT.RDF] Info /home/sftnight/build/ws/BUILDTYPE/Release/LABEL/ROOT-centos8/V/6-26/root/tree/dataframe/src/RLoopManager.cxx:722 in void ROOT::Detail::RDF::RLoopManager::Jit()>: Just-in-time compilation phase completed in 1.043670 seconds.
Info in <[ROOT.RDF] Info /home/sftnight/build/ws/BUILDTYPE/Release/LABEL/ROOT-centos8/V/6-26/root/tree/dataframe/src/RLoopManager.cxx:482 in void ROOT::Detail::RDF::RLoopManager::RunTreeReader()>: Processing trees {CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree,CollectionTree} in files {./data18_13TeV_p5267/DAOD_PHYS.30125463._000001.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000002.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000003.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000004.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000005.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000006.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000007.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000008.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000009.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000010.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000011.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000012.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000013.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000014.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000015.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000017.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000018.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000019.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000020.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000021.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000022.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000023.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000024.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000025.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000026.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000027.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000028.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000029.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000030.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000031.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000032.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000033.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000034.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000035.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000036.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000037.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000038.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000039.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000040.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000041.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000042.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000043.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000044.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000045.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000046.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000047.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000048.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000049.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000050.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000051.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000052.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000053.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000054.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000055.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000056.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000057.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000058.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000059.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000060.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000061.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000062.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000063.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000064.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000065.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000066.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000067.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000068.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000069.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000070.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000071.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000072.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000073.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000074.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000075.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000076.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000077.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000078.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000079.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000080.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000081.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000082.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000083.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000084.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000085.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000086.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000087.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000088.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000089.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000090.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000091.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000092.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000093.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000094.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000095.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000096.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000097.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000098.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000099.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000100.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000101.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000102.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000103.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000104.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000105.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000106.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000107.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000108.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000109.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000110.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000111.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000112.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000113.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000114.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000115.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000116.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000117.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000118.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000119.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000120.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000121.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000122.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000123.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000124.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000125.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000126.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000127.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000128.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000129.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000130.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000131.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000132.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000133.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000134.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000135.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000161.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000162.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000163.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000164.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000165.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000166.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000167.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000168.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000169.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000170.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000171.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000172.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000173.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000174.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000175.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000176.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000177.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000178.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000179.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000180.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000181.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000182.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000183.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000184.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000185.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000186.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000187.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000188.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000189.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000190.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000191.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000192.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000194.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000195.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000196.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000197.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000198.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000199.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000200.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000201.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000202.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000203.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000204.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000205.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000206.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000207.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000208.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000209.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000210.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000211.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000212.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000213.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000214.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000215.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000216.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000217.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000218.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000219.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000220.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000221.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000222.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000223.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000224.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000225.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000226.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000227.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000228.pool.root.1,./data18_13TeV_p5267/DAOD_PHYS.30125463._000229.pool.root.1}: entry range [0,20909804], using slot 0 in thread 140345329703872.
Error in <TTreeReader::SetEntryBase()>: There was an error while notifying the proxies.
Warning in <TTreeReader::SetEntryBase()>: Unexpected error '-6' in TChain::LoadTree
terminate called after throwing an instance of 'std::runtime_error'
  what():  An error was encountered while processing the data. TTreeReader status code is: 9
Aborted (core dumped)

eguiraud · August 24, 2022, 12:00pm

Ah yes, in a single thread run RDF will construct a single TChain with all the files and then loop on it.

In a multi-thread program you would see every task reading just certain files and then you could pinpoint which file is problematic based on which task fails (maybe in 2 or 3 steps depending on task granularity).

In any case, I’m happy you could solve this!

Cheers,
Enrico

system · September 7, 2022, 12:01pm

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.