I am getting an error code that I don't know how to decode

William_Sorger · June 10, 2024, 2:15pm

ROOT Version: ROOT 6.30/02
Platform: Lxplus
Compiler: Python

My code crashes when computing the histograms for dijet mass, I am unable to understand what the error is even telling me which makes this a hard problem to solve. The code it uses is

ComputeInvariantMass_code = 
ROOT::VecOps::RVec<double> ComputeInvariantMass(ROOT::VecOps::RVec<float> pt, ROOT::VecOps::RVec<float> eta, ROOT::VecOps::RVec<float> phi,
 ROOT::VecOps::RVec<float> m)
{
  if(2 > pt.size()) return ROOT::VecOps::RVec<double> {std::numeric_limits<double>::min()};
  
  TLorentzVector p[2];
  //This creates all the p vectors
  for(int i ; i < pt.size(); i++) p[i].SetPtEtaPhiM(pt[i], eta[i], phi[i], m[i]);

  //We create an empty RVec
  ROOT::VecOps::RVec<double> r;
  //Then create an RVec with all possible unique 2 combinations of indexes for the momentum vectors
  auto v_1 = ROOT::VecOps::Combinations (pt, 2);
  //We then define a size to make the r RVec accomidate all the combinations 
  const auto size = v_1[0].size();
  r.reserve(size);

  //We then fill up the r RVec with index values from v_1 for the momentum then get invariant mass
   for(int i=0; i<size; i++) {
      r.emplace_back((p[v_1[0][i]] + p[v_1[1][i]]).M());
    }
  return r;

}

ROOT.gInterpreter.Declare(ComputeInvariantMass_code)ComputeInvariantMass_code = '''
ROOT::VecOps::RVec<double> ComputeInvariantMass(ROOT::VecOps::RVec<float> pt, ROOT::VecOps::RVec<float> eta, ROOT::VecOps::RVec<float> phi,
 ROOT::VecOps::RVec<float> m)
{
  if(2 > pt.size()) return ROOT::VecOps::RVec<double> {std::numeric_limits<double>::min()};
  
  TLorentzVector p[2];
  //This creates all the p vectors
  for(int i ; i < pt.size(); i++) p[i].SetPtEtaPhiM(pt[i], eta[i], phi[i], m[i]);

  //We create an empty RVec
  ROOT::VecOps::RVec<double> r;
  //Then create an RVec with all possible unique 2 combinations of indexes for the momentum vectors
  auto v_1 = ROOT::VecOps::Combinations (pt, 2);
  //We then define a size to make the r RVec accomidate all the combinations 
  const auto size = v_1[0].size();
  r.reserve(size);

  //We then fill up the r RVec with index values from v_1 for the momentum then get invariant mass
   for(int i=0; i<size; i++) {
      r.emplace_back((p[v_1[0][i]] + p[v_1[1][i]]).M());
    }
  return r;

}


ROOT.gInterpreter.Declare(ComputeInvariantMass_code)

I know there are some ways of viewing the debug, but I am unsure on how to access them on lxplus, and I am currently using VScode to code. Can anyone help me understand the error that is being thrown up?

I am posting Error message below as it is quite large.

William_Sorger · June 10, 2024, 2:16pm

pt 1 of error

Processing sample SMWZqcd at Samples/bkgWZ/SM_WZqcd/events_SMWZqcd.root
TChain created with 10000 entries
('argsMuons', 'ROOT::VecOps::Reverse(ROOT::VecOps::Argsort(Muon.PT));')
('argsElectron', 'ROOT::VecOps::Reverse(ROOT::VecOps::Argsort(Electron.PT));')
('leptons', 'ROOT::VecOps::Concatenate(Electron.PT, Muon.PT);')
('argLeptons', 'ROOT::VecOps::Reverse(ROOT::VecOps::Argsort(leptons));')
('argJets', 'ROOT::VecOps::Reverse(ROOT::VecOps::Argsort(Jet.PT));')
('muonPt', 'ROOT::VecOps::Take(Muon.PT, argsMuons);')
('electronPt', 'ROOT::VecOps::Take(Electron.PT, argsElectron);')
('leptonPt', 'ROOT::VecOps::Take(leptons, argLeptons);')
('jetPt', ' ROOT::VecOps::Take(Jet.PT, argJets);')
('met', 'MissingET.MET[0]')
('leptonMass', 'LeptonMass(electronPt, muonPt, leptonPt);')
('leptonEta', 'ROOT::VecOps::Take(ROOT::VecOps::Concatenate(Electron.Eta, Muon.Eta), argLeptons);')
('leptonPhi', 'ROOT::VecOps::Take(ROOT::VecOps::Concatenate(Electron.Phi, Muon.Phi), argLeptons);')
('leptonCharge', 'ROOT::VecOps::Take(ROOT::VecOps::Concatenate(Electron.Charge, Muon.Charge), argLeptons);')
('jetPhi', 'ROOT::VecOps::Take(Jet.Phi, argJets);')
('jetEta', 'ROOT::VecOps::Take(Jet.Eta, argJets);')
('jetMass', 'ROOT::VecOps::Take(Jet.Mass, argJets);')
('goodElectrons', 'electronPt > 15')
('goodMuons', 'muonPt > 15')
('goodLeptons', 'leptonPt > 15')
('nLeptons', 'Sum(goodElectrons) + Sum(goodMuons)')
('goodJets', 'jetPt >= 50')
('nJets', 'Sum(goodJets)')
('mll', 'ComputeInvariantMassLeptons(leptonPt[goodLeptons], leptonEta[goodLeptons], leptonPhi[goodLeptons], leptonMass[goodLeptons])')
('mjj', 'ComputeInvariantMass(jetPt[goodJets], jetEta[goodJets], jetPhi[goodJets], jetMass[goodJets])')
('dPhijj', 'ComputeDPhijj(jetPhi[goodJets])')
('dEtajj', 'jetPhi[goodJets].size() >= 2 ? std::fabs(jetEta[goodJets][0] - jetEta[goodJets][1]) : std::numeric_limits<float>::lowest()')
('pTj1', 'jetPt[goodJets].size() >= 2 ? jetPt[goodJets][0] : std::numeric_limits<double>::lowest();')
('pTj2', 'jetPt[goodJets].size() >= 2 ? jetPt[goodJets][1] : std::numeric_limits<double>::lowest();')
('pTj3', 'jetPt[goodJets].size() >= 3 ? jetPt[goodJets][2] : std::numeric_limits<double>::lowest();')
('pTl1', 'leptonPt[goodLeptons].size() >= 2 ? leptonPt[goodLeptons][0] : std::numeric_limits<double>::lowest();')
('pTl2', 'leptonPt[goodLeptons].size() >= 2 ? leptonPt[goodLeptons][1] : std::numeric_limits<double>::lowest();')
('etal1', 'leptonEta[goodLeptons].size() >= 2 ? leptonEta[goodLeptons][0] : std::numeric_limits<double>::lowest();')
('etal2', 'leptonEta[goodLeptons].size() >= 2 ? leptonEta[goodLeptons][1] : std::numeric_limits<double>::lowest();')
('ptrel', '(pTl1*pTl2)/(pTj1*pTj2)')
('dRj1l1', 'ComputeDRjl(jetPhi[goodJets], jetEta[goodJets], leptonPhi[goodLeptons], leptonEta[goodLeptons], 0, 0)')
('dRj2l2', 'ComputeDRjl(jetPhi[goodJets], jetEta[goodJets], leptonPhi[goodLeptons], leptonEta[goodLeptons], 1, 1)')
('dRjj', 'ComputeDRjj(jetPhi[goodJets], jetEta[goodJets])')
('W4vec', 'ComputeWZMass(0,nLeptons,Sum(goodElectrons), Sum(goodMuons),leptonPt[goodLeptons], leptonEta[goodLeptons], leptonPhi[goodLeptons], leptonMass[goodLeptons], MissingET.MET[0], MissingET.Phi[0])')
('Z4vec', 'ComputeWZMass(1, nLeptons,Sum(goodElectrons), Sum(goodMuons),leptonPt[goodLeptons], leptonEta[goodLeptons], leptonPhi[goodLeptons], leptonMass[goodLeptons], MissingET.MET[0], MissingET.Phi[0])')
('WZmass', '(W4vec + Z4vec).M()')
('Wmass', 'W4vec.M()')
('Zmass', 'Z4vec.M()')
(('mll', 'Mll', 50, 0, 5000.0), 'mll')
(('mjj', 'Mjj', 10, 0, 10000.0), 'mjj')
 *** Break *** segmentation violation



===========================================================
There was a crash.
This is the entire stack trace of all threads:
===========================================================

Thread 15 (Thread 0x7fa9fae92640 (LWP 1702096) "python"):
#0  0x00007faa2348679a in __futex_abstimed_wait_common () from /lib64/libc.so.6
#1  0x00007faa23491c48 in __new_sem_wait_slow64.constprop.0 () from /lib64/libc.so.6
#2  0x00007faa019a26b6 in XrdSysSemaphore::Wait (this=0xcb350a0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysPthread.hh:509
#3  XrdCl::SyncQueue<XrdCl::JobManager::JobHelper>::Get (this=0xcb30648) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdCl/XrdClSyncQueue.hh:66
#4  XrdCl::JobManager::RunJobs (this=0xcb30630) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdCl/XrdClJobManager.cc:151
#5  0x00007faa019a2759 in RunRunnerThread (arg=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdCl/XrdClJobManager.cc:34
#6  0x00007faa23489c02 in start_thread () from /lib64/libc.so.6
#7  0x00007faa2350ec40 in clone3 () from /lib64/libc.so.6

Thread 14 (Thread 0x7fa9fb693640 (LWP 1702095) "python"):
#0  0x00007faa2348679a in __futex_abstimed_wait_common () from /lib64/libc.so.6
#1  0x00007faa23491c48 in __new_sem_wait_slow64.constprop.0 () from /lib64/libc.so.6
#2  0x00007faa019a26b6 in XrdSysSemaphore::Wait (this=0xcb350a0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysPthread.hh:509
#3  XrdCl::SyncQueue<XrdCl::JobManager::JobHelper>::Get (this=0xcb30648) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdCl/XrdClSyncQueue.hh:66
#4  XrdCl::JobManager::RunJobs (this=0xcb30630) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdCl/XrdClJobManager.cc:151
#5  0x00007faa019a2759 in RunRunnerThread (arg=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdCl/XrdClJobManager.cc:34
#6  0x00007faa23489c02 in start_thread () from /lib64/libc.so.6
#7  0x00007faa2350ec40 in clone3 () from /lib64/libc.so.6

Thread 13 (Thread 0x7fa9fbe94640 (LWP 1702094) "python"):
#0  0x00007faa2348679a in __futex_abstimed_wait_common () from /lib64/libc.so.6
#1  0x00007faa23491c48 in __new_sem_wait_slow64.constprop.0 () from /lib64/libc.so.6
#2  0x00007faa019a26b6 in XrdSysSemaphore::Wait (this=0xcb350a0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysPthread.hh:509
#3  XrdCl::SyncQueue<XrdCl::JobManager::JobHelper>::Get (this=0xcb30648) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdCl/XrdClSyncQueue.hh:66
#4  XrdCl::JobManager::RunJobs (this=0xcb30630) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdCl/XrdClJobManager.cc:151
#5  0x00007faa019a2759 in RunRunnerThread (arg=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdCl/XrdClJobManager.cc:34
#6  0x00007faa23489c02 in start_thread () from /lib64/libc.so.6
#7  0x00007faa2350ec40 in clone3 () from /lib64/libc.so.6

Thread 12 (Thread 0x7fa9fc695640 (LWP 1702093) "python"):
#0  0x00007faa234d4075 in clock_nanosleep
GLIBC_2.2.5 () from /lib64/libc.so.6
#1  0x00007faa234d8c87 in nanosleep () from /lib64/libc.so.6
#2  0x00007faa01b15f18 in XrdSysTimer::Wait (mills=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysTimer.cc:239
#3  0x00007faa01921820 in XrdCl::TaskManager::RunTasks (this=0x499f3c0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdCl/XrdClTaskManager.cc:246
#4  0x00007faa01921909 in RunRunnerThread (arg=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdCl/XrdClTaskManager.cc:38
#5  0x00007faa23489c02 in start_thread () from /lib64/libc.so.6
#6  0x00007faa2350ec40 in clone3 () from /lib64/libc.so.6

Thread 11 (Thread 0x7fa9fce96640 (LWP 1702092) "python"):
#0  0x00007faa2350e21e in epoll_wait () from /lib64/libc.so.6
#1  0x00007faa01b105f2 in XrdSys::IOEvents::PollE::Begin (this=0xcbb3030, syncsem=<optimized out>, retcode=<optimized out>, eTxt=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEventsPollE.icc:212
#2  0x00007faa01b0d03d in XrdSys::IOEvents::BootStrap::Start (parg=0x7fff83ead4c0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEvents.cc:149
#3  0x00007faa01b15618 in XrdSysThread_Xeq (myargs=0xcb35bb0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysPthread.cc:86
#4  0x00007faa23489c02 in start_thread () from /lib64/libc.so.6
#5  0x00007faa2350ec40 in clone3 () from /lib64/libc.so.6

Thread 10 (Thread 0x7fa9fd697640 (LWP 1702091) "python"):
#0  0x00007faa2350e21e in epoll_wait () from /lib64/libc.so.6
#1  0x00007faa01b105f2 in XrdSys::IOEvents::PollE::Begin (this=0xcbb2e30, syncsem=<optimized out>, retcode=<optimized out>, eTxt=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEventsPollE.icc:212
#2  0x00007faa01b0d03d in XrdSys::IOEvents::BootStrap::Start (parg=0x7fff83ead4c0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEvents.cc:149
#3  0x00007faa01b15618 in XrdSysThread_Xeq (myargs=0x492f200) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysPthread.cc:86
#4  0x00007faa23489c02 in start_thread () from /lib64/libc.so.6
#5  0x00007faa2350ec40 in clone3 () from /lib64/libc.so.6

Thread 9 (Thread 0x7fa9fde98640 (LWP 1702090) "python"):
#0  0x00007faa2350e21e in epoll_wait () from /lib64/libc.so.6
#1  0x00007faa01b105f2 in XrdSys::IOEvents::PollE::Begin (this=0xcb46b20, syncsem=<optimized out>, retcode=<optimized out>, eTxt=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEventsPollE.icc:212
#2  0x00007faa01b0d03d in XrdSys::IOEvents::BootStrap::Start (parg=0x7fff83ead4c0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEvents.cc:149
#3  0x00007faa01b15618 in XrdSysThread_Xeq (myargs=0xcb19d60) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysPthread.cc:86
#4  0x00007faa23489c02 in start_thread () from /lib64/libc.so.6
#5  0x00007faa2350ec40 in clone3 () from /lib64/libc.so.6

Thread 8 (Thread 0x7fa9fe699640 (LWP 1702089) "python"):
#0  0x00007faa2350e21e in epoll_wait () from /lib64/libc.so.6
#1  0x00007faa01b105f2 in XrdSys::IOEvents::PollE::Begin (this=0xcb86820, syncsem=<optimized out>, retcode=<optimized out>, eTxt=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEventsPollE.icc:212
#2  0x00007faa01b0d03d in XrdSys::IOEvents::BootStrap::Start (parg=0x7fff83ead4c0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEvents.cc:149
#3  0x00007faa01b15618 in XrdSysThread_Xeq (myargs=0xcb419b0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysPthread.cc:86
#4  0x00007faa23489c02 in start_thread () from /lib64/libc.so.6
#5  0x00007faa2350ec40 in clone3 () from /lib64/libc.so.6

Thread 7 (Thread 0x7fa9fee9a640 (LWP 1702088) "python"):
#0  0x00007faa2350e21e in epoll_wait () from /lib64/libc.so.6
#1  0x00007faa01b105f2 in XrdSys::IOEvents::PollE::Begin (this=0xcb35660, syncsem=<optimized out>, retcode=<optimized out>, eTxt=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEventsPollE.icc:212
#2  0x00007faa01b0d03d in XrdSys::IOEvents::BootStrap::Start (parg=0x7fff83ead4c0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEvents.cc:149
#3  0x00007faa01b15618 in XrdSysThread_Xeq (myargs=0xcb48420) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysPthread.cc:86
#4  0x00007faa23489c02 in start_thread () from /lib64/libc.so.6
#5  0x00007faa2350ec40 in clone3 () from /lib64/libc.so.6

Thread 6 (Thread 0x7fa9ff69b640 (LWP 1702087) "python"):
#0  0x00007faa2350e21e in epoll_wait () from /lib64/libc.so.6
#1  0x00007faa01b105f2 in XrdSys::IOEvents::PollE::Begin (this=0xcbb1410, syncsem=<optimized out>, retcode=<optimized out>, eTxt=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEventsPollE.icc:212
#2  0x00007faa01b0d03d in XrdSys::IOEvents::BootStrap::Start (parg=0x7fff83ead4c0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEvents.cc:149
#3  0x00007faa01b15618 in XrdSysThread_Xeq (myargs=0xcb5d2a0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysPthread.cc:86
#4  0x00007faa23489c02 in start_thread () from /lib64/libc.so.6
#5  0x00007faa2350ec40 in clone3 () from /lib64/libc.so.6

Thread 5 (Thread 0x7fa9ffe9c640 (LWP 1702086) "python"):
#0  0x00007faa2350e21e in epoll_wait () from /lib64/libc.so.6
#1  0x00007faa01b105f2 in XrdSys::IOEvents::PollE::Begin (this=0x4915950, syncsem=<optimized out>, retcode=<optimized out>, eTxt=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEventsPollE.icc:212
#2  0x00007faa01b0d03d in XrdSys::IOEvents::BootStrap::Start (parg=0x7fff83ead4c0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEvents.cc:149
#3  0x00007faa01b15618 in XrdSysThread_Xeq (myargs=0xcacdc30) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysPthread.cc:86
#4  0x00007faa23489c02 in start_thread () from /lib64/libc.so.6
#5  0x00007faa2350ec40 in clone3 () from /lib64/libc.so.6

Thread 4 (Thread 0x7faa0069d640 (LWP 1702085) "python"):
#0  0x00007faa2350e21e in epoll_wait () from /lib64/libc.so.6
#1  0x00007faa01b105f2 in XrdSys::IOEvents::PollE::Begin (this=0xcb41fd0, syncsem=<optimized out>, retcode=<optimized out>, eTxt=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEventsPollE.icc:212
#2  0x00007faa01b0d03d in XrdSys::IOEvents::BootStrap::Start (parg=0x7fff83ead4c0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEvents.cc:149
#3  0x00007faa01b15618 in XrdSysThread_Xeq (myargs=0xcb92010) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysPthread.cc:86
#4  0x00007faa23489c02 in start_thread () from /lib64/libc.so.6
#5  0x00007faa2350ec40 in clone3 () from /lib64/libc.so.6

Thread 3 (Thread 0x7faa00e9e640 (LWP 1702084) "python"):
#0  0x00007faa2350e21e in epoll_wait () from /lib64/libc.so.6
#1  0x00007faa01b105f2 in XrdSys::IOEvents::PollE::Begin (this=0xcb5fc40, syncsem=<optimized out>, retcode=<optimized out>, eTxt=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEventsPollE.icc:212
#2  0x00007faa01b0d03d in XrdSys::IOEvents::BootStrap::Start (parg=0x7fff83ead4c0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEvents.cc:149
#3  0x00007faa01b15618 in XrdSysThread_Xeq (myargs=0xcb5ffa0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysPthread.cc:86
#4  0x00007faa23489c02 in start_thread () from /lib64/libc.so.6
#5  0x00007faa2350ec40 in clone3 () from /lib64/libc.so.6

Thread 2 (Thread 0x7faa0169f640 (LWP 1702083) "python"):
#0  0x00007faa2350e21e in epoll_wait () from /lib64/libc.so.6
#1  0x00007faa01b105f2 in XrdSys::IOEvents::PollE::Begin (this=0x49a0860, syncsem=<optimized out>, retcode=<optimized out>, eTxt=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEventsPollE.icc:212
#2  0x00007faa01b0d03d in XrdSys::IOEvents::BootStrap::Start (parg=0x7fff83ead4c0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEvents.cc:149
#3  0x00007faa01b15618 in XrdSysThread_Xeq (myargs=0xcb303c0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysPthread.cc:86
#4  0x00007faa23489c02 in start_thread () from /lib64/libc.so.6
#5  0x00007faa2350ec40 in clone3 () from /lib64/libc.so.6

Thread 1 (Thread 0x7faa23bdb740 (LWP 1701143) "python"):
#0  0x00007faa234d8a3f in wait4 () from /lib64/libc.so.6
#1  0x00007faa2344b243 in do_system () from /lib64/libc.so.6
#2  0x00007faa22efb47c in TUnixSystem::StackTrace() () from /cvmfs/sft.cern.ch/lcg/views/LCG_105/x86_64-el9-gcc11-opt/lib/libCore.so
#3  0x00007faa231d80e3 in (anonymous namespace)::TExceptionHandlerImp::HandleException(int) () from /cvmfs/sft.cern.ch/lcg/views/LCG_105/x86_64-el9-gcc11-opt/lib/libcppyy_backend3_9.so
#4  0x00007faa22ef8a11 in TUnixSystem::DispatchSignals(ESignals) () from /cvmfs/sft.cern.ch/lcg/views/LCG_105/x86_64-el9-gcc11-opt/lib/libCore.so
#5  <signal handler called>
#6  0x00007faa13f091e9 in ?? ()
#7  0x00007fff83ead590 in ?? ()
#8  0x00007faa0c1b8220 in ?? ()
#9  0x00007fff83ead5b0 in ?? ()
#10 0x00007faa0c1b9e58 in ?? ()
#11 0x0000000000000008 in ?? ()
#12 0x00007fff83ead620 in ?? ()
#13 0x00007fff83ead610 in ?? ()
#14 0x00007faa0c1b9d93 in ?? ()
#15 0x0000000000000008 in ?? ()
#16 0x00007faa0c1b9e40 in ?? ()
#17 0x00007faa0c1b9dd0 in ?? ()
#18 0x0000000000000002 in ?? ()
#19 0x00007fff83eada78 in ?? ()
#20 0x00007fff83eada58 in ?? ()
#21 0x00007fff83ead620 in ?? ()
#22 0x00007fff83eada78 in ?? ()
#23 0x0000000000000001 in ?? ()
#24 0x00007fff83eada74 in ?? ()
#25 0x00007fff83ead650 in ?? ()
#26 0x00007faa0c1b9ce6 in ?? ()
#27 0x0000000000000000 in ?? ()
===========================================================


The lines below might hint at the cause of the crash. If you see question
marks as part of the stack trace, try to recompile with debugging information
enabled and export CLING_DEBUG=1 environment variable before running.
You may get help by asking at the ROOT forum https://root.cern/forum
preferably using the command (.forum bug) in the ROOT prompt.
Only if you are really convinced it is a bug in ROOT then please submit a
report at https://root.cern/bugs or (preferably) using the command (.gh bug) in
the ROOT prompt. Please post the ENTIRE stack trace
from above as an attachment in addition to anything else
that might help us fixing this issue.
===========================================================
#6  0x00007faa13f091e9 in ?? ()
#7  0x00007fff83ead590 in ?? ()
#8  0x00007faa0c1b8220 in ?? ()
#9  0x00007fff83ead5b0 in ?? ()
#10 0x00007faa0c1b9e58 in ?? ()
#11 0x0000000000000008 in ?? ()
#12 0x00007fff83ead620 in ?? ()
#13 0x00007fff83ead610 in ?? ()
#14 0x00007faa0c1b9d93 in ?? ()
#15 0x0000000000000008 in ?? ()
#16 0x00007faa0c1b9e40 in ?? ()
#17 0x00007faa0c1b9dd0 in ?? ()
#18 0x0000000000000002 in ?? ()
#19 0x00007fff83eada78 in ?? ()
#20 0x00007fff83eada58 in ?? ()
#21 0x00007fff83ead620 in ?? ()
#22 0x00007fff83eada78 in ?? ()
#23 0x0000000000000001 in ?? ()
#24 0x00007fff83eada74 in ?? ()
#25 0x00007fff83ead650 in ?? ()
#26 0x00007faa0c1b9ce6 in ?? ()
#27 0x0000000000000000 in ?? ()
===========================================================

William_Sorger · June 10, 2024, 2:17pm

pt 2 of error

 *** Break *** segmentation violation



===========================================================
There was a crash.
This is the entire stack trace of all threads:
===========================================================

Thread 15 (Thread 0x7fa9fae92640 (LWP 1702096) "python"):
#0  0x00007faa2348679a in __futex_abstimed_wait_common () from /lib64/libc.so.6
#1  0x00007faa23491c48 in __new_sem_wait_slow64.constprop.0 () from /lib64/libc.so.6
#2  0x00007faa019a26b6 in XrdSysSemaphore::Wait (this=0xcb350a0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysPthread.hh:509
#3  XrdCl::SyncQueue<XrdCl::JobManager::JobHelper>::Get (this=0xcb30648) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdCl/XrdClSyncQueue.hh:66
#4  XrdCl::JobManager::RunJobs (this=0xcb30630) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdCl/XrdClJobManager.cc:151
#5  0x00007faa019a2759 in RunRunnerThread (arg=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdCl/XrdClJobManager.cc:34
#6  0x00007faa23489c02 in start_thread () from /lib64/libc.so.6
#7  0x00007faa2350ec40 in clone3 () from /lib64/libc.so.6

Thread 14 (Thread 0x7fa9fb693640 (LWP 1702095) "python"):
#0  0x00007faa2348679a in __futex_abstimed_wait_common () from /lib64/libc.so.6
#1  0x00007faa23491c48 in __new_sem_wait_slow64.constprop.0 () from /lib64/libc.so.6
#2  0x00007faa019a26b6 in XrdSysSemaphore::Wait (this=0xcb350a0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysPthread.hh:509
#3  XrdCl::SyncQueue<XrdCl::JobManager::JobHelper>::Get (this=0xcb30648) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdCl/XrdClSyncQueue.hh:66
#4  XrdCl::JobManager::RunJobs (this=0xcb30630) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdCl/XrdClJobManager.cc:151
#5  0x00007faa019a2759 in RunRunnerThread (arg=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdCl/XrdClJobManager.cc:34
#6  0x00007faa23489c02 in start_thread () from /lib64/libc.so.6
#7  0x00007faa2350ec40 in clone3 () from /lib64/libc.so.6

Thread 13 (Thread 0x7fa9fbe94640 (LWP 1702094) "python"):
#0  0x00007faa2348679a in __futex_abstimed_wait_common () from /lib64/libc.so.6
#1  0x00007faa23491c48 in __new_sem_wait_slow64.constprop.0 () from /lib64/libc.so.6
#2  0x00007faa019a26b6 in XrdSysSemaphore::Wait (this=0xcb350a0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysPthread.hh:509
#3  XrdCl::SyncQueue<XrdCl::JobManager::JobHelper>::Get (this=0xcb30648) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdCl/XrdClSyncQueue.hh:66
#4  XrdCl::JobManager::RunJobs (this=0xcb30630) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdCl/XrdClJobManager.cc:151
#5  0x00007faa019a2759 in RunRunnerThread (arg=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdCl/XrdClJobManager.cc:34
#6  0x00007faa23489c02 in start_thread () from /lib64/libc.so.6
#7  0x00007faa2350ec40 in clone3 () from /lib64/libc.so.6

Thread 12 (Thread 0x7fa9fc695640 (LWP 1702093) "python"):
#0  0x00007faa234d4075 in clock_nanosleep
GLIBC_2.2.5 () from /lib64/libc.so.6
#1  0x00007faa234d8c87 in nanosleep () from /lib64/libc.so.6
#2  0x00007faa01b15f18 in XrdSysTimer::Wait (mills=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysTimer.cc:239
#3  0x00007faa01921820 in XrdCl::TaskManager::RunTasks (this=0x499f3c0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdCl/XrdClTaskManager.cc:246
#4  0x00007faa01921909 in RunRunnerThread (arg=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdCl/XrdClTaskManager.cc:38
#5  0x00007faa23489c02 in start_thread () from /lib64/libc.so.6
#6  0x00007faa2350ec40 in clone3 () from /lib64/libc.so.6

Thread 11 (Thread 0x7fa9fce96640 (LWP 1702092) "python"):
#0  0x00007faa2350e21e in epoll_wait () from /lib64/libc.so.6
#1  0x00007faa01b105f2 in XrdSys::IOEvents::PollE::Begin (this=0xcbb3030, syncsem=<optimized out>, retcode=<optimized out>, eTxt=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEventsPollE.icc:212
#2  0x00007faa01b0d03d in XrdSys::IOEvents::BootStrap::Start (parg=0x7fff83ead4c0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEvents.cc:149
#3  0x00007faa01b15618 in XrdSysThread_Xeq (myargs=0xcb35bb0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysPthread.cc:86
#4  0x00007faa23489c02 in start_thread () from /lib64/libc.so.6
#5  0x00007faa2350ec40 in clone3 () from /lib64/libc.so.6

Thread 10 (Thread 0x7fa9fd697640 (LWP 1702091) "python"):
#0  0x00007faa2350e21e in epoll_wait () from /lib64/libc.so.6
#1  0x00007faa01b105f2 in XrdSys::IOEvents::PollE::Begin (this=0xcbb2e30, syncsem=<optimized out>, retcode=<optimized out>, eTxt=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEventsPollE.icc:212
#2  0x00007faa01b0d03d in XrdSys::IOEvents::BootStrap::Start (parg=0x7fff83ead4c0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEvents.cc:149
#3  0x00007faa01b15618 in XrdSysThread_Xeq (myargs=0x492f200) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysPthread.cc:86
#4  0x00007faa23489c02 in start_thread () from /lib64/libc.so.6
#5  0x00007faa2350ec40 in clone3 () from /lib64/libc.so.6

Thread 9 (Thread 0x7fa9fde98640 (LWP 1702090) "python"):
#0  0x00007faa2350e21e in epoll_wait () from /lib64/libc.so.6
#1  0x00007faa01b105f2 in XrdSys::IOEvents::PollE::Begin (this=0xcb46b20, syncsem=<optimized out>, retcode=<optimized out>, eTxt=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEventsPollE.icc:212
#2  0x00007faa01b0d03d in XrdSys::IOEvents::BootStrap::Start (parg=0x7fff83ead4c0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEvents.cc:149
#3  0x00007faa01b15618 in XrdSysThread_Xeq (myargs=0xcb19d60) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysPthread.cc:86
#4  0x00007faa23489c02 in start_thread () from /lib64/libc.so.6
#5  0x00007faa2350ec40 in clone3 () from /lib64/libc.so.6

Thread 8 (Thread 0x7fa9fe699640 (LWP 1702089) "python"):
#0  0x00007faa2350e21e in epoll_wait () from /lib64/libc.so.6
#1  0x00007faa01b105f2 in XrdSys::IOEvents::PollE::Begin (this=0xcb86820, syncsem=<optimized out>, retcode=<optimized out>, eTxt=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEventsPollE.icc:212
#2  0x00007faa01b0d03d in XrdSys::IOEvents::BootStrap::Start (parg=0x7fff83ead4c0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEvents.cc:149
#3  0x00007faa01b15618 in XrdSysThread_Xeq (myargs=0xcb419b0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysPthread.cc:86
#4  0x00007faa23489c02 in start_thread () from /lib64/libc.so.6
#5  0x00007faa2350ec40 in clone3 () from /lib64/libc.so.6

Thread 7 (Thread 0x7fa9fee9a640 (LWP 1702088) "python"):
#0  0x00007faa2350e21e in epoll_wait () from /lib64/libc.so.6
#1  0x00007faa01b105f2 in XrdSys::IOEvents::PollE::Begin (this=0xcb35660, syncsem=<optimized out>, retcode=<optimized out>, eTxt=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEventsPollE.icc:212
#2  0x00007faa01b0d03d in XrdSys::IOEvents::BootStrap::Start (parg=0x7fff83ead4c0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEvents.cc:149
#3  0x00007faa01b15618 in XrdSysThread_Xeq (myargs=0xcb48420) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysPthread.cc:86
#4  0x00007faa23489c02 in start_thread () from /lib64/libc.so.6
#5  0x00007faa2350ec40 in clone3 () from /lib64/libc.so.6

Thread 6 (Thread 0x7fa9ff69b640 (LWP 1702087) "python"):
#0  0x00007faa2350e21e in epoll_wait () from /lib64/libc.so.6
#1  0x00007faa01b105f2 in XrdSys::IOEvents::PollE::Begin (this=0xcbb1410, syncsem=<optimized out>, retcode=<optimized out>, eTxt=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEventsPollE.icc:212
#2  0x00007faa01b0d03d in XrdSys::IOEvents::BootStrap::Start (parg=0x7fff83ead4c0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEvents.cc:149
#3  0x00007faa01b15618 in XrdSysThread_Xeq (myargs=0xcb5d2a0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysPthread.cc:86
#4  0x00007faa23489c02 in start_thread () from /lib64/libc.so.6
#5  0x00007faa2350ec40 in clone3 () from /lib64/libc.so.6

Thread 5 (Thread 0x7fa9ffe9c640 (LWP 1702086) "python"):
#0  0x00007faa2350e21e in epoll_wait () from /lib64/libc.so.6
#1  0x00007faa01b105f2 in XrdSys::IOEvents::PollE::Begin (this=0x4915950, syncsem=<optimized out>, retcode=<optimized out>, eTxt=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEventsPollE.icc:212
#2  0x00007faa01b0d03d in XrdSys::IOEvents::BootStrap::Start (parg=0x7fff83ead4c0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEvents.cc:149
#3  0x00007faa01b15618 in XrdSysThread_Xeq (myargs=0xcacdc30) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysPthread.cc:86
#4  0x00007faa23489c02 in start_thread () from /lib64/libc.so.6
#5  0x00007faa2350ec40 in clone3 () from /lib64/libc.so.6

Thread 4 (Thread 0x7faa0069d640 (LWP 1702085) "python"):
#0  0x00007faa2350e21e in epoll_wait () from /lib64/libc.so.6
#1  0x00007faa01b105f2 in XrdSys::IOEvents::PollE::Begin (this=0xcb41fd0, syncsem=<optimized out>, retcode=<optimized out>, eTxt=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEventsPollE.icc:212
#2  0x00007faa01b0d03d in XrdSys::IOEvents::BootStrap::Start (parg=0x7fff83ead4c0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEvents.cc:149
#3  0x00007faa01b15618 in XrdSysThread_Xeq (myargs=0xcb92010) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysPthread.cc:86
#4  0x00007faa23489c02 in start_thread () from /lib64/libc.so.6
#5  0x00007faa2350ec40 in clone3 () from /lib64/libc.so.6

Thread 3 (Thread 0x7faa00e9e640 (LWP 1702084) "python"):
#0  0x00007faa2350e21e in epoll_wait () from /lib64/libc.so.6
#1  0x00007faa01b105f2 in XrdSys::IOEvents::PollE::Begin (this=0xcb5fc40, syncsem=<optimized out>, retcode=<optimized out>, eTxt=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEventsPollE.icc:212
#2  0x00007faa01b0d03d in XrdSys::IOEvents::BootStrap::Start (parg=0x7fff83ead4c0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEvents.cc:149
#3  0x00007faa01b15618 in XrdSysThread_Xeq (myargs=0xcb5ffa0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysPthread.cc:86
#4  0x00007faa23489c02 in start_thread () from /lib64/libc.so.6
#5  0x00007faa2350ec40 in clone3 () from /lib64/libc.so.6

Thread 2 (Thread 0x7faa0169f640 (LWP 1702083) "python"):
#0  0x00007faa2350e21e in epoll_wait () from /lib64/libc.so.6
#1  0x00007faa01b105f2 in XrdSys::IOEvents::PollE::Begin (this=0x49a0860, syncsem=<optimized out>, retcode=<optimized out>, eTxt=<optimized out>) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEventsPollE.icc:212
#2  0x00007faa01b0d03d in XrdSys::IOEvents::BootStrap::Start (parg=0x7fff83ead4c0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysIOEvents.cc:149
#3  0x00007faa01b15618 in XrdSysThread_Xeq (myargs=0xcb303c0) at /build/jenkins/workspace/lcg_release_pipeline/build/externals/xrootd-5.6.3/src/xrootd/5.6.3/src/XrdSys/XrdSysPthread.cc:86
#4  0x00007faa23489c02 in start_thread () from /lib64/libc.so.6
#5  0x00007faa2350ec40 in clone3 () from /lib64/libc.so.6

Thread 1 (Thread 0x7faa23bdb740 (LWP 1701143) "python"):
#0  0x00007faa234d8a3f in wait4 () from /lib64/libc.so.6
#1  0x00007faa2344b243 in do_system () from /lib64/libc.so.6
#2  0x00007faa22efb47c in TUnixSystem::StackTrace() () from /cvmfs/sft.cern.ch/lcg/views/LCG_105/x86_64-el9-gcc11-opt/lib/libCore.so
#3  0x00007faa231d7f63 in (anonymous namespace)::TExceptionHandlerImp::HandleException(int) () from /cvmfs/sft.cern.ch/lcg/views/LCG_105/x86_64-el9-gcc11-opt/lib/libcppyy_backend3_9.so
#4  0x00007faa22ef8a11 in TUnixSystem::DispatchSignals(ESignals) () from /cvmfs/sft.cern.ch/lcg/views/LCG_105/x86_64-el9-gcc11-opt/lib/libCore.so
#5  <signal handler called>
#6  0x00007faa13f091e9 in ?? ()
#7  0x00007fff83ead590 in ?? ()
#8  0x00007faa0c1b8220 in ?? ()
#9  0x00007fff83ead5b0 in ?? ()
#10 0x00007faa0c1b9e58 in ?? ()
#11 0x0000000000000008 in ?? ()
#12 0x00007fff83ead620 in ?? ()
#13 0x00007fff83ead610 in ?? ()
#14 0x00007faa0c1b9d93 in ?? ()
#15 0x0000000000000008 in ?? ()
#16 0x00007faa0c1b9e40 in ?? ()
#17 0x00007faa0c1b9dd0 in ?? ()
#18 0x0000000000000002 in ?? ()
#19 0x00007fff83eada78 in ?? ()
#20 0x00007fff83eada58 in ?? ()
#21 0x00007fff83ead620 in ?? ()
#22 0x00007fff83eada78 in ?? ()
#23 0x0000000000000001 in ?? ()
#24 0x00007fff83eada74 in ?? ()
#25 0x00007fff83ead650 in ?? ()
#26 0x00007faa0c1b9ce6 in ?? ()
#27 0x0000000000000000 in ?? ()
===========================================================


The lines below might hint at the cause of the crash. If you see question
marks as part of the stack trace, try to recompile with debugging information
enabled and export CLING_DEBUG=1 environment variable before running.
You may get help by asking at the ROOT forum https://root.cern/forum
preferably using the command (.forum bug) in the ROOT prompt.
Only if you are really convinced it is a bug in ROOT then please submit a
report at https://root.cern/bugs or (preferably) using the command (.gh bug) in
the ROOT prompt. Please post the ENTIRE stack trace
from above as an attachment in addition to anything else
that might help us fixing this issue.
===========================================================
#6  0x00007faa13f091e9 in ?? ()
#7  0x00007fff83ead590 in ?? ()
#8  0x00007faa0c1b8220 in ?? ()
#9  0x00007fff83ead5b0 in ?? ()
#10 0x00007faa0c1b9e58 in ?? ()
#11 0x0000000000000008 in ?? ()
#12 0x00007fff83ead620 in ?? ()
#13 0x00007fff83ead610 in ?? ()
#14 0x00007faa0c1b9d93 in ?? ()
#15 0x0000000000000008 in ?? ()
#16 0x00007faa0c1b9e40 in ?? ()
#17 0x00007faa0c1b9dd0 in ?? ()
#18 0x0000000000000002 in ?? ()
#19 0x00007fff83eada78 in ?? ()
#20 0x00007fff83eada58 in ?? ()
#21 0x00007fff83ead620 in ?? ()
#22 0x00007fff83eada78 in ?? ()
#23 0x0000000000000001 in ?? ()
#24 0x00007fff83eada74 in ?? ()
#25 0x00007fff83ead650 in ?? ()
#26 0x00007faa0c1b9ce6 in ?? ()
#27 0x0000000000000000 in ?? ()
===========================================================

William_Sorger · June 10, 2024, 5:32pm

The error seems to originate from this snippet of code histo = rd.Histo2D(*h) histo.Scale( cross_section[sampleName] / tot_events * lumi ) the inside currently is just a float of 0.001 so it is essentially histo.Scale(0.001). I still don’t know what is causing the error.

couet · June 11, 2024, 7:10am

Welcome to the ROOT forum !

Can you post an example reproducing you problem ? a ROOT macro …

William_Sorger · June 18, 2024, 3:41pm

The Code is on CERNBOX at https://cernbox.cern.ch/s/gjqSlO77d3xzdWP, I am unable to add a link and the compressed file is too big, so this is my substitute. All you need to do to get the error is download all contents of link into the same folder, and run test_ana.py. Thank you very much for your patience!

couet · June 19, 2024, 5:55am

It seems to work for me on Mac with ROOT master. At least it doesn not crash. I get:

% python3 test_ana.py
Processing sample WZQuad at ./output_WZquad_Jet.root
TClass::Init:0: RuntimeWarning: no dictionary for class SortableObject is available
TClass::Init:0: RuntimeWarning: no dictionary for class Jet is available
TChain created with 10000 entries
('argJets', 'ROOT::VecOps::Reverse(ROOT::VecOps::Argsort(Jet.PT));')
('jetPt', ' ROOT::VecOps::Take(Jet.PT, argJets);')
('jetPhi', 'ROOT::VecOps::Take(Jet.Phi, argJets);')
('jetEta', 'ROOT::VecOps::Take(Jet.Eta, argJets);')
('jetMass', 'ROOT::VecOps::Take(Jet.Mass, argJets);')
('goodJets', 'jetPt >= 50')
('nJets', 'Sum(goodJets)')
('mjj', 'ComputeInvariantMass(jetPt[goodJets], jetEta[goodJets], jetPhi[goodJets], jetMass[goodJets])')
(('mjj', 'Mjj', 10, 0, 10000.0), 'mjj')
('nJets >= 2', 'LeptonCut')
(('mjj', 'Mjj', 10, 0, 10000.0), 'mjj')
LeptonCut : pass=7969       all=10000      -- eff=79.69 % cumulative eff=79.69 %
Processing sample SMWZqcd at ./output_SMWZqcd_Jet.root
TChain created with 10000 entries
('argJets', 'ROOT::VecOps::Reverse(ROOT::VecOps::Argsort(Jet.PT));')
('jetPt', ' ROOT::VecOps::Take(Jet.PT, argJets);')
('jetPhi', 'ROOT::VecOps::Take(Jet.Phi, argJets);')
('jetEta', 'ROOT::VecOps::Take(Jet.Eta, argJets);')
('jetMass', 'ROOT::VecOps::Take(Jet.Mass, argJets);')
('goodJets', 'jetPt >= 50')
('nJets', 'Sum(goodJets)')
('mjj', 'ComputeInvariantMass(jetPt[goodJets], jetEta[goodJets], jetPhi[goodJets], jetMass[goodJets])')
(('mjj', 'Mjj', 10, 0, 10000.0), 'mjj')
('nJets >= 2', 'LeptonCut')
(('mjj', 'Mjj', 10, 0, 10000.0), 'mjj')
LeptonCut : pass=6755       all=10000      -- eff=67.55 % cumulative eff=67.55 %
TFile**		output.root	
 TFile*		output.root	
  KEY: TH1D	Mjj_nofilter_WZQuad_all;1	Mjj
  KEY: TH1D	Mjj_LeptonCut_WZQuad_all;1	Mjj
  KEY: TH1D	Mjj_nofilter_SMWZqcd_all;1	Mjj
  KEY: TH1D	Mjj_LeptonCut_SMWZqcd_all;1	Mjj

William_Sorger · June 19, 2024, 12:07pm

Hmmm, I just double checked an when I run on lxplus I get the same crash as before. Could this be an lxplus runtime error, I don’t know what is different about the two environments? Thank you so much for your response!

also for reference I am using source /cvmfs/sft.cern.ch/lcg/views/LCG_105/x86_64-el9-gcc11-opt/setup.sh environment on lxplus

$ cd ./Root_Forum_Isolated_Code/
$ ls
output.root  output_SMWZqcd_Jet.root  output_WZquad_Jet.root  test_ana.py
$ python test_ana.py 
Processing sample WZQuad at ./output_WZquad_Jet.root
TClass::Init:0: RuntimeWarning: no dictionary for class SortableObject is available
TClass::Init:0: RuntimeWarning: no dictionary for class Jet is available
TChain created with 10000 entries
('argJets', 'ROOT::VecOps::Reverse(ROOT::VecOps::Argsort(Jet.PT));')
('jetPt', ' ROOT::VecOps::Take(Jet.PT, argJets);')
('jetPhi', 'ROOT::VecOps::Take(Jet.Phi, argJets);')
('jetEta', 'ROOT::VecOps::Take(Jet.Eta, argJets);')
('jetMass', 'ROOT::VecOps::Take(Jet.Mass, argJets);')
('goodJets', 'jetPt >= 50')
('nJets', 'Sum(goodJets)')
('mjj', 'ComputeInvariantMass(jetPt[goodJets], jetEta[goodJets], jetPhi[goodJets], jetMass[goodJets])')
(('mjj', 'Mjj', 10, 0, 10000.0), 'mjj')
('nJets >= 2', 'LeptonCut')
(('mjj', 'Mjj', 10, 0, 10000.0), 'mjj')
LeptonCut : pass=7969       all=10000      -- eff=79.69 % cumulative eff=79.69 %
Processing sample SMWZqcd at ./output_SMWZqcd_Jet.root
TChain created with 10000 entries
('argJets', 'ROOT::VecOps::Reverse(ROOT::VecOps::Argsort(Jet.PT));')
('jetPt', ' ROOT::VecOps::Take(Jet.PT, argJets);')
('jetPhi', 'ROOT::VecOps::Take(Jet.Phi, argJets);')
('jetEta', 'ROOT::VecOps::Take(Jet.Eta, argJets);')
('jetMass', 'ROOT::VecOps::Take(Jet.Mass, argJets);')
('goodJets', 'jetPt >= 50')
('nJets', 'Sum(goodJets)')
('mjj', 'ComputeInvariantMass(jetPt[goodJets], jetEta[goodJets], jetPhi[goodJets], jetMass[goodJets])')
(('mjj', 'Mjj', 10, 0, 10000.0), 'mjj')
 *** Break *** segmentation violation



===========================================================
There was a crash.
This is the entire stack trace of all threads:
===========================================================

Same Error after this

couet · June 19, 2024, 12:12pm

I am not sure it makes a difference but not I am using python3 and you are using python.

William_Sorger · June 19, 2024, 1:12pm

Still crashed with python3. Do you have a way of trying this on lxplus or some similar hardware? Or do you know difference sources I could get ROOT and Python from in lxplus?

dastudillo · June 19, 2024, 3:18pm

It also crashes for me, with python3 on ubuntu and ROOT 6.32.00

$  python3 test_ana.py
Processing sample WZQuad at ./output_WZquad_Jet.root
TClass::Init:0: RuntimeWarning: no dictionary for class SortableObject is available
TClass::Init:0: RuntimeWarning: no dictionary for class Jet is available
TChain created with 10000 entries
('argJets', 'ROOT::VecOps::Reverse(ROOT::VecOps::Argsort(Jet.PT));')
('jetPt', ' ROOT::VecOps::Take(Jet.PT, argJets);')
('jetPhi', 'ROOT::VecOps::Take(Jet.Phi, argJets);')
('jetEta', 'ROOT::VecOps::Take(Jet.Eta, argJets);')
('jetMass', 'ROOT::VecOps::Take(Jet.Mass, argJets);')
('goodJets', 'jetPt >= 50')
('nJets', 'Sum(goodJets)')
('mjj', 'ComputeInvariantMass(jetPt[goodJets], jetEta[goodJets], jetPhi[goodJets], jetMass[goodJets])')
(('mjj', 'Mjj', 10, 0, 10000.0), 'mjj')
 *** Break *** segmentation violation

William_Sorger · June 20, 2024, 1:36pm

Hmm… it shouldn’t crash for quad events, I get the crash at qcd events. This is an odd predicament, as the calculation fails at different points for different hardware.

William_Sorger · July 1, 2024, 1:42pm

I used gbd and bt to debug and back trace the code but I still get an incomprehensible error. There is a segmentation fault, but I don’t know why it is trying to access something that is restricted as all the data is read and write for my profile.

Thread 1 "python" received signal SIGSEGV, Segmentation fault.
0x00007fffe876c1e9 in ?? ()
(gdb) bt full
#0  0x00007fffe876c1e9 in ?? ()
No symbol table info available.
#1  0x00007fffffff8ac0 in ?? ()
No symbol table info available.
#2  0x00007fffe1d27220 in ?? ()
No symbol table info available.
#3  0x00007fffffff8ae0 in ?? ()
No symbol table info available.
#4  0x00007fffe1d28e58 in ?? ()
No symbol table info available.
#5  0x0000000000000008 in ?? ()
--Type <RET> for more, q to quit, c to continue without paging--c
No symbol table info available.
#6  0x00007fffffff8b50 in ?? ()
No symbol table info available.
#7  0x00007fffffff8b40 in ?? ()
No symbol table info available.
#8  0x00007fffe1d28d93 in ?? ()
No symbol table info available.
#9  0x0000000000000008 in ?? ()
No symbol table info available.
#10 0x00007fffe1d28e40 in ?? ()
No symbol table info available.
#11 0x00007fffe1d28dd0 in ?? ()
No symbol table info available.
#12 0x0000000000000002 in ?? ()
No symbol table info available.
#13 0x00007fffffff8fa8 in ?? ()
No symbol table info available.
#14 0x00007fffffff8f88 in ?? ()
No symbol table info available.
#15 0x00007fffffff8b50 in ?? ()
No symbol table info available.
#16 0x00007fffffff8fa8 in ?? ()
No symbol table info available.
#17 0x0000000000000001 in ?? ()
No symbol table info available.
#18 0x00007fffffff8fa4 in ?? ()
No symbol table info available.
#19 0x00007fffffff8b80 in ?? ()
No symbol table info available.
#20 0x00007fffe1d28ce6 in ?? ()
No symbol table info available.
#21 0x0000000000000000 in ?? ()
No symbol table info available.
(gdb)

jonas · July 10, 2024, 9:14am

Hi! Probably you already figured out by now, but this is the problem:

  TLorentzVector p[2];
  //This creates all the p vectors
  for(int i ; i < pt.size(); i++) {
    p[i].SetPtEtaPhiM(pt[i], eta[i], phi[i], m[i]);
  }

Your TLorentzVector needs to be the same size at pt:

  TLorentzVector p[pt.size()];

Note that I’m using there a variable-length array on the stack, which is not standard on C++ and not supported by all compilers. You can also use a std::vector<TLorentzVector> if the overhead of heap allocation is acceptable to you.

William_Sorger · July 17, 2024, 10:04pm

Thank you very much for you help! I was still stuck on the issue.