Hi all,
For the last few days I have been trying to produce some ntuples for my analysis, using miniAOD files located here: root://cms-xrd-global.cern.ch//store/mc/RunIIFall17MiniAOD/…
When I run my configuration file interactively everything works smoothly and I get the expected ntuples. However, when I am submitting my jobs at the batch system of lxplus my jobs exit unsuccessfully with the following message in the STDOUT file:
==== running ====
Reading phedex query from cache: 846 samples, 0.6 hours old
Error in <TNetXNGFile::Open>: [FATAL] Redirect limit has been reached
loading FWLite.
Using analysis type: SOS
Component | N(files) N(k ev) | N(jobs) | file/job k ev/job | lumi eq [1/fb]
------------------------------------------------------- | -------- ------------ | ------- | -------- ----------- | -----------
DYJetsToLL_M50 | 372 26923.935 | 2 | 186.00 13461.000 | 2.159
------------------------------------------------------- | -------- ------------ | ------- | -------- ----------- | -----------
TOTAL | 372 26923.935 | 2 | 186.00 13461.967 |
Dataset /DYJetsToLL_M-50_TuneCP5_13TeV-amcatnloFXFX-pythia8/RunIIFall17MiniAOD-94X_mc2017_realistic_v10-v1/MINIAODSIM is not available, will use AAA
Found it
Component | N(files) N(k ev) | N(jobs) | file/job k ev/job | lumi eq [1/fb]
------------------------------------------------------- | -------- ------------ | ------- | -------- ----------- | -----------
DYJetsToLL_M50 | 372 26923.935 | 2 | 186.00 13461.000 | 2.159
------------------------------------------------------- | -------- ------------ | ------- | -------- ----------- | -----------
TOTAL | 372 26923.935 | 2 | 186.00 13461.967 |
Loading FW Lite
[QGLikelihoodCalculator]: Initializing from file: /afs/cern.ch/work/i/ipapaver/SOS_lepton_2017/11_2/CMSSW_9_4_11/src/PhysicsTools/Heppy/data/pdfQG_AK4chs_13TeV_cmssw8020_v2.root
[QGLikelihoodCalculator]: Initialized binning of pdfs...
[QGLikelihoodCalculator]: pdfs initialized...
[QGLikelihoodCalculator]: Initializing from file: /afs/cern.ch/work/i/ipapaver/SOS_lepton_2017/11_2/CMSSW_9_4_11/src/PhysicsTools/Heppy/data/pdfQG_AK4chs_13TeV_cmssw8020_v2.root
[QGLikelihoodCalculator]: Initialized binning of pdfs...
[QGLikelihoodCalculator]: pdfs initialized...
[QGLikelihoodCalculator]: Initializing from file: /afs/cern.ch/work/i/ipapaver/SOS_lepton_2017/11_2/CMSSW_9_4_11/src/PhysicsTools/Heppy/data/pdfQG_AK4chs_13TeV_cmssw8020_v2.root
[QGLikelihoodCalculator]: Initialized binning of pdfs...
[QGLikelihoodCalculator]: pdfs initialized...
Cannot save prescale information in MC: will put everything to unprescaled
Aggressive prefetching level 2
Failed the big query: ['edmFileUtil', '--ls', '-j', 'root://cms-xrd-global.cern.ch//store/mc/RunIIFall17MiniAOD/..........
Try url: root://cmsxrootd.fnal.gov//store/mc/RunIIFall17MiniAOD/DYJetsToLL_M-50_TuneCP5_13TeV-amcatnloFXFX-pythia8/MINIAODSIM/94X_mc2017_realistic_v10-v1Error in <TNetXNGFile::Open>: [FATAL] Redirect limit has been reached
Error in <TNetXNGFile::Open>: [FATAL] Redirect limit has been reached
Error in <TNetXNGFile::Open>: [ERROR] Server responded with an error: [3011] Unable to open file /eos/cms/store/mc/RunIIFall17MiniAOD/DYJetsToLL_M-50_TuneCP5_13TeV-amcatnloFXFX-pythia8/MINIAODSIM/94X_mc2017_realistic_v10-v1/50000/7642F20E-30DC-E711-9548-0025905A60B8.root; No such file or directory
/50000/7642F20E-30DC-E711-9548-0025905A60B8.root
and then it crashes.
I am ssh-ed to an lxplus machine (connected from Greece) and using python 6.10/09 in CMSSW_9_4_11.
I would really appreciate any help or insight on how to overcome this error and continue the tuple production on the batch system.
Also, it is not very clear to me why I do not get the same error message when I run interactively.
Thanks a lot in advance,
Ioanna