Hi,
I’m using 5.27/04 on the server. I send accross about 10 or 15 files to be compiled using ACLIC. Once in a while (but not always, and I can’t reproduce it reliably) the PROOF session totally hangs.
Here is the log from my console:
Compiling on proof BasicPlotPlugins/JetKinematicPlots.cpp
Info in <ACLiC>: unmodified script has already been compiled and loaded
15:49:11 17574 Mst-0 | Info in <TXProofServ::HandleCache>: loading macro JetKine
maticPlots.cpp+ ...
15:49:11 17574 Mst-0 | Info in <TUnixSystem::ACLiC>: creating shared library /ph
ys/users/gwatts/.proof/session-tev2-1284936494-17574/master-0-tev2-1284936494-17
574/./JetKinematicPlots_cpp.so
15:49:14 17588 Wrk-0.0 | Info in <TXProofServ::HandleCache>: loading macro JetKi
nematicPlots.cpp+ ...
15:49:14 17590 Wrk-0.1 | Info in <TXProofServ::HandleCache>: loading macro JetKi
nematicPlots.cpp+ ...
15:49:14 17594 Wrk-0.3 | Info in <TXProofServ::HandleCache>: loading macro JetKi
nematicPlots.cpp+ ...
15:49:14 17610 Wrk-0.15 | Info in <TXProofServ::HandleCache>: loading macro JetK
inematicPlots.cpp+ ...
15:49:14 17592 Wrk-0.2 | Info in <TXProofServ::HandleCache>: loading macro JetKi
nematicPlots.cpp+ ...
15:49:14 17604 Wrk-0.8 | Info in <TXProofServ::HandleCache>: loading macro JetKi
nematicPlots.cpp+ ...
15:49:14 17602 Wrk-0.7 | Info in <TXProofServ::HandleCache>: loading macro JetKi
nematicPlots.cpp+ ...
15:49:15 17598 Wrk-0.5 | Info in <TXProofServ::HandleCache>: loading macro JetKi
nematicPlots.cpp+ ...
15:49:15 17606 Wrk-0.9 | Info in <TXProofServ::HandleCache>: loading macro JetKi
nematicPlots.cpp+ ...
15:49:15 17584 Wrk-0.13 | Info in <TXProofServ::HandleCache>: loading macro JetK
inematicPlots.cpp+ ...
15:49:15 17586 Wrk-0.12 | Info in <TXProofServ::HandleCache>: loading macro JetK
inematicPlots.cpp+ ...
15:49:15 17612 Wrk-0.10 | Info in <TXProofServ::HandleCache>: loading macro JetK
inematicPlots.cpp+ ...
15:49:15 17596 Wrk-0.4 | Info in <TXProofServ::HandleCache>: loading macro JetKi
nematicPlots.cpp+ ...
15:49:15 17614 Wrk-0.14 | Info in <TXProofServ::HandleCache>: loading macro JetK
inematicPlots.cpp+ ...
15:49:15 17600 Wrk-0.6 | Info in <TXProofServ::HandleCache>: loading macro JetKi
nematicPlots.cpp+ ...
15:49:15 17608 Wrk-0.11 | Info in <TXProofServ::HandleCache>: loading macro JetK
inematicPlots.cpp+ ...
Compiling on proof BasicPlotPlugins/EMJESfix.cpp
Here is a log from one of the worker nodes:
100919 15:48:16 30646 xpd-I: ProofServMgr::Create: srvtype = 0
15:48:26 17606 Wrk-0.9 | Info in <TXProofServ::HandleCache>: loading macro MuonInBJet.cpp+ ...
15:48:33 17606 Wrk-0.9 | Info in <TXProofServ::HandleCache>: loading macro BTagJet.cpp+ ...
15:48:37 17606 Wrk-0.9 | Info in <TXProofServ::HandleCache>: loading macro XMLUtils.cpp+ ...
15:48:42 17606 Wrk-0.9 | Info in <TXProofServ::HandleCache>: loading macro FlowOutputObject.cpp+ ...
15:48:47 17606 Wrk-0.9 | Info in <TXProofServ::HandleCache>: loading macro FlowBase.cpp+ ...
15:48:53 17606 Wrk-0.9 | Info in <TXProofServ::HandleCache>: loading macro FlowSequential.cpp+ ...
15:48:57 17606 Wrk-0.9 | Info in <TXProofServ::HandleCache>: loading macro GlobalCache.cpp+ ...
15:49:01 17606 Wrk-0.9 | Info in <TXProofServ::HandleCache>: loading macro GlobalCacheReset.cpp+ ...
15:49:07 17606 Wrk-0.9 | Info in <TXProofServ::HandleCache>: loading macro BasicPlotMaker.cxx+ ...
15:49:15 17606 Wrk-0.9 | Info in <TXProofServ::HandleCache>: loading macro JetKinematicPlots.cpp+ ...
15:49:19 17606 Wrk-0.9 | Info in <TXProofServ::HandleCache>: loading macro EMJESfix.cpp+ ...
And here is the bottom of the log from the server side:
15:49:17 17574 Mst-0 | Info in <TXProofServ::HandleCache>: loading macro EMJESfix.cpp+ ...
15:49:17 17574 Mst-0 | Info in <TUnixSystem::ACLiC>: creating shared library /phys/users/gwatts/.proof/session-tev2-1284
936494-17574/master-0-tev2-1284936494-17574/./EMJESfix_cpp.so
15:49:19 17588 Wrk-0.0 | Info in <TXProofServ::HandleCache>: loading macro EMJESfix.cpp+ ...
15:49:19 17590 Wrk-0.1 | Info in <TXProofServ::HandleCache>: loading macro EMJESfix.cpp+ ...
15:49:19 17592 Wrk-0.2 | Info in <TXProofServ::HandleCache>: loading macro EMJESfix.cpp+ ...
15:49:19 17594 Wrk-0.3 | Info in <TXProofServ::HandleCache>: loading macro EMJESfix.cpp+ ...
15:49:19 17608 Wrk-0.11 | Info in <TXProofServ::HandleCache>: loading macro EMJESfix.cpp+ ...
15:49:19 17604 Wrk-0.8 | Info in <TXProofServ::HandleCache>: loading macro EMJESfix.cpp+ ...
15:49:19 17606 Wrk-0.9 | Info in <TXProofServ::HandleCache>: loading macro EMJESfix.cpp+ ...
15:49:19 17612 Wrk-0.10 | Info in <TXProofServ::HandleCache>: loading macro EMJESfix.cpp+ ...
15:49:19 17602 Wrk-0.7 | Info in <TXProofServ::HandleCache>: loading macro EMJESfix.cpp+ ...
15:49:19 17584 Wrk-0.13 | Info in <TXProofServ::HandleCache>: loading macro EMJESfix.cpp+ ...
15:49:19 17586 Wrk-0.12 | Info in <TXProofServ::HandleCache>: loading macro EMJESfix.cpp+ ...
15:49:20 17600 Wrk-0.6 | Info in <TXProofServ::HandleCache>: loading macro EMJESfix.cpp+ ...
15:49:20 17596 Wrk-0.4 | Info in <TXProofServ::HandleCache>: loading macro EMJESfix.cpp+ ...
15:49:20 17598 Wrk-0.5 | Info in <TXProofServ::HandleCache>: loading macro EMJESfix.cpp+ ...
15:49:20 17610 Wrk-0.15 | Info in <TXProofServ::HandleCache>: loading macro EMJESfix.cpp+ ...
15:49:20 17614 Wrk-0.14 | Info in <TXProofServ::HandleCache>: loading macro EMJESfix.cpp+ ...
It looks like all workers have finished the build, but some how the client hasn’t gotten the message.
Is this known? If not, is there anything I should be doing to try to debug this the next time this happens? The work around is to just kill ROOT and restart it (on the client end of things).
Cheers, Gordon.