Problem in installing pyroot

ROOT
1

Dear Proof expert:

Following the instrction at wisconsin.cern.ch/~nengxu/xrootd … _PROOF.ppt, I finished step 1 and 2 successfuly, I didn’t apply step 3 because I don’t need to specify a data disk. Then I did step4, changing the master name and slave name. At step5 when I tried to /etc/init.d/olbd, it shows nothing:

[pcncu10] /root > /etc/init.d/olbd restart

but xrootd could be started:

[pcncu10] /root > /etc/init.d/xrootd restart
Stopping xrootd: [ OK ]
Starting xrootd: [ OK ]

Then I go to step 6 and encountered the following error in file transfer test:

[qing1981] /home/qing/analysis/Jan29/data > xrdcp -d 1 SinglePhotonPt40.root root://pcncu10.cern.ch//xrootd/test/test.root
Set debug level 1
110218 17:26:42 001 Xrd: main: © 2004-2010 by the Xrootd group. $Revision: 1.103 $ - Xrootd version: v20100913-0630-root-5
110218 17:26:42 001 Xrd: Create: © 2004-2010 by the Xrootd group. XrdClient $Revision: 1.157 $ - Xrootd version: v20100913-0630-root-5
110218 17:26:42 001 Xrd: ShowUrls: The converted URLs count is 1
110218 17:26:42 001 Xrd: ShowUrls: URL n.1: root://pcncu10.cern.ch:1094//xrootd/test/test.root.
110218 17:26:42 001 Xrd: Open: Access to server granted.
110218 17:26:42 001 Xrd: Open: Opening the remote file /xrootd/test/test.root
110218 17:26:42 001 Xrd: Open: File open in progress.
110218 17:26:42 5517 Xrd: CheckErrorStatus: Server [pcncu10.cern.ch:1094] requested 10 seconds of wait
110218 17:26:52 5517 Xrd: CheckErrorStatus: Server [pcncu10.cern.ch:1094] requested 10 seconds of wait
110218 17:27:02 5517 Xrd: CheckErrorStatus: Server [pcncu10.cern.ch:1094] requested 10 seconds of wait
110218 17:27:12 5517 Xrd: DumpPhyConn: Phyconn entry, key='qing@pcncu10.cern.ch:1094’, LogCnt=1 Valid
110218 17:27:12 5517 Xrd: CheckErrorStatus: Server [pcncu10.cern.ch:1094] requested 10 seconds of wait
110218 17:27:22 5517 Xrd: CheckErrorStatus: Server [pcncu10.cern.ch:1094] requested 10 seconds of wait
110218 17:27:32 5517 Xrd: CheckErrorStatus: Server [pcncu10.cern.ch:1094] requested 10 seconds of wait
110218 17:27:42 5517 Xrd: DumpPhyConn: Phyconn entry, key='qing@pcncu10.cern.ch:1094’, LogCnt=1 Valid
110218 17:27:42 5517 Xrd: CheckErrorStatus: Server [pcncu10.cern.ch:1094] requested 10 seconds of wait

Any idea with this error?

Thanks,Gang

2

Hi,

Your problem is a problem with an xrootd setup and I am afraid we cannot provide support in here.
Please address to xrootd.org .

Also, the slides you refer to look quite old (‘olbd’ has been replaced by ‘cmsd’ since several years).

You can find some doc about setting up a PROOF cluster at root.cern.ch/drupal/content/some … -use-cases . Not fully up-to-date but probably better than what you have.

G. Ganis

3

Hi:

The xroot problem is solved. I installed ROOT_5_28 and xrootd-3.0.4 on 2 machines: pcncu1001.cern.ch and qing1981.cern.ch, after starting xrootd on these 2 machines, I can transfer file from a third machine pcncu17.cern.ch to pcncu1001 via xrdcp:

[pcncu17] /scratch/qing/PROOF_test > xrdcp proof_test._00002.root root://pcncu1001.cern.ch//xrootd/test/p … 00002.root
[xrootd] Total 21.13 MB |====================| 100.00 % [147.7 MB/s]
[pcncu17] /scratch/qing/PROOF_test > xrdcp proof_test._00001.root root://pcncu1001.cern.ch//xrootd/test/p … 00001.root
[xrootd] Total 21.10 MB |====================| 100.00 % [148.5 MB/s]
[pcncu17] /scratch/qing/PROOF_test > xrdcp proof_test._00001.root root://qing1981.cern.ch//xrootd/test/pr … 00001.root
[xrootd] Total 21.10 MB |====================| 100.00 % [136.6 MB/s]

But when I run run.C (slide 11 of of wisconsin.cern.ch/~nengxu/xrootd … _PROOF.ppt), the following error appeared:
root [0] .x run.C
110617 23:33:39 001 Proofx-E: Conn::CheckResp: server [pcncu1001.cern.ch:1093] did not return OK replying to last request
110617 23:33:39 001 Proofx-E: Conn::CheckErrorStatus: error 3006: 'master not allowed to connect - request ignored’
110617 23:33:39 001 Proofx-I: Conn::Login: pcncu1001.cern.ch: master not allowed to connect - request ignored
110617 23:33:39 001 Proofx-E: Conn::GetAccessToSrv: client could not login at [pcncu1001.cern.ch:1093]
110617 23:33:39 001 Proofx-E: Conn::Connect: failure: master not allowed to connect - request ignored
110617 23:33:39 001 Proofx-E: XrdProofConn: XrdProofConn: severe error occurred while opening a connection to server [pcncu1001.cern.ch:1093]
Error: illegal pointer to class object gProof 0x0 1776 run.C:7:
*** Interpreter error recovered ***

Any idea what’s wrong?

Here is my xrootd.cf:

[pcncu1001] /home/xrootd/xrootd-3.0.4/etc > cat xrootd.cf
if pcncu1001.cern.ch
xrd.port 1094
else
xord.port any
fi

all.export /xrootd r/w

oss.path /xrootd/ r/w
cms.path /xrootd/ r/w

if pcncu1001.cern.ch
all.role manager
else
all.role server
fi

all.manager pcncu1001.cern.ch:1213

cms.allow host pcncu1001.cern.ch
cms.allow host qing1981.cern.ch

if exec xrootd
xrd.protocol xproofd:1093 /opt/root/lib/libXrdProofd.so
fi

xpd.rootsys /opt/root
xpd.workdir /xrootd/
xpd.role worker
if pcncu1001.cern.ch
xpd.role master
fi
xpd.allow pcncu1001.cern.ch
xpd.poolurl root://pcncu1001.cern.ch
xpd.namespace /home/xrootd/proofpool

xpd.inwait 20
xpd.resource static /etc/proof.conf

And here is the /etc/proof.conf:

[pcncu1001] /home/xrootd/xrootd-3.0.4/etc > cat /etc/proof.conf
master pcncu1001.cern.ch workdir=/xrootd
worker qing1981.cern.ch workdir=/xrootd

Cheers,Gang

4

Hi,

Could please try do do step by step what you are doing in run.C and check the xrootd.log each time, both on the master and the worker machines?
Start with

root[] TProof *p = TProof::Open("pcncu1001.cern.ch",0,0,4)

G. Ganis

5

Hi, Ganis:

Here is the error:

root [1] TProof *p = TProof::Open(“pcncu1001.cern.ch”,0,0,4)
110621 14:58:12 001 Proofx-E: Conn::CheckResp: server [pcncu1001.cern.ch:1093] did not return OK replying to last request
110621 14:58:12 001 Proofx-E: Conn::CheckErrorStatus: error 3006: 'Server not allowed to be top master - ignoring request’
110621 14:58:12 001 Proofx-I: Conn::Login: pcncu1001.cern.ch: Server not allowed to be top master - ignoring request
110621 14:58:12 001 Proofx-E: Conn::GetAccessToSrv: client could not login at [pcncu1001.cern.ch:1093]
110621 14:58:12 001 Proofx-E: Conn::Connect: failure: Server not allowed to be top master - ignoring request
110621 14:58:12 001 Proofx-E: XrdProofConn: XrdProofConn: severe error occurred while opening a connection to server [pcncu1001.cern.ch:1093]

Here is the log :

[pcncu1001] /home/xrootd/xrootd-3.0.4 > xproofd -c etc/xrootd.cf
Config warning: this hostname, pcncu1001, is registered without a domain qualification.
110621 14:57:42 001 Scalla is starting. . .
Copr. 2010 Stanford University, xrd version v3.0.2
++++++ xproofd anon@pcncu1001 initialization started.
Config using configuration file etc/xrootd.cf
Config maximum number of connections restricted to 1024
110621 14:57:42 001 xpd.workdir /xrootd/
110621 14:57:42 001 xpd.role worker
110621 14:57:42 001 xpd.allow pcncu1001.cern.ch
110621 14:57:42 001 xpd.poolurl root://pcncu1001.cern.ch
110621 14:57:42 001 xpd.namespace /home/xrootd/proofpool
110621 14:57:42 001 xpd.allowedusers xrootd,qing
110621 14:57:42 001 xpd-I: Manager::Config: configuring
110621 14:57:42 001 xpd-I: Manager::Config: listening on port 1093
110621 14:57:42 001 xpd-I: Manager::Config: using temp dir: /tmp
110621 14:57:42 001 xpd-I: Manager::Config: role set to: worker
110621 14:57:42 001 xpd-I: Manager::Config: admin path set to: /tmp/.xproofd.1093
110621 14:57:42 001 xpd-I: Manager::Config: unix sockets under: /tmp/.xproofd.1093/socks
110621 14:57:42 001 xpd-I: Manager::Config: working directories under: /xrootd/
110621 14:57:42 001 xpd-I: Manager::Config: masters allowed to connect: pcncu1001.cern.ch
110621 14:57:42 001 xpd-I: Manager::Config: PROOF pool: root://pcncu1001.cern.ch
110621 14:57:42 001 xpd-I: Manager::Config: PROOF pool namespace: /home/xrootd/proofpool
110621 14:57:42 001 xpd-I: Manager::Config: no dataset sources defined
110621 14:57:42 001 xpd-I: Manager::Config: list of superusers: xrootd
110621 14:57:42 001 xpd-I: Manager::Config: running in controlled access mode: users allowed: qing,xrootd
110621 14:57:42 001 xpd-I: Manager::Config: bare lib path for proofserv:
110621 14:57:42 001 xpd-I: Group::Print: +++ Group: default
110621 14:57:42 001 xpd-I: Group::Print: +++ Priority: -1, fraction: -1
110621 14:57:42 001 xpd-I: Group::Print: +++ End of Group: default
110621 14:57:42 001 xpd-I: Admin::Config: configuring
110621 14:57:42 001 xpd-I: Admin::Config: allowed/supported copy commands: root:xrdcp,https:wget,file:cp,http:wget,xrd:xrdcp
110621 14:57:42 001 xpd.resource static /etc/proof.conf
110621 14:57:42 001 xpd-I: NetMgr::Config: configuring
110621 14:57:42 001 xpd-I: NetMgr::Config: 0 worker nodes defined at start-up
110621 14:57:42 001 xpd-I: PriorityMgr::Config: configuring
110621 14:57:42 001 xpd-I: PriorityMgr::Config: no priority changes requested
110621 14:57:42 001 xpd-I: PriorityMgr::Config: poller thread started
110621 14:57:42 001 xpd-I: ROOTMgr::SetLogDir: rootsys log validation path: /tmp/.xproofd.1093/rootsysvalidation
110621 14:57:42 001 xpd.rootsys /opt/root
110621 14:57:42 001 xpd-I: ROOTMgr::Config: configuring
110621 14:57:42 001 xpd-I: ClientMgr::Config: configuring
110621 14:57:42 001 xpd-I: ClientMgr::Config: clients admin path set to: /tmp/.xproofd.1093/clients
110621 14:57:42 001 xpd-I: ClientMgr::Config: XRD seclib not specified; strong authentication disabled
110621 14:57:42 001 xpd-I: ClientMgr::Config: cron thread started
110621 14:57:42 001 xpd-I: ProofServMgr::Config: configuring
110621 14:57:42 001 xpd-I: ProofServMgr::Config: setting internal timeout to 10 secs
110621 14:57:42 001 xpd-I: ProofServMgr::Config: client sessions kept idle for 0 secs after disconnection
110621 14:57:42 001 xpd-I: ProofServMgr::Config: active sessions admin path set to: /tmp/.xproofd.1093/activesessions
110621 14:57:42 001 xpd-I: ProofServMgr::Config: terminated sessions admin path set to /tmp/.xproofd.1093/terminatedsessions
110621 14:57:42 001 xpd-I: ProofServMgr::Config: RC settings: 0
110621 14:57:42 001 xpd-I: ProofServMgr::Config: ENV settings: 0
110621 14:57:42 001 xpd-I: ProofServMgr::Config: cron thread started
110621 14:57:42 001 xpd-I: Manager::Config: file serving (protocol: ‘rootd://’) explicitly disabled
110621 14:57:42 001 xpd-I: Manager::Config: manager cron thread started
110621 14:57:42 001 xpd-I: Protocol::Configure: global manager created
110621 14:57:42 001 xpd-I: Protocol::Configure: xproofd protocol version 0.6 build v3.0.2 successfully loaded
110621 14:57:42 6136 xpd-I: ProofServCron: next full sessions check in 30 secs
------ xproofd anon@pcncu1001:1093 initialization completed.

Here is my xrootd.cf:

[pcncu1001] /home/xrootd/xrootd-3.0.4 > cat etc/xrootd.cf
if pcncu1001.cern.ch
xrd.port 1094
else
xord.port any
fi

all.export /xrootd r/w

oss.path /xrootd/ r/w
cms.path /xrootd/ r/w

if pcncu1001.cern.ch
all.role manager
else
all.role server
fi

all.manager pcncu1001.cern.ch:1213

cms.allow host pcncu1001.cern.ch
cms.allow host qing1981.cern.ch

if exec xrootd
xrd.protocol xproofd:1093 /opt/root/lib/libXrdProofd.so
fi

xpd.rootsys /opt/root
xpd.workdir /xrootd/
xpd.role worker
if pcncu1001.cern.ch
xpd.role master
fi
xpd.allow pcncu1001.cern.ch
xpd.poolurl root://pcncu1001.cern.ch
xpd.namespace /home/xrootd/proofpool

xpd.inwait 20
xpd.resource static /etc/proof.conf

xpd.allowedusers xrootd,qing

I have disabled the firewall, any idea where the problem is?

Cheers,Gang