sometimes when I train several methods the ROC-integ presented at the end of the training clearly do not respect the ROC curves accessed through TMVAGui. See for example:
Name: Method: ROC-integ
dataset BDT_Tracker2 : 0.566
dataset BDT_Tracker : 0.855
The ROC Curve of BDT_Tracker2 clearly show a better classificator but the ROC-integ displayed report a measly 0.566.
My question is: what is more accurate and less prone to be an error? My bet is on the curve but I want your opinion as TMVA expert.
Thanks for your time,
Which version of ROOT are you using ? I think there was a bug with the ROC integral calculation that should have been fixed in the current master version.
If you can check with the latest version would be great, otherwise, you can send me the output file and I can double-check the result.
But it is clear that the result of the curve in this case seems to be correct
I’m using ROOT 6.10/08.
The bug is only in the integral calculation or even in the roc curve?
I think the bug might be in both. Could you try to use 6.11.02 or wait for the new 6.12 release, that will be done later this week ?
Otherwise if you post your macro and data I can try it
I’ll wait for 6.12, thanks.