DataSetInfo : [default] : Added class "hss" : Add Tree TrainingTree of type hss with 5853 events : Add Tree TrainingTree of type hss with 7835 events : Add Tree TrainingTree of type hss with 2911 events : Add Tree TrainingTree of type hss with 3973 events

DataSetInfo : [default] : Added class "Multijet" : Add Tree TrainingTree of type Multijet with 12366 events : Add Tree TrainingTree of type Multijet with 6238 events

DataSetInfo : [default] : Added class "BIB" : Add Tree TrainingTree of type BIB with 12843 events : Add Tree TrainingTree of type BIB with 6404 events

Factory : Booking method: BDT :

DataSetFactory : [default] : Number of events in input trees : : : : Dataset[default] : Weight renormalisation mode: "EqualNumEvents": renormalises all event classes ... : Dataset[default] : such that the effective (weighted) number of events in each class is the same : Dataset[default] : (and equals the number of events (entries) given for class=0 ) : Dataset[default] : ... i.e. such that Sum[i=1..N_j]{w_i} = N_classA, j=classA, classB, ... : Dataset[default] : ... (note that N_j is the sum of TRAINING events : Dataset[default] : ..... Testing events are not renormalised nor included in the renormalisation factor!) : Number of training and testing events : --------------------------------------------------------------------------- : hss -- training events : 13688 : hss -- testing events : 6884 : hss -- training and testing events: 20572 : Multijet -- training events : 12366 : Multijet -- testing events : 6238 : Multijet -- training and testing events: 18604 : BIB -- training events : 12843 : BIB -- testing events : 6404 : BIB -- training and testing events: 19247 :

DataSetInfo : Correlation matrix (hss): : ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- : JetPt JetPhi CalRatio NTracks SumPtOfAllTracks MaxTrackPt JetWidth EnergyDensity HadronicLayer1Fraction JetLat JetLong FirstClusterRadius ShowerCenter BIBDeltaTimingM BIBDeltaTimingP PredictedLz PredictedLxy : JetPt: +1.000 +0.045 +0.104 +0.074 +0.087 +0.074 -0.183 +0.277 +0.025 +0.094 -0.015 -0.153 -0.075 -0.087 -0.091 -0.149 +0.026 : JetPhi: +0.045 +1.000 -0.038 +0.026 +0.050 -0.007 +0.053 +0.070 +0.073 +0.006 -0.017 -0.015 -0.035 -0.056 +0.045 -0.003 -0.064 : CalRatio: +0.104 -0.038 +1.000 -0.108 -0.100 -0.118 -0.554 -0.220 -0.453 -0.334 -0.267 +0.457 +0.724 +0.192 +0.210 +0.392 +0.836 : NTracks: +0.074 +0.026 -0.108 +1.000 +0.927 +0.759 +0.140 -0.018 +0.067 +0.065 +0.091 -0.098 -0.095 -0.011 -0.074 -0.086 -0.124 : SumPtOfAllTracks: +0.087 +0.050 -0.100 +0.927 +1.000 +0.857 +0.115 -0.017 +0.066 +0.072 +0.084 -0.086 -0.089 -0.003 -0.072 -0.076 -0.117 : MaxTrackPt: +0.074 -0.007 -0.118 +0.759 +0.857 +1.000 +0.120 -0.012 +0.065 +0.069 +0.101 -0.081 -0.099 -0.014 -0.060 -0.073 -0.125 : JetWidth: -0.183 +0.053 -0.554 +0.140 +0.115 +0.120 +1.000 -0.027 +0.249 +0.262 +0.203 -0.277 -0.408 -0.092 -0.138 -0.286 -0.575 : EnergyDensity: +0.277 +0.070 -0.220 -0.018 -0.017 -0.012 -0.027 +1.000 +0.092 -0.117 +0.083 +0.115 -0.233 +0.137 -0.071 +0.137 -0.256 : HadronicLayer1Fraction: +0.025 +0.073 -0.453 +0.067 +0.066 +0.065 +0.249 +0.092 +1.000 +0.335 +0.239 -0.374 -0.504 -0.191 -0.134 -0.283 -0.529 : JetLat: +0.094 +0.006 -0.334 +0.065 +0.072 +0.069 +0.262 -0.117 +0.335 +1.000 +0.369 -0.433 -0.423 -0.163 -0.219 -0.430 -0.469 : JetLong: -0.015 -0.017 -0.267 +0.091 +0.084 +0.101 +0.203 +0.083 +0.239 +0.369 +1.000 -0.155 -0.250 +0.013 -0.156 -0.153 -0.392 : FirstClusterRadius: -0.153 -0.015 +0.457 -0.098 -0.086 -0.081 -0.277 +0.115 -0.374 -0.433 -0.155 +1.000 +0.655 +0.442 +0.397 +0.901 +0.401 : ShowerCenter: -0.075 -0.035 +0.724 -0.095 -0.089 -0.099 -0.408 -0.233 -0.504 -0.423 -0.250 +0.655 +1.000 +0.307 +0.276 +0.529 +0.772 : BIBDeltaTimingM: -0.087 -0.056 +0.192 -0.011 -0.003 -0.014 -0.092 +0.137 -0.191 -0.163 +0.013 +0.442 +0.307 +1.000 -0.635 +0.400 +0.164 : BIBDeltaTimingP: -0.091 +0.045 +0.210 -0.074 -0.072 -0.060 -0.138 -0.071 -0.134 -0.219 -0.156 +0.397 +0.276 -0.635 +1.000 +0.353 +0.212 : PredictedLz: -0.149 -0.003 +0.392 -0.086 -0.076 -0.073 -0.286 +0.137 -0.283 -0.430 -0.153 +0.901 +0.529 +0.400 +0.353 +1.000 +0.338 : PredictedLxy: +0.026 -0.064 +0.836 -0.124 -0.117 -0.125 -0.575 -0.256 -0.529 -0.469 -0.392 +0.401 +0.772 +0.164 +0.212 +0.338 +1.000 : -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

DataSetInfo : Correlation matrix (Multijet): : ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- : JetPt JetPhi CalRatio NTracks SumPtOfAllTracks MaxTrackPt JetWidth EnergyDensity HadronicLayer1Fraction JetLat JetLong FirstClusterRadius ShowerCenter BIBDeltaTimingM BIBDeltaTimingP PredictedLz PredictedLxy : JetPt: +1.000 -0.107 +0.064 +0.434 +0.053 +0.010 -0.320 +0.164 +0.019 +0.049 +0.020 -0.105 -0.087 -0.069 -0.013 -0.087 +0.123 : JetPhi: -0.107 +1.000 +0.027 +0.024 -0.005 -0.005 -0.060 -0.015 -0.023 -0.001 -0.077 +0.051 +0.048 -0.000 +0.042 +0.053 +0.024 : CalRatio: +0.064 +0.027 +1.000 +0.157 +0.038 +0.020 -0.070 -0.141 -0.209 -0.014 -0.076 +0.344 +0.501 +0.122 +0.146 +0.215 +0.183 : NTracks: +0.434 +0.024 +0.157 +1.000 +0.073 +0.005 -0.045 -0.011 -0.042 +0.023 +0.014 +0.044 +0.032 -0.064 +0.102 -0.043 -0.106 : SumPtOfAllTracks: +0.053 -0.005 +0.038 +0.073 +1.000 +0.997 -0.053 +0.010 -0.012 -0.004 +0.003 +0.024 +0.008 -0.018 +0.034 +0.025 +0.001 : MaxTrackPt: +0.010 -0.005 +0.020 +0.005 +0.997 +1.000 -0.033 +0.007 -0.008 -0.006 +0.005 +0.020 +0.002 -0.015 +0.027 +0.026 +0.001 : JetWidth: -0.320 -0.060 -0.070 -0.045 -0.053 -0.033 +1.000 -0.252 +0.028 +0.026 +0.115 -0.097 +0.006 +0.009 -0.073 -0.159 -0.149 : EnergyDensity: +0.164 -0.015 -0.141 -0.011 +0.010 +0.007 -0.252 +1.000 +0.019 -0.405 -0.169 +0.201 -0.195 +0.005 +0.124 +0.351 -0.157 : HadronicLayer1Fraction: +0.019 -0.023 -0.209 -0.042 -0.012 -0.008 +0.028 +0.019 +1.000 +0.027 -0.008 -0.220 -0.167 -0.084 -0.066 -0.158 +0.022 : JetLat: +0.049 -0.001 -0.014 +0.023 -0.004 -0.006 +0.026 -0.405 +0.027 +1.000 +0.324 -0.300 -0.071 -0.049 -0.164 -0.316 +0.102 : JetLong: +0.020 -0.077 -0.076 +0.014 +0.003 +0.005 +0.115 -0.169 -0.008 +0.324 +1.000 -0.031 +0.011 +0.035 -0.053 -0.046 -0.086 : FirstClusterRadius: -0.105 +0.051 +0.344 +0.044 +0.024 +0.020 -0.097 +0.201 -0.220 -0.300 -0.031 +1.000 +0.434 +0.289 +0.433 +0.854 -0.228 : ShowerCenter: -0.087 +0.048 +0.501 +0.032 +0.008 +0.002 +0.006 -0.195 -0.167 -0.071 +0.011 +0.434 +1.000 +0.168 +0.176 +0.093 +0.213 : BIBDeltaTimingM: -0.069 -0.000 +0.122 -0.064 -0.018 -0.015 +0.009 +0.005 -0.084 -0.049 +0.035 +0.289 +0.168 +1.000 -0.685 +0.264 -0.028 : BIBDeltaTimingP: -0.013 +0.042 +0.146 +0.102 +0.034 +0.027 -0.073 +0.124 -0.066 -0.164 -0.053 +0.433 +0.176 -0.685 +1.000 +0.341 -0.124 : PredictedLz: -0.087 +0.053 +0.215 -0.043 +0.025 +0.026 -0.159 +0.351 -0.158 -0.316 -0.046 +0.854 +0.093 +0.264 +0.341 +1.000 -0.178 : PredictedLxy: +0.123 +0.024 +0.183 -0.106 +0.001 +0.001 -0.149 -0.157 +0.022 +0.102 -0.086 -0.228 +0.213 -0.028 -0.124 -0.178 +1.000 : -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

DataSetInfo : Correlation matrix (BIB): : ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- : JetPt JetPhi CalRatio NTracks SumPtOfAllTracks MaxTrackPt JetWidth EnergyDensity HadronicLayer1Fraction JetLat JetLong FirstClusterRadius ShowerCenter BIBDeltaTimingM BIBDeltaTimingP PredictedLz PredictedLxy : JetPt: +1.000 -0.027 +0.213 +0.183 +0.260 +0.206 -0.244 +0.227 -0.049 -0.117 -0.094 +0.007 +0.017 +0.070 -0.110 +0.003 +0.048 : JetPhi: -0.027 +1.000 +0.026 -0.021 -0.065 -0.092 +0.009 +0.003 -0.022 +0.038 +0.042 -0.032 -0.057 -0.108 +0.053 -0.040 +0.064 : CalRatio: +0.213 +0.026 +1.000 -0.682 -0.588 -0.483 -0.651 -0.260 -0.167 -0.514 -0.453 +0.247 +0.497 -0.059 -0.187 +0.201 +0.735 : NTracks: +0.183 -0.021 -0.682 +1.000 +0.833 +0.567 +0.491 +0.341 +0.091 +0.477 +0.466 -0.168 -0.402 +0.113 +0.153 -0.108 -0.656 : SumPtOfAllTracks: +0.260 -0.065 -0.588 +0.833 +1.000 +0.897 +0.286 +0.274 +0.049 +0.435 +0.372 -0.086 -0.294 +0.151 +0.127 -0.070 -0.567 : MaxTrackPt: +0.206 -0.092 -0.483 +0.567 +0.897 +1.000 +0.186 +0.185 +0.018 +0.359 +0.302 -0.029 -0.186 +0.161 +0.096 -0.057 -0.463 : JetWidth: -0.244 +0.009 -0.651 +0.491 +0.286 +0.186 +1.000 +0.193 +0.129 +0.429 +0.433 -0.191 -0.377 +0.019 +0.185 -0.141 -0.603 : EnergyDensity: +0.227 +0.003 -0.260 +0.341 +0.274 +0.185 +0.193 +1.000 +0.070 +0.155 +0.225 +0.078 -0.221 +0.044 +0.189 +0.086 -0.339 : HadronicLayer1Fraction: -0.049 -0.022 -0.167 +0.091 +0.049 +0.018 +0.129 +0.070 +1.000 +0.102 +0.035 -0.426 -0.507 -0.142 -0.068 -0.208 -0.544 : JetLat: -0.117 +0.038 -0.514 +0.477 +0.435 +0.359 +0.429 +0.155 +0.102 +1.000 +0.658 -0.176 -0.296 -0.001 +0.151 -0.159 -0.507 : JetLong: -0.094 +0.042 -0.453 +0.466 +0.372 +0.302 +0.433 +0.225 +0.035 +0.658 +1.000 -0.042 -0.277 +0.119 +0.199 -0.028 -0.471 : FirstClusterRadius: +0.007 -0.032 +0.247 -0.168 -0.086 -0.029 -0.191 +0.078 -0.426 -0.176 -0.042 +1.000 +0.747 +0.519 +0.303 +0.908 +0.400 : ShowerCenter: +0.017 -0.057 +0.497 -0.402 -0.294 -0.186 -0.377 -0.221 -0.507 -0.296 -0.277 +0.747 +1.000 +0.286 +0.135 +0.631 +0.700 : BIBDeltaTimingM: +0.070 -0.108 -0.059 +0.113 +0.151 +0.161 +0.019 +0.044 -0.142 -0.001 +0.119 +0.519 +0.286 +1.000 -0.082 +0.552 -0.009 : BIBDeltaTimingP: -0.110 +0.053 -0.187 +0.153 +0.127 +0.096 +0.185 +0.189 -0.068 +0.151 +0.199 +0.303 +0.135 -0.082 +1.000 +0.327 -0.129 : PredictedLz: +0.003 -0.040 +0.201 -0.108 -0.070 -0.057 -0.141 +0.086 -0.208 -0.159 -0.028 +0.908 +0.631 +0.552 +0.327 +1.000 +0.267 : PredictedLxy: +0.048 +0.064 +0.735 -0.656 -0.567 -0.463 -0.603 -0.339 -0.544 -0.507 -0.471 +0.400 +0.700 -0.009 -0.129 +0.267 +1.000 : -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

DataSetFactory : [default] : :

Factory : Train all methods

Factory : [default] : Create Transformation "I" with events from all classes. :

: Transformation, Variable selection : : Input : variable 'JetPt' <---> Output : variable 'JetPt' : Input : variable 'JetPhi' <---> Output : variable 'JetPhi' : Input : variable 'CalRatio' <---> Output : variable 'CalRatio' : Input : variable 'NTracks' <---> Output : variable 'NTracks' : Input : variable 'SumPtOfAllTracks' <---> Output : variable 'SumPtOfAllTracks' : Input : variable 'MaxTrackPt' <---> Output : variable 'MaxTrackPt' : Input : variable 'JetWidth' <---> Output : variable 'JetWidth' : Input : variable 'EnergyDensity' <---> Output : variable 'EnergyDensity' : Input : variable 'HadronicLayer1Fraction' <---> Output : variable 'HadronicLayer1Fraction' : Input : variable 'JetLat' <---> Output : variable 'JetLat' : Input : variable 'JetLong' <---> Output : variable 'JetLong' : Input : variable 'FirstClusterRadius' <---> Output : variable 'FirstClusterRadius' : Input : variable 'ShowerCenter' <---> Output : variable 'ShowerCenter' : Input : variable 'BIBDeltaTimingM' <---> Output : variable 'BIBDeltaTimingM' : Input : variable 'BIBDeltaTimingP' <---> Output : variable 'BIBDeltaTimingP' : Input : variable 'PredictedLz' <---> Output : variable 'PredictedLz' : Input : variable 'PredictedLxy' <---> Output : variable 'PredictedLxy'

TFHandler_Factory : Variable Mean RMS [ Min Max ] : --------------------------------------------------------------------------------------------------------------------------------- : JetPt: 226.70 140.45 [ 40.006 549.71 ] : JetPhi: 0.020100 1.8980 [ -3.1411 3.1415 ] : CalRatio: 0.52000 1.2706 [ -2.9900 3.9900 ] : NTracks: 2.3629 3.5609 [ 0.0000 24.000 ] : SumPtOfAllTracks: 28.455 167.58 [ 0.0000 20464. ] : MaxTrackPt: 12.081 161.53 [ 0.0000 20456. ] : JetWidth: 0.064671 0.049434 [ 0.00020935 0.26377 ] : EnergyDensity: 0.021026 0.069052 [ 8.5235e-06 2.0312 ] : HadronicLayer1Fraction: 0.47040 0.32711 [ -6.2824 3.9126 ] : JetLat: 0.75277 0.22661 [ 0.0017624 0.99609 ] : JetLong: 0.66190 0.27025 [ 3.8875e-27 1.0000 ] : FirstClusterRadius: 3288.3 1107.5 [ 1464.0 6464.0 ] : ShowerCenter: 1021.0 863.40 [ 0.0000 11008. ] : BIBDeltaTimingM: 9.7870 10.355 [ -54.345 68.432 ] : BIBDeltaTimingP: 9.1251 10.396 [ -33.446 68.225 ] : PredictedLz: 1310.2 1189.0 [ -1196.0 6443.1 ] : PredictedLxy: 1466.5 891.18 [ 117.88 4631.8 ] : --------------------------------------------------------------------------------------------------------------------------------- : Ranking input variables (method unspecific)...

Factory : Train method: BDT for Multiclass classification :

BDT : #events: (reweighted) sig: 19448.5 bkg: 19448.5 : #events: (unweighted) sig: 13688 bkg: 25209 : Training 800 Decision Trees ... patience please : Elapsed time for training with 38897 events: 129 sec : Dataset[default] : Create results for training : Dataset[default] : Multiclass evaluation of BDT on training sample : Dataset[default] : Elapsed time for evaluation of 38897 events: 6.49 sec : Creating multiclass response histograms... : Creating xml weight file: default/weights/JetMVAClassifier-1460061314_BDT.weights.xml : Creating standalone class: default/weights/JetMVAClassifier-1460061314_BDT.class.C

Factory : Training finished : : Ranking input variables (method specific)...

BDT : Ranking result (top variable is best ranked) : -------------------------------------------------------- : Rank : Variable : Variable Importance : -------------------------------------------------------- : 1 : JetPt : -nan : 2 : JetPhi : -nan : 3 : CalRatio : -nan : 4 : NTracks : -nan : 5 : SumPtOfAllTracks : -nan : 6 : MaxTrackPt : -nan : 7 : JetWidth : -nan : 8 : EnergyDensity : -nan : 9 : HadronicLayer1Fraction : -nan : 10 : JetLat : -nan : 11 : JetLong : -nan : 12 : FirstClusterRadius : -nan : 13 : ShowerCenter : -nan : 14 : BIBDeltaTimingM : -nan : 15 : BIBDeltaTimingP : -nan : 16 : PredictedLz : -nan : 17 : PredictedLxy : -nan : --------------------------------------------------------

Factory : === Destroy and recreate all methods via weight files for testing === :

Factory : Test all methods

Factory : Test method: BDT for Multiclass classification performance : : Dataset[default] : Create results for testing : Dataset[default] : Multiclass evaluation of BDT on testing sample : Dataset[default] : Elapsed time for evaluation of 19526 events: 2.05 sec : Creating multiclass response histograms...

Factory : Evaluate all methods : Evaluate multiclass classification method: BDT

TFHandler_BDT : Variable Mean RMS [ Min Max ] : --------------------------------------------------------------------------------------------------------------------------------- : JetPt: 268.74 148.17 [ 40.009 549.01 ] : JetPhi: 0.11320 1.8847 [ -3.1414 3.1405 ] : CalRatio: 0.81414 1.3422 [ -2.9900 3.9931 ] : NTracks: 1.4510 3.2858 [ 0.0000 22.000 ] : SumPtOfAllTracks: 21.715 59.622 [ 0.0000 5227.0 ] : MaxTrackPt: 8.0188 23.967 [ 0.0000 5216.0 ] : JetWidth: 0.054302 0.047232 [ 6.9114e-05 0.25931 ] : EnergyDensity: 0.017150 0.061718 [ 1.6809e-05 1.9766 ] : HadronicLayer1Fraction: 0.44524 0.46722 [ -87.457 3.0192 ] : JetLat: 0.71126 0.24084 [ 2.1935e-05 0.99609 ] : JetLong: 0.62464 0.27641 [ 4.1008e-05 0.99609 ] : FirstClusterRadius: 3346.9 1071.9 [ 1456.0 6464.0 ] : ShowerCenter: 1171.5 900.76 [ 0.0000 9152.0 ] : BIBDeltaTimingM: 10.040 10.969 [ -32.520 76.438 ] : BIBDeltaTimingP: 8.2811 10.144 [ -59.860 65.266 ] : PredictedLz: 1368.7 1255.3 [ -462.15 19148. ] : PredictedLxy: 1687.6 896.89 [ 84.852 19523. ] : --------------------------------------------------------------------------------------------------------------------------------- : 1-vs-rest performance metrics per class : ------------------------------------------------------------------------------------------------------- : : Considers the listed class as signal and the other classes : as background, reporting the resulting binary performance. : : Dataset MVA Method Sig eff Sig eff Sig eff : Name: / Class: ROC AUC @B=0.01 @B=0.10 @B=0.30 : : default BDT : hss 0.500 0.010 0.100 0.300 : Multijet 0.500 0.010 0.100 0.300 : BIB 0.500 0.010 0.100 0.300 : ------------------------------------------------------------------------------------------------------- : : : Confusion matrices for all methods : ------------------------------------------------------------------------------------------------------- : : Does a binary comparison between the two classes given by a : particular row-column combination. In each case, the class : given by the row is considered signal while the class given : by the column index is considered background. : : Showing confusion matrix for method : BDT : (Signal Efficiency for Background Efficiency 0.01%) : hss Multijet BIB : hss - 0.010 0.010 : Multijet 0.010 - 0.010 : BIB 0.010 0.010 - : : (Signal Efficiency for Background Efficiency 0.10%) : hss Multijet BIB : hss - 0.100 0.100 : Multijet 0.100 - 0.100 : BIB 0.100 0.100 - : : (Signal Efficiency for Background Efficiency 0.30%) : hss Multijet BIB : hss - 0.300 0.300 : Multijet 0.300 - 0.300 : BIB 0.300 0.300 - : : ------------------------------------------------------------------------------------------------------- :

Dataset:default : Created tree 'TestTree' with 19526 events :

Dataset:default : Created tree 'TrainTree' with 38897 events :

Factory : Thank you for using TMVA! : For citation information, please visit: http://tmva.sf.net/citeTMVA.html