Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
digi_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GSTqCut25_run0 0 1 018 869 1 018 869 6 000 6 000 5 757 0 243 0 102 0 96.0 % 0.0 % processed
digi_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GSTqCut15_run0 0 1 041 531 1 041 531 6 000 6 000 5 872 0 128 0 66 0 97.9 % 0.0 % processed
digi_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GSTqCut25_run0 0 1 058 944 1 058 944 7 000 7 000 6 863 0 137 0 93 0 98.0 % 0.0 % processed
digi_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GSTqCut15_run0 0 1 062 225 1 062 225 7 000 7 000 6 884 0 116 0 53 0 98.3 % 0.0 % processed
digi_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GSTqCut25_run0 0 1 182 856 1 182 856 5 000 5 000 4 901 0 99 0 35 0 98.0 % 0.0 % processed
digi_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GSTqCut15_run0 0 1 161 750 1 161 750 5 000 5 000 4 792 0 208 0 35 0 95.8 % 0.0 % processed
Total 0 6 526 175 6 526 175 36 000 36 000 35 069 0 931 0 384 0 97.4 % 0.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 61862 0 35097
root 61268 0 31677 3336

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 27 189139 182628 176343 174335 167884 164474 153511 135590 129563 126380
-9 2 189635 189622
-6 514 222514 220189 208807 197072 194570 187001 184059 183885 183191 182692
85 8 130456 115349 111540 105182 103780 43869 31349 30696
143 3473 236969 234215 232391 225271 223962 223022 222857 222754 222507 221526
179 85 47206 46818 46817 46816 46815 46813 46811 46809 46808 46805
190 3 116084 110139 104172
210 23 139262 100483 73916 59501 46191 46044 46019 45624 45461 45036
211 24 177276 175254 157164 147057 146960 139617 101135 101121 100227 97724
8020 14999 244942 244941 244145 244134 244133 244132 244121 244120 244103 244102
8021 11066 239665 238463 237738 237737 236967 236135 236134 233573 233288 231851
8022 2 38842 17724
8028 126 218969 218664 218587 213342 213127 201130 200329 192205 191514 189004
10001 516 226614 224917 220056 213939 202677 195751 193074 187852 187625 187019
10040 1 115023

Hosts with Task Failures

Hostname Exit Codes
All 143 8021 8020 10001 -6 8028 179
q16copt056.crc.nd.edu 367 131 114 118 3 1 0 0
q16copt071.crc.nd.edu 343 130 110 102 0 1 0 0
q16copt080.crc.nd.edu 333 130 109 87 3 3 1 0
q16copt069.crc.nd.edu 331 107 99 118 3 2 0 2
q16copt070.crc.nd.edu 312 103 125 76 3 5 0 0
q16copt022.crc.nd.edu 276 144 104 25 1 2 0 0
q16copt028.crc.nd.edu 270 125 118 24 1 1 1 0
q16copt063.crc.nd.edu 252 115 107 24 4 1 1 0
q16copt077.crc.nd.edu 245 97 114 32 1 0 1 0
q16copt005.crc.nd.edu 210 112 85 12 0 1 0 0