Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
gen_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 000 000 5 000 000 10 000 10 000 10 000 0 0 0 0 0 100.0 % 0.0 % processed
gen_step_tllq4fNoSchanWNoHiggs0p_all22WCsStartPtCheckV2dim6TopMay20GST_run0 0 5 000 000 5 000 000 10 000 10 000 10 000 0 0 0 0 0 100.0 % 0.0 % processed
gen_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 15 000 000 5 331 675 30 000 30 000 30 000 0 0 0 0 0 100.0 % 0.0 % processed
gen_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0 0 17 500 000 5 405 867 35 000 35 000 35 000 0 0 0 0 0 100.0 % 0.0 % processed
gen_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 12 500 000 6 057 427 25 000 25 000 25 000 0 0 0 0 0 100.0 % 0.0 % processed
Total 0 55 000 000 26 794 969 110 000 110 000 110 000 0 0 0 0 0 100.0 % 0.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 127456 0 112375
root 44531 0 43457 1092

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 3 180415 45961 43576
143 4886 258200 258196 258150 257972 257696 257637 257633 257427 257150 257148
179 12576 189557 189556 189544 189542 189541 189540 189539 189536 189535 189534
210 2323 187720 187558 187551 187439 187435 187427 187419 187417 187414 187409
211 52 185922 179218 171007 100719 100626 100524 100523 100385 100359 97471
8020 1575 198278 198142 195545 195540 195530 195529 195525 195513 195512 195505
8021 927 187732 187716 187714 187712 187711 187710 187706 187705 187703 187700
10001 12 187248 180600 180413 180403 79165 79149 78961 78156 72257 45343

Hosts with Task Failures

Hostname Exit Codes
All 179 143 210 8020 8021 211
d32cepyc033.crc.nd.edu 318 231 46 27 1 12 1
d32cepyc023.crc.nd.edu 264 199 34 19 2 10 0
d32cepyc032.crc.nd.edu 219 177 22 12 5 3 0
d32cepyc009.crc.nd.edu 216 108 55 37 7 9 0
d32cepyc042.crc.nd.edu 214 147 33 18 10 5 1
d32cepyc003.crc.nd.edu 211 98 56 34 12 11 0
d32cepyc010.crc.nd.edu 209 139 44 14 7 5 0
d32cepyc021.crc.nd.edu 203 152 10 19 13 7 2
d32cepyc028.crc.nd.edu 194 132 36 12 11 3 0
d32cepyc018.crc.nd.edu 176 107 29 17 13 10 0