Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
mAOD_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0 0 4 893 500 4 893 500 10 000 10 000 9 787 9 787 213 0 19 0 97.9 % 97.9 % processed
mAOD_step_tllq4fNoSchanWNoHiggs0p_all22WCsStartPtCheckV2dim6TopMay20GST_run0 0 4 884 500 4 884 500 10 000 10 000 9 769 9 769 231 0 12 0 97.7 % 97.7 % processed
mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 284 475 5 284 475 30 001 30 001 29 747 29 662 254 0 20 0 99.2 % 98.9 % processed
mAOD_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 334 483 5 334 483 35 006 35 006 34 534 34 485 472 0 35 0 98.7 % 98.5 % processed
mAOD_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 940 149 5 940 149 25 005 25 005 24 529 24 511 476 0 46 0 98.1 % 98.0 % processed
Total 0 26 337 107 26 337 107 110 012 110 012 108 366 108 214 1 646 0 132 0 98.5 % 98.4 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 161526 0 46581
root 155560 0 40663 4055
gsiftp 0 0 2 0

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

Task Resources

Task Timing

statisticsprofile show timeline breakdown

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 2 652402 648467
-4 5 648648 647592 571789 570844 166675
84 1 204641
143 84 595947 593759 593757 593756 593753 592402 581080 571080 571077 571075
179 22 284706 284394 283799 283790 277306 277305 277030 277020 276633 276619
210 39 282261 281913 281731 281729 281516 276206 276203 275757 275743 275300
211 8 167220 166186 164712 164105 160500 159585 124150 24253
8020 16431 654000 653996 653994 653992 653990 653988 653987 653986 653985 653983
8021 86 653197 653105 652977 652960 652869 652756 652711 652591 652469 652463
10001 17 653064 652721 652498 651162 650857 648752 648643 648466 648170 647712
10040 11 511182 510539 510534 497898 497897 279446 278857 278143 278142 76306

Hosts with Task Failures

Hostname Exit Codes
All 8020 143 10001 8021 179
q16copt040.crc.nd.edu 138 137 1 0 0 0
d32cepyc006.crc.nd.edu 136 136 0 0 0 0
q16copt071.crc.nd.edu 131 131 0 0 0 0
q16copt015.crc.nd.edu 125 121 2 0 2 0
q16copt099.crc.nd.edu 125 125 0 0 0 0
d8civy158.crc.nd.edu 121 120 0 1 0 0
q16copt027.crc.nd.edu 118 115 3 0 0 0
q16copt070.crc.nd.edu 118 117 0 1 0 0
q16copt121.crc.nd.edu 112 107 2 1 1 1
q16copt089.crc.nd.edu 110 110 0 0 0 0