Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
nAOD_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0 0 4 865 500 4 865 500 3 247 3 247 3 245 3 245 2 0 2 0 99.9 % 99.9 % processed
nAOD_step_tllq4fNoSchanWNoHiggs0p_all22WCsStartPtCheckV2dim6TopMay20GST_run0 0 4 745 000 4 745 000 3 180 3 180 3 176 3 176 4 0 4 0 99.9 % 99.9 % processed
nAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 187 202 5 187 202 3 262 3 262 3 255 3 255 7 0 7 0 99.8 % 99.8 % processed
nAOD_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 271 904 5 271 904 3 402 3 402 3 395 3 395 7 0 7 0 99.8 % 99.8 % processed
nAOD_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 933 839 5 933 839 8 163 8 163 8 160 8 160 3 0 3 0 100.0 % 100.0 % processed
Total 0 26 003 445 26 003 445 21 254 21 254 21 231 21 231 23 0 23 0 99.9 % 99.9 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 45898 0 21270
root 380 0 5 0

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

Task Resources

Task Timing

statisticsprofile show timeline breakdown

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 1 33716
1 5 60162 60161 60160 60159 60158
143 2612 63335 63332 63300 63240 63238 63226 62358 62264 62249 62228
179 17294 63746 63737 63732 63730 63715 63714 63712 63701 63698 63696
210 388 63393 63391 63084 63022 63007 62920 62878 62762 62712 62665
211 16 61103 61092 59440 59326 57857 55461 52348 51948 51848 51805
8020 7934 63752 63750 63749 63748 63747 63744 63743 63742 63741 63740
8021 194 63443 63442 63388 63241 63115 62874 62399 61879 61630 59658

Hosts with Task Failures

Hostname Exit Codes
All 8020 179 143 210 8021 211
q16copt049.crc.nd.edu 146 58 45 36 6 1 0
q16copt095.crc.nd.edu 136 50 59 19 8 0 0
q16copt120.crc.nd.edu 133 56 42 33 0 2 0
q16copt072.crc.nd.edu 130 45 49 30 4 2 0
q16copt068.crc.nd.edu 120 50 31 35 3 1 0
q16copt066.crc.nd.edu 116 41 30 42 1 2 0
q16copt040.crc.nd.edu 115 44 27 41 0 2 1
q16copt015.crc.nd.edu 98 38 29 27 1 3 0
d12chas038.crc.nd.edu 97 28 53 13 2 1 0
d12chas083.crc.nd.edu 97 27 54 16 0 0 0