Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
nAOD_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 000 000 5 000 000 3 328 3 328 3 328 3 328 0 0 0 0 100.0 % 100.0 % processed
nAOD_step_tllq4fNoSchanWNoHiggs0p_all22WCsStartPtCheckV2dim6TopMay20GST_run0 0 5 000 000 5 000 000 3 325 3 325 3 325 3 325 0 0 0 0 100.0 % 100.0 % processed
nAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 330 109 5 330 109 3 329 3 329 3 329 3 329 0 0 0 0 100.0 % 100.0 % processed
nAOD_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 405 276 5 405 276 2 915 2 915 2 915 2 915 0 0 0 0 100.0 % 100.0 % processed
nAOD_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 6 053 903 6 053 903 4 161 4 161 4 161 4 161 0 0 0 0 100.0 % 100.0 % processed
Total 0 26 789 288 26 789 288 17 058 17 058 17 058 17 058 0 0 0 0 100.0 % 100.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 34170 0 18581
root 32042 0 3226 391
gsiftp 0 0 3 0

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

Task Resources

Task Timing

statisticsprofile show timeline breakdown

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
1 413 32571 32564 32563 32556 32555 32554 32550 32549 32548 32547
143 19 31841 31804 31755 31754 29994 29991 29512 29447 29364 29040
179 13422 28937 28936 28935 28934 28933 28932 28931 28930 28929 28928
210 1350 16198 16197 16196 16195 16194 16193 16192 16191 16190 16189
211 61 16131 16126 16122 16114 16113 16106 16102 16100 16096 16095
8020 65 3831 3830 3826 3825 3792 3715 3713 3703 2739 2738
8021 7 16107 16098 15978 15801 15473 7000 2179
10020 83

Hosts with Task Failures

Hostname Exit Codes
All 179 210 1 211 8020 8021
d64cepyc009.crc.nd.edu 746 630 93 13 9 1 0
d64cepyc005.crc.nd.edu 653 537 103 11 2 0 0
d32cepyc005.crc.nd.edu 241 194 28 4 7 8 0
d32cepyc013.crc.nd.edu 226 189 31 6 0 0 0
q16copt051.crc.nd.edu 224 218 5 0 0 0 1
q16copt035.crc.nd.edu 164 161 0 3 0 0 0
d32cepyc010.crc.nd.edu 162 141 13 2 6 0 0
d12chas238.crc.nd.edu 157 140 10 3 1 3 0
q16copt045.crc.nd.edu 152 141 7 2 0 0 2
q16copt064.crc.nd.edu 152 139 10 2 0 1 0