Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GSTqCut25_run0 0 1 014 646 1 014 646 6 000 6 000 5 733 5 706 267 0 5 0 95.5 % 95.1 % processed
mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GSTqCut15_run0 0 1 033 483 1 033 483 6 000 6 000 5 827 5 788 173 0 11 0 97.1 % 96.5 % processed
mAOD_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GSTqCut25_run0 0 1 049 321 1 049 321 7 000 7 000 6 801 6 740 199 0 5 0 97.2 % 96.3 % processed
mAOD_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GSTqCut15_run0 0 1 055 729 1 055 729 7 000 7 000 6 842 6 842 158 0 6 0 97.7 % 97.7 % processed
mAOD_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GSTqCut25_run0 0 1 178 816 1 178 816 5 000 5 000 4 884 4 857 116 0 0 0 97.7 % 97.1 % processed
mAOD_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GSTqCut15_run0 0 1 157 368 1 157 368 5 000 5 000 4 774 4 732 226 0 0 0 95.5 % 94.6 % processed
Total 0 6 489 363 6 489 363 36 000 36 000 34 861 34 665 1 139 0 27 0 96.8 % 96.3 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 47021 0 15675
root 47161 0 13222 2453
gsiftp 0 0 1 0

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

Task Resources

Task Timing

statisticsprofile show timeline breakdown

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-9 1 191965
-4 2 245284 245121
6 1 244396
84 1 137254
210 1 42426
211 7 216057 214120 179606 175301 175300 157012 139197
8020 4162 250082 250081 250080 250079 250078 250077 250075 250074 250073 250071
8021 7 245274 214787 214786 100545 95397 77882 74978
10001 2 245231 245114
10010 8

Hosts with Task Failures

Hostname Exit Codes
All 8020 210
q16copt056.crc.nd.edu 469 469 0
q16copt058.crc.nd.edu 469 469 0
q16copt078.crc.nd.edu 456 456 0
d12chas348.crc.nd.edu 444 444 0
d12chas218.crc.nd.edu 442 442 0
d12chas230.crc.nd.edu 441 441 0
d12chas350.crc.nd.edu 106 106 0
q16copt120.crc.nd.edu 89 88 1
qa-rtx6k-042.crc.nd.edu 46 46 0
q16copt066.crc.nd.edu 9 9 0