Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
nAOD_step_tHq4f_testUpdateGenproddim6TopMay20GST_run2 0 35 000 35 000 200 200 70 48 1 0 0 129 35.0 % 24.0 % processed
nAOD_step_tllq4fNoSchanWNoHiggs0p_testUpdateGenproddim6TopMay20GST_run1 0 37 500 37 500 200 200 75 52 5 0 0 120 37.5 % 26.0 % processed
nAOD_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1 0 93 903 93 903 620 620 614 614 6 0 0 0 99.0 % 99.0 % processed
nAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2 0 96 465 96 465 720 720 709 709 11 0 0 0 98.5 % 98.5 % processed
nAOD_step_ttlnuJet_testUpdateGenproddim6TopMay20GST_run1 0 96 930 96 930 420 420 408 354 9 0 0 3 97.1 % 84.3 % processed
Total 0 359 798 359 798 2 160 2 160 1 876 1 777 32 0 0 252 86.9 % 82.3 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 793 0 688
root 1270 0 536 30

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

Task Resources

Task Timing

statisticsprofile show timeline breakdown

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
143 12 14866 14863 14847 14843 14834 14833 14827 14811 14799 13577
179 6 14892 14891 14890 14889 14884 14883
8020 12 14876 14875 14874 14872 14867 14864 14136 14074 14071 13955
8021 6 14865 13614 13613 13612 13611 13576

Hosts with Task Failures

Hostname Exit Codes
All 143 8020 8021 179
q16copt069.crc.nd.edu 2 1 1 0 0
q16copt024.crc.nd.edu 2 2 0 0 0
q16copt100.crc.nd.edu 2 1 0 1 0
d6cneh029.crc.nd.edu 2 0 1 0 1
d6cneh011.crc.nd.edu 1 0 1 0 0
d12chas250.crc.nd.edu 1 0 0 1 0
d12chas215.crc.nd.edu 1 0 1 0 0
d6cneh014.crc.nd.edu 1 1 0 0 0
d6cneh047.crc.nd.edu 1 1 0 0 0
d6cneh078.crc.nd.edu 1 0 0 1 0