Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
mAOD_step_tHq4f_testUpdateGenproddim6TopMay20GST_run2 0 98 000 98 000 200 200 196 196 4 0 0 0 98.0 % 98.0 % processed
mAOD_step_tllq4fNoSchanWNoHiggs0p_testUpdateGenproddim6TopMay20GST_run1 0 96 500 96 500 200 200 193 90 4 0 0 3 96.5 % 45.0 % processed
mAOD_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1 0 91 335 91 335 620 620 597 597 23 0 7 0 96.3 % 96.3 % processed
mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2 0 95 583 95 583 720 720 703 668 17 0 8 0 97.6 % 92.8 % processed
mAOD_step_ttlnuJet_testUpdateGenproddim6TopMay20GST_run1 0 97 646 97 646 420 420 411 411 9 0 2 0 97.9 % 97.9 % processed

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 3975 0 983
root 4781 0 940 43

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

Task Resources

Task Timing

statisticsprofile show timeline breakdown

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
84 1 9922
8020 587 14865 14863 14862 14861 14860 14858 14857 14856 14855 14854
8021 10 10084 9875 9869 9732 9729 9447 9444 9252 9071 9038

Hosts with Task Failures

Hostname Exit Codes
All 8020
d6cneh022.crc.nd.edu 36 36
qa-2080ti-006.crc.nd.edu 35 35
d12chas254.crc.nd.edu 30 30
d12chas121.crc.nd.edu 30 30
d12chas227.crc.nd.edu 28 28
d8civy156.crc.nd.edu 12 12
d12chas018.crc.nd.edu 9 9
d12chas035.crc.nd.edu 9 9
q16copt064.crc.nd.edu 8 8
q16copt092.crc.nd.edu 7 7