Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
mAOD_step_tttt_FourtopsMay3v1_run0 0 14 902 000 14 902 000 30 000 30 000 29 804 29 804 196 0 6 0 99.3 % 99.3 % processed
Total 0 14 902 000 14 902 000 30 000 30 000 29 804 29 804 196 0 6 0 99.3 % 99.3 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 25918 0 10123
root 19337 0 9487 37

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

Task Resources

Task Timing

statisticsprofile show timeline breakdown

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
143 159 256412 255513 255507 255505 255459 255454 255453 255452 255447 255439
179 1924 222066 221830 221594 221593 221592 221591 221590 221589 221588 221198
210 55 223518 223195 166964 166220 166105 166098 166097 166094 166092 166091
211 4 165528 159847 159021 145633
8020 295 286976 286956 286952 286942 286787 286628 286627 286542 286457 286369
8021 262 237270 237209 236978 236692 234549 234482 234268 232803 231314 231071
10040 124 286986 286969 284111 262749 262001 227772 227469 227468 227215 227214

Hosts with Task Failures

Hostname Exit Codes
All 179 8021 8020 143 10040 210
q16copt009.crc.nd.edu 55 23 16 11 1 4 0
q16copt021.crc.nd.edu 46 35 3 4 1 1 2
q16copt033.crc.nd.edu 43 35 1 4 2 0 1
q16copt035.crc.nd.edu 39 24 2 6 6 1 0
q16copt038.crc.nd.edu 35 29 4 1 1 0 0
d12chas008.crc.nd.edu 33 32 0 1 0 0 0
q16copt010.crc.nd.edu 31 23 5 2 0 0 1
q16copt001.crc.nd.edu 31 28 1 0 1 1 0
q16copt034.crc.nd.edu 31 23 4 4 0 0 0
d32cepyc049.crc.nd.edu 31 30 0 0 0 0 1