Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
mAOD_step_ttHJet_HanV4ttXJetStartPtChecks_run0 0 12 858 485 12 858 485 80 000 80 000 79 752 69 276 4 0 2 244 99.7 % 86.6 % processed
Total 0 12 858 485 12 858 485 80 000 80 000 79 752 69 276 4 0 2 244 99.7 % 86.6 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 76965 0 31203
root 82610 0 0 31203
gsiftp 0 0 31126 0

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

Task Resources

Task Timing

statisticsprofile show timeline breakdown

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 103 238596 238523 238482 237728 237275 237056 236480 236427 235829 235814
-4 260 238660 238627 238591 238399 238321 238269 238215 238211 238206 238205
143 3 168087 135137 126888
8020 202 238484 238210 238204 238183 237266 237247 237032 236771 236764 236642
8021 901 238663 238662 238639 238604 238580 238576 238525 238503 238496 238490
10001 347 238599 238577 238517 238397 238352 238323 238294 238216 238212 238208

Hosts with Task Failures

Hostname Exit Codes
All 8021 10001 -4 8020 -11 143
q16copt070.crc.nd.edu 30 10 5 8 6 1 0
q16copt052.crc.nd.edu 30 13 6 5 2 4 0
q16copt044.crc.nd.edu 28 10 5 6 7 0 0
q16copt028.crc.nd.edu 28 16 4 4 2 2 0
q16copt074.crc.nd.edu 27 8 5 8 3 2 1
q16copt067.crc.nd.edu 25 8 8 5 2 2 0
q16copt099.crc.nd.edu 25 11 6 3 4 1 0
q16copt073.crc.nd.edu 24 12 4 2 2 4 0
q16copt089.crc.nd.edu 24 7 7 6 3 1 0
q16copt045.crc.nd.edu 23 15 3 3 1 1 0