Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
mAOD_step_tHq4f_HanV4tHqStartPtChecksMatchOff_run2 0 10 036 000 10 036 000 20 072 20 072 20 072 20 072 0 0 0 0 100.0 % 100.0 % processed
Total 0 10 036 000 10 036 000 20 072 20 072 20 072 20 072 0 0 0 0 100.0 % 100.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 22726 0 10146
root 22736 0 0 10146
gsiftp 0 0 1 0

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

Task Resources

Task Timing

statisticsprofile show timeline breakdown

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 49 63486 62468 62235 62072 61777 61467 61225 61216 59997 59775
-4 74 63468 63408 63352 63315 63194 63008 62979 62686 62660 61849
143 3 62991 62663 62304
8020 216 63642 63585 63489 63471 63433 63429 63319 63307 63232 63131
8021 892 63781 63662 63648 63639 63634 63611 63608 63603 63572 63548
10001 135 63622 63546 63539 63317 63226 63201 63103 63078 62792 62695
10040 5 63327 60028 36105 30425 30278

Hosts with Task Failures

Hostname Exit Codes
All 8021 8020 10001 -4 -11 143
q16copt066.crc.nd.edu 22 14 5 1 0 2 0
q16copt097.crc.nd.edu 21 15 1 1 2 1 1
q16copt067.crc.nd.edu 20 11 8 1 0 0 0
q16copt072.crc.nd.edu 19 9 6 2 1 1 0
d12chas048.crc.nd.edu 17 12 3 1 1 0 0
q16copt059.crc.nd.edu 17 11 3 1 1 1 0
q16copt069.crc.nd.edu 17 12 2 1 2 0 0
q16copt076.crc.nd.edu 16 4 5 3 2 2 0
q16copt092.crc.nd.edu 16 11 5 0 0 0 0
q16copt060.crc.nd.edu 14 7 4 1 1 1 0