Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
reco_step_tllq4fNoSchanWNoHiggs0p_HanV4Model16DttllScanpointsXQCUT0MatchOff_run1 0 9 999 500 9 999 500 20 000 20 000 19 999 0 1 0 1 0 100.0 % 0.0 % processed

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 22868 0 10029
root 22868 0 0 10029
gsiftp 0 0 14 0

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 102 64600 64196 64092 63837 62825 62340 61342 60497 60451 60054
143 5 65365 65176 64720 63697 61526
8020 20 56211 51251 48333 43930 43929 43924 43807 43451 43445 43439
8021 1315 65462 65460 65208 65177 65175 65096 65051 65000 64927 64773
10001 107 65313 63875 62831 61881 61728 61721 61713 61337 61316 60709
10040 153 65467 65464 65432 65414 65398 65375 65342 65320 65285 65243
10050 982 46263 46262 46261 46260 46259 46258 46257 46256 46255 46254

Hosts with Task Failures

Hostname Exit Codes
All 10050 8021 10040 10001 -11 8020
d64cepyc002.crc.nd.edu 73 40 26 1 3 2 1
d12chas143.crc.nd.edu 44 22 14 4 1 3 0
q16copt050.crc.nd.edu 42 26 14 1 1 0 0
d12chas348.crc.nd.edu 42 25 11 4 2 0 0
qa-xp-009.crc.nd.edu 37 16 13 4 1 2 1
d12chas326.crc.nd.edu 35 17 11 1 3 2 1
d12chas124.crc.nd.edu 33 16 11 3 0 2 1
d12chas104.crc.nd.edu 32 14 15 2 1 0 0
d12chas350.crc.nd.edu 26 11 11 2 0 2 0
d12chas139.crc.nd.edu 25 9 13 0 2 1 0