Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
reco_step_tttt_FourtopsMay3v1_run0 0 14 905 000 14 905 000 30 000 30 000 29 810 0 190 0 15 0 99.4 % 0.0 % processed
Total 0 14 905 000 14 905 000 30 000 30 000 29 810 0 190 0 15 0 99.4 % 0.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 60618 0 15320
root 26729 0 12907 99

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 27 231091 229878 229067 165582 165557 164121 158624 158059 158049 154013
85 1 61883
143 1447 255148 255147 255146 255144 255143 255141 255138 255137 255132 255131
179 10054 225069 225068 225067 225066 225065 225064 224098 222955 222088 222086
210 191 228885 227554 222767 222090 222084 220973 220857 165050 165035 164593
211 5 164580 164107 162905 143929 143670
8020 1272 287028 287027 287026 287025 287024 287023 287022 287021 287020 287019
8021 3668 255145 237226 237114 236646 236634 236495 236418 236413 236338 236332
10001 24 233111 231325 166294 166268 163553 160920 159881 158074 158068 157126
10040 238 256069 256031 226074 225072 224228 224195 224168 224166 224113 224084

Hosts with Task Failures

Hostname Exit Codes
All 179 8021 8020 143 10040 210
q16copt067.crc.nd.edu 119 60 30 16 11 0 2
q16copt015.crc.nd.edu 112 85 15 7 4 1 0
d32cepyc051.crc.nd.edu 108 83 16 6 0 2 1
d64cepyc011.crc.nd.edu 106 80 15 4 4 2 1
d64cepyc001.crc.nd.edu 100 77 12 5 2 2 2
d64cepyc004.crc.nd.edu 99 60 20 13 1 3 2
q16copt037.crc.nd.edu 75 41 21 4 9 0 0
d64cepyc006.crc.nd.edu 74 56 9 5 3 1 0
d64cepyc007.crc.nd.edu 67 52 9 2 1 3 0
d32cepyc062.crc.nd.edu 66 41 16 6 1 1 1