Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
digi_step_tttt_FourtopsMay3v1_run0 0 14 919 000 14 919 000 30 000 30 000 29 838 0 162 0 63 0 99.5 % 0.0 % processed

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 76901 0 32654
root 13496 0 9917 234

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 10 277538 267380 248274 231240 132512 107341 102326 88095 68468 53356
-7 1 130988
-6 10 266782 244452 233311 228872 225456 155507 128161 123992 79439 17041
84 2 142676 61104
85 53 255397 250742 247428 245340 243389 230786 166083 166018 158702 158556
143 1192 276892 276757 274806 274584 270831 269162 269152 268602 266948 263354
179 24782 230408 230407 230406 224760 224758 224757 224756 224755 224754 224753
190 106 252000 251990 251245 250819 250402 247599 245344 245154 230381 230151
210 2737 230154 230146 230144 230022 230019 229990 229987 229986 229973 229963
211 83 227444 223849 165477 165444 165415 165391 165364 165358 165348 164941
8020 4390 286938 286937 286936 286931 286930 286929 286928 286927 286926 286925
8021 14875 281212 281156 281050 280321 280016 278900 278799 278798 278797 278796
8022 2 223336 35544
8028 19 269156 260460 252161 232746 230390 228136 227757 156722 147216 145923
10001 14 278146 250404 245072 243383 152730 142473 138144 133500 115849 105621
10040 1 130855

Hosts with Task Failures

Hostname Exit Codes
All 179 8021 8020 210 143 211 190 85 10001 8028
d64cepyc004.crc.nd.edu 271 157 81 18 15 0 0 0 0 0 0
q16copt027.crc.nd.edu 252 111 78 22 12 25 2 1 0 1 0
d64cepyc010.crc.nd.edu 231 148 46 15 19 0 0 2 0 0 1
d64cepyc009.crc.nd.edu 230 156 41 14 17 0 2 0 0 0 0
q16copt077.crc.nd.edu 225 112 83 11 3 16 0 0 0 0 0
d64cepyc007.crc.nd.edu 201 133 50 5 10 2 1 0 0 0 0
d64cepyc006.crc.nd.edu 199 155 19 7 16 1 1 0 0 0 0
d32cepyc016.crc.nd.edu 191 118 44 11 14 2 1 1 0 0 0
q16copt026.crc.nd.edu 190 110 61 4 1 13 0 0 1 0 0
q16copt038.crc.nd.edu 189 88 62 15 4 19 0 1 0 0 0