Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
gen_step_tttt_FourtopsMay3v1_run0 0 15 000 000 15 000 000 30 000 30 000 30 000 0 0 0 0 0 100.0 % 0.0 % processed
Total 0 15 000 000 15 000 000 30 000 30 000 30 000 0 0 0 0 0 100.0 % 0.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 36142 0 31419
root 143 0 60 83
gsiftp 0 0 5 0

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 3 41977 41643 13618
143 392 113694 113523 113110 100146 100145 100025 100021 100020 100005 99907
179 3745 125145 120438 117276 117275 117274 117273 117272 117271 117270 117269
210 1385 122078 122074 122072 121521 121518 120195 119150 118945 118943 118941
211 34 123906 120439 118436 114682 110115 109863 109511 109228 109033 108030
8020 746 126985 125808 122071 120440 120436 120435 119337 119147 118430 118227
8021 229 119148 118087 116152 116146 115681 115442 115441 115433 115268 114681

Hosts with Task Failures

Hostname Exit Codes
All 179 210 8020 143 8021 211
d64cepyc007.crc.nd.edu 68 39 15 4 5 5 0
d32cepyc034.crc.nd.edu 64 36 11 9 5 2 1
d64cepyc011.crc.nd.edu 63 35 20 3 4 1 0
d64cepyc009.crc.nd.edu 57 36 12 4 2 2 1
d32cepyc021.crc.nd.edu 51 25 7 9 8 2 0
d32cepyc020.crc.nd.edu 51 31 17 2 0 1 0
d64cepyc008.crc.nd.edu 49 27 9 7 3 3 0
q16copt008.crc.nd.edu 49 29 7 6 4 2 1
d64cepyc004.crc.nd.edu 47 28 11 7 0 0 1
d64cepyc002.crc.nd.edu 46 22 11 3 10 0 0