Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
sim_step_tttt_FourtopsMay3v1_run0 0 14 950 500 14 950 500 30 000 30 000 29 901 0 99 0 99 0 99.7 % 0.0 % processed
Total 0 14 950 500 14 950 500 30 000 30 000 29 901 0 99 0 99 0 99.7 % 0.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 57419 0 33631
root 4760 0 2240 45

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 4 89992 65589 36686 11403
143 2343 256241 247728 236806 236377 230576 230379 230378 230377 230376 230375
179 12745 225354 225352 225351 225350 225349 225348 225347 225346 224633 224611
210 3671 229542 229249 227026 225832 166750 166748 166747 166744 166742 166741
211 63 158669 158666 158363 158358 157779 157281 156962 143810 136910 118992
8016 233 257675 256268 255149 251915 249284 245209 241606 239089 237079 236525
8020 4450 286796 286719 286638 286551 286427 286340 286293 286257 286197 286160
8021 6356 230726 230577 228964 166161 165830 165825 165281 165267 165263 165257
10001 3 110779 93543 36621

Hosts with Task Failures

Hostname Exit Codes
All 179 8021 210 8020 143 8016 211
d64cepyc010.crc.nd.edu 349 189 82 38 23 14 2 1
d64cepyc011.crc.nd.edu 328 152 87 50 15 15 8 1
d64cepyc009.crc.nd.edu 322 170 68 43 19 20 2 0
d64cepyc004.crc.nd.edu 288 129 63 53 25 14 4 0
d64cepyc001.crc.nd.edu 259 123 63 32 25 13 2 1
d64cepyc006.crc.nd.edu 254 120 63 43 13 13 2 0
d64cepyc007.crc.nd.edu 240 107 75 31 15 6 5 1
d64cepyc008.crc.nd.edu 239 89 75 42 15 14 3 1
d64cepyc005.crc.nd.edu 233 112 52 36 21 10 1 1
d32cepyc035.crc.nd.edu 228 57 27 18 110 13 3 0