Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0 0 4 978 500 4 978 500 10 000 10 000 9 957 0 43 0 43 0 99.6 % 0.0 % processed
sim_step_tllq4fNoSchanWNoHiggs0p_all22WCsStartPtCheckV2dim6TopMay20GST_run0 0 4 996 000 4 996 000 10 000 10 000 9 992 0 8 0 8 0 99.9 % 0.0 % processed
sim_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 325 119 5 325 119 30 000 30 000 29 963 0 37 0 37 0 99.9 % 0.0 % processed
sim_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 386 593 5 386 593 35 000 35 000 34 875 0 125 0 125 0 99.6 % 0.0 % processed
sim_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 6 047 600 6 047 600 25 000 25 000 24 959 0 41 0 41 0 99.8 % 0.0 % processed
Total 0 26 733 812 26 733 812 110 000 110 000 109 746 0 254 0 254 0 99.8 % 0.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 128218 0 111669
root 94824 0 85541 1489

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 1 348692
143 3388 458007 409802 316549 296798 293785 258548 257736 257734 257629 257560
179 6285 189332 189331 189318 189216 189213 189212 189211 189210 189208 189206
210 1909 187034 187015 187008 186780 186772 186765 186705 186702 186696 186695
211 14 187612 186447 100651 100636 75753 69766 49078 48917 48769 48759
8016 292 579208 542700 506270 503367 490533 472201 452822 448571 447654 442268
8020 8074 601333 601318 601308 601294 601293 601292 601280 601279 601278 601277
8021 1897 257758 257735 190094 187180 187179 187177 187175 187174 187094 187091
10001 3 307730 185006 149079

Hosts with Task Failures

Hostname Exit Codes
All 8020 179 143 210 8021 8016 211 10001
d32cepyc012.crc.nd.edu 198 99 44 29 11 11 4 0 0
d32cepyc003.crc.nd.edu 197 105 44 24 15 6 3 0 0
d32cepyc022.crc.nd.edu 191 99 44 23 14 10 0 0 1
d32cepyc009.crc.nd.edu 190 114 45 16 6 8 0 1 0
d32cepyc058.crc.nd.edu 188 115 31 14 16 8 4 0 0
d32cepyc018.crc.nd.edu 182 97 35 17 21 10 2 0 0
d32cepyc006.crc.nd.edu 178 86 39 23 14 11 4 1 0
d32cepyc004.crc.nd.edu 169 81 35 19 16 13 5 0 0
d32cepyc016.crc.nd.edu 166 77 47 16 10 14 2 0 0
d32cepyc002.crc.nd.edu 166 96 28 13 12 14 2 1 0