Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0 0 4 965 000 4 965 000 10 000 10 000 9 930 0 70 0 70 0 99.3 % 0.0 % processed
sim_step_tllq4fNoSchanWNoHiggs0p_all22WCsStartPtCheckV2dim6TopMay20GST_run0 0 4 963 000 4 963 000 10 000 10 000 9 926 0 74 0 74 0 99.3 % 0.0 % processed
sim_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 313 170 5 313 170 30 001 30 001 29 909 0 92 0 92 0 99.7 % 0.0 % processed
sim_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 376 455 5 376 455 35 006 35 006 34 805 0 201 0 201 0 99.4 % 0.0 % processed
sim_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 6 012 374 6 012 374 25 005 25 005 24 827 0 178 0 178 0 99.3 % 0.0 % processed
Total 0 26 629 999 26 629 999 110 012 110 012 109 397 0 615 0 615 0 99.4 % 0.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 137562 0 112724
root 60413 0 37084 5372

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 5 289614 165145 96111 70128 24989
143 1962 598341 570913 570764 570597 560851 553944 507328 470627 432268 419429
179 2282 285028 285001 285000 284999 284998 284997 284982 284981 284980 284979
210 3178 282849 282844 282832 282831 282830 282825 282822 282820 282818 282816
211 149 281979 275923 275860 275453 275420 275084 275062 274481 273257 272364
8016 325 577804 576298 575569 574751 574008 573205 571946 569437 564806 561954
8020 19736 644576 644575 644455 644331 644330 644329 644328 644327 644268 644190
8021 2490 282827 282823 282807 282804 282299 281901 281879 281815 281373 280090

Hosts with Task Failures

Hostname Exit Codes
All 8020 210 143 179 8021 8016 211
d64cepyc002.crc.nd.edu 296 236 16 14 13 13 3 1
d32cepyc007.crc.nd.edu 207 166 20 8 6 4 0 3
q16copt049.crc.nd.edu 180 132 14 11 11 9 3 0
d32cepyc061.crc.nd.edu 166 158 5 1 2 0 0 0
q16copt102.crc.nd.edu 163 119 12 10 9 11 0 2
d32cepyc017.crc.nd.edu 161 161 0 0 0 0 0 0
q16copt099.crc.nd.edu 155 114 12 9 10 10 0 0
d32cepyc020.crc.nd.edu 152 146 3 0 0 1 2 0
q16copt025.crc.nd.edu 143 93 16 13 11 9 0 1
d32cepyc019.crc.nd.edu 142 142 0 0 0 0 0 0