Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0 0 4 967 500 4 967 500 10 000 10 000 9 935 0 35 0 35 2 99.3 % 0.0 % processed
sim_step_tllq4fNoSchanWNoHiggs0p_all22WCsStartPtCheckV2dim6TopMay20GST_run0 0 4 939 500 4 939 500 10 000 10 000 9 879 0 96 0 96 2 98.8 % 0.0 % processed
sim_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 288 995 5 288 995 30 000 30 000 29 772 0 228 0 228 0 99.2 % 0.0 % processed
sim_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 375 779 5 375 779 35 000 35 000 34 800 0 192 0 192 2 99.4 % 0.0 % processed
sim_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 6 037 055 6 037 055 25 000 25 000 24 928 0 62 0 62 1 99.7 % 0.0 % processed
Total 0 26 608 829 26 608 829 110 000 110 000 109 314 0 613 0 613 7 99.4 % 0.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 221758 0 113260
root 76413 0 56939 2528

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 2 334204 94027
143 2301 918502 912057 818439 798884 786975 703555 696034 573391 571658 547285
179 85950 470285 470283 470281 470278 470277 470276 470224 470201 470148 470144
210 3829 540808 540788 540310 539738 469907 469885 469793 469791 469731 469649
211 117 540314 540292 540288 540115 539806 539785 539731 539718 538482 538480
8016 297 916457 906228 858199 796785 786362 777457 761268 758927 742935 740666
8020 19518 905499 905442 905423 905412 905409 905274 905264 905263 905262 905261
8021 2964 543458 543327 543326 543324 543318 543315 543177 543176 543174 542960
10001 2 887092 664872

Hosts with Task Failures

Hostname Exit Codes
All 179 8020 210 143 8021 8016 211
d32cepyc004.crc.nd.edu 790 563 176 17 18 12 2 2
d32cepyc017.crc.nd.edu 693 516 139 13 12 12 0 1
d32cepyc026.crc.nd.edu 692 458 190 17 11 13 0 3
d32cepyc047.crc.nd.edu 678 543 88 17 17 12 1 0
d32cepyc006.crc.nd.edu 658 485 132 9 17 14 1 0
d32cepyc038.crc.nd.edu 644 496 128 9 4 7 0 0
d32cepyc032.crc.nd.edu 637 429 174 16 9 7 2 0
d32cepyc027.crc.nd.edu 635 464 160 3 2 2 2 2
d32cepyc041.crc.nd.edu 631 421 175 11 13 6 3 2
d32cepyc019.crc.nd.edu 624 456 136 14 8 9 1 0