Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
sim_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GSTqCut25_run0 0 3 752 049 3 752 049 30 000 30 000 21 190 0 0 0 0 8 583 70.6 % 0.0 % processed
sim_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GSTqCut15_run0 0 4 101 835 4 101 835 30 000 30 000 23 122 0 0 0 0 6 724 77.1 % 0.0 % processed
sim_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GSTqCut20_run0 0 4 529 763 4 529 763 30 000 30 000 25 486 0 0 0 0 4 406 85.0 % 0.0 % processed
sim_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GSTqCut25_run0 0 3 932 795 3 932 795 35 000 35 000 25 495 0 0 0 0 9 352 72.8 % 0.0 % processed
sim_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GSTqCut15_run0 0 3 362 388 3 362 388 35 000 35 000 21 826 0 0 0 0 12 957 62.4 % 0.0 % processed
sim_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GSTqCut20_run0 0 3 002 415 3 002 415 35 000 35 000 19 445 0 0 0 0 15 309 55.6 % 0.0 % processed
sim_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GSTqCut25_run0 0 4 577 090 4 577 090 25 000 25 000 18 983 0 1 1 0 5 932 75.9 % 0.0 % processed
sim_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GSTqCut15_run0 0 2 875 584 2 875 584 25 000 25 000 11 880 0 0 0 0 12 778 47.5 % 0.0 % processed
sim_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GSTqCut20_run0 0 4 369 820 4 369 820 25 000 25 000 18 043 0 0 0 0 6 786 72.2 % 0.0 % processed
Total 0 34 503 739 34 503 739 270 000 270 000 185 470 0 1 1 0 82 827 68.7 % 0.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 196769 0 190229
root 12943 0 12203 643
gsiftp 0 0 494 0

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
143 867 681596 681571 681339 680865 680843 680821 680260 680258 680257 680249
179 5796 633093 633092 633091 633090 633089 633088 633087 633086 633085 633084
210 4780 614940 614939 614938 614937 614936 614934 614933 614932 614877 614876
211 3 682472 263541 80540
8016 432 683910 676088 673894 670705 667459 664205 661872 660935 659217 655380
8020 356 682641 682607 682519 682512 682509 682505 682485 682478 682476 682473
8021 294 681901 681896 681570 681558 681549 681511 681471 681354 681342 681336

Hosts with Task Failures

Hostname Exit Codes
All 179 210 143 8016 8021 8020
q16copt076.crc.nd.edu 96 56 28 7 2 2 1
d32cepyc028.crc.nd.edu 95 56 31 1 4 1 2
d32cepyc007.crc.nd.edu 92 71 15 1 0 3 2
q16copt068.crc.nd.edu 89 54 23 10 1 1 0
d32cepyc040.crc.nd.edu 87 56 26 0 3 1 1
d32cepyc056.crc.nd.edu 86 50 26 2 5 2 1
q16copt066.crc.nd.edu 84 58 13 9 2 1 1
d32cepyc024.crc.nd.edu 81 60 15 1 1 2 2
d32cepyc015.crc.nd.edu 78 65 10 0 1 0 2
q16copt060.crc.nd.edu 77 44 16 8 4 3 2