Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
gen_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 000 000 5 000 000 10 000 10 000 10 000 0 0 0 0 0 100.0 % 0.0 % processed
gen_step_tllq4fNoSchanWNoHiggs0p_all22WCsStartPtCheckV2dim6TopMay20GST_run0 0 5 000 000 5 000 000 10 000 10 000 10 000 0 0 0 0 0 100.0 % 0.0 % processed
gen_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 15 000 000 5 329 612 30 000 30 000 30 000 0 0 0 0 0 100.0 % 0.0 % processed
gen_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0 0 17 500 000 5 406 626 35 000 35 000 35 000 0 0 0 0 0 100.0 % 0.0 % processed
gen_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 12 500 000 6 054 455 25 000 25 000 25 000 0 0 0 0 0 100.0 % 0.0 % processed
Total 0 55 000 000 26 790 693 110 000 110 000 110 000 0 0 0 0 0 100.0 % 0.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 206014 0 113860
root 26069 0 24406 1399

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
143 2313 548103 548085 548067 547685 547684 547681 547677 547664 547663 547660
179 89256 470759 470742 470737 470692 470688 470685 470677 470676 470674 470672
210 3659 508132 470245 470117 470100 470054 470046 470042 470035 470030 470028
211 201 541255 540740 540239 539119 518741 509184 473676 473611 473434 470667
8020 2013 545602 545559 545555 538644 538639 538601 538595 538592 538566 538167
8021 1083 515383 467064 466762 466746 466711 466416 466414 466378 466371 466338
10001 11 347607 331219 109980 95147 94931 94920 94918 89474 89463 80530

Hosts with Task Failures

Hostname Exit Codes
All 179 210 143 8020 8021 211
d32cepyc003.crc.nd.edu 1160 1134 9 9 4 3 1
d32cepyc035.crc.nd.edu 1146 1080 19 22 17 7 1
d32cepyc042.crc.nd.edu 1112 1059 14 21 13 5 0
d32cepyc026.crc.nd.edu 855 808 16 13 16 1 1
q16copt036.crc.nd.edu 758 729 11 2 7 9 0
q16copt067.crc.nd.edu 751 715 16 7 2 10 1
q16copt070.crc.nd.edu 702 680 12 3 1 6 0
qa-rtx6k-014.crc.nd.edu 681 650 12 8 7 4 0
d32cepyc027.crc.nd.edu 609 603 1 1 3 1 0
d32cepyc025.crc.nd.edu 587 540 14 16 10 5 2