Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
reco_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0 0 4 876 500 4 876 500 10 000 10 000 9 753 0 160 1 22 87 97.5 % 0.0 % processed
reco_step_tllq4fNoSchanWNoHiggs0p_all22WCsStartPtCheckV2dim6TopMay20GST_run0 0 4 750 500 4 750 500 10 000 10 000 9 501 0 193 0 8 298 95.0 % 0.0 % processed
reco_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 198 818 5 198 818 30 000 30 000 29 265 0 735 0 88 0 97.5 % 0.0 % processed
reco_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 288 420 5 288 420 35 000 35 000 34 236 0 756 0 129 8 97.8 % 0.0 % processed
reco_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 949 501 5 949 501 25 000 25 000 24 566 0 424 0 126 10 98.3 % 0.0 % processed
Total 0 26 063 739 26 063 739 110 000 110 000 107 321 0 2 268 1 373 403 97.6 % 0.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 130420 0 53817
root 116089 0 51458 708

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 5 861013 815333 812994 810305 346810
84 1 350800
143 733 833251 833250 833249 833248 833247 833246 833245 833244 833243 833242
179 4527 467930 467928 467866 467693 467692 467691 467639 467638 467637 467636
210 120 517308 469259 469034 468631 468630 467400 467336 467073 466680 466326
211 8 536598 512410 465208 462190 459874 105005 102330 77312
8020 6460 913772 912993 912840 912025 911947 911868 911718 911576 911558 911462
8021 484 668045 543393 543342 543338 542856 542855 542799 542661 542660 542312
10001 3 906411 906010 862123
10040 19 544961 544959 544389 536592 535592 535072 535070 535069 522166 521601

Hosts with Task Failures

Hostname Exit Codes
All 8020 179 8021 143 210 10040 84 211
d32cepyc027.crc.nd.edu 110 60 46 2 1 0 1 0 0
d32cepyc025.crc.nd.edu 107 62 38 2 2 2 0 1 0
d32cepyc062.crc.nd.edu 93 45 40 5 2 0 0 0 1
d32cepyc026.crc.nd.edu 93 42 46 2 2 1 0 0 0
d32cepyc035.crc.nd.edu 88 52 31 2 3 0 0 0 0
d32cepyc055.crc.nd.edu 87 50 25 6 5 1 0 0 0
d32cepyc021.crc.nd.edu 87 46 32 6 2 0 1 0 0
q16copt018.crc.nd.edu 87 17 66 1 3 0 0 0 0
d32cepyc016.crc.nd.edu 87 64 18 2 1 1 1 0 0
d64cepyc001.crc.nd.edu 65 65 0 0 0 0 0 0 0