Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
reco_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0 0 4 994 500 4 994 500 10 000 10 000 9 989 0 11 0 2 0 99.9 % 0.0 % processed
reco_step_tllq4fNoSchanWNoHiggs0p_all22WCsStartPtCheckV2dim6TopMay20GST_run0 0 4 996 000 4 996 000 10 000 10 000 9 992 0 8 0 2 0 99.9 % 0.0 % processed
reco_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 324 194 5 324 194 30 000 30 000 29 972 0 28 0 0 0 99.9 % 0.0 % processed
reco_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 399 244 5 399 244 35 000 35 000 34 975 0 25 0 3 0 99.9 % 0.0 % processed
reco_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 6 047 771 6 047 771 25 000 25 000 24 977 0 23 0 3 0 99.9 % 0.0 % processed
Total 0 26 761 709 26 761 709 110 000 110 000 109 905 0 95 0 10 0 99.9 % 0.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 110352 0 54974
root 110309 0 54911 63

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 2 444642 179145
143 209 495271 491756 490634 490391 488086 487698 487267 487208 486896 484564
8020 231 556407 556406 556405 556404 552261 552260 552259 552258 552257 552256
8021 24 445174 445169 445133 444992 444489 444201 170335 170247 170203 170163
10001 2 167971 166052
10040 8 174726 174028 173954 173714 171640 171551 171227 170911

Hosts with Task Failures

Hostname Exit Codes
All 8020 143 8021 -11 10040
q16copt043.crc.nd.edu 31 27 4 0 0 0
d32cepyc020.crc.nd.edu 8 6 2 0 0 0
d32cepyc014.crc.nd.edu 8 3 4 0 0 1
q16copt121.crc.nd.edu 7 4 3 0 0 0
d12chas323.crc.nd.edu 6 3 3 0 0 0
d12chas216.crc.nd.edu 6 2 1 2 1 0
d32cepyc017.crc.nd.edu 6 2 4 0 0 0
q16copt006.crc.nd.edu 6 1 5 0 0 0
d32cepyc021.crc.nd.edu 5 3 1 1 0 0
q16copt067.crc.nd.edu 5 1 3 1 0 0