Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
mAOD_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0 0 4 955 500 4 955 500 10 000 10 000 9 911 9 911 89 0 0 0 99.1 % 99.1 % processed
mAOD_step_tllq4fNoSchanWNoHiggs0p_all22WCsStartPtCheckV2dim6TopMay20GST_run0 0 4 991 000 4 991 000 10 000 10 000 9 982 9 982 18 0 0 0 99.8 % 99.8 % processed
mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 321 600 5 321 600 30 000 30 000 29 943 29 943 57 0 0 0 99.8 % 99.8 % processed
mAOD_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 366 235 5 366 235 35 000 35 000 34 744 34 729 256 0 2 0 99.3 % 99.2 % processed
mAOD_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 6 037 054 6 037 054 25 000 25 000 24 915 24 915 85 0 0 0 99.7 % 99.7 % processed
Total 0 26 671 389 26 671 389 110 000 110 000 109 495 109 480 505 0 2 0 99.5 % 99.5 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 105934 0 46970
root 103712 0 46187 84

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

Task Resources

Task Timing

statisticsprofile show timeline breakdown

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 1 503273
143 19 257530 257528 257131 256783 195022 194916 194915 194564 192585 191264
179 66 188329 188300 187743 180762 98161 97968 97714 97016 94694 93992
210 12 187525 187461 187460 186862 186609 182280 178850 178741 79366 78296
8020 702 608952 608951 608950 608949 608948 608947 608946 608945 608944 608943
8021 13 187544 186295 186227 185452 180368 179640 179541 79130 74340 73982
10001 1 75749

Hosts with Task Failures

Hostname Exit Codes
All 8020 179 10001
d12chas307.crc.nd.edu 57 57 0 0
d6cneh001.crc.nd.edu 26 26 0 0
q16copt091.crc.nd.edu 17 17 0 0
d32cepyc005.crc.nd.edu 12 8 3 1
d32cepyc004.crc.nd.edu 9 9 0 0
d32cepyc050.crc.nd.edu 7 7 0 0
d32cepyc051.crc.nd.edu 6 6 0 0
d32cepyc047.crc.nd.edu 6 6 0 0
d32cepyc057.crc.nd.edu 5 5 0 0
d32cepyc048.crc.nd.edu 5 5 0 0