Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
nAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GSTqCut15_run0 0 1 031 390 1 031 390 654 654 650 650 4 0 4 0 99.4 % 99.4 % processed
nAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GSTqCut25_run0 0 995 606 995 606 640 640 626 626 14 0 14 0 97.8 % 97.8 % processed
nAOD_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GSTqCut15_run0 0 1 053 798 1 053 798 570 570 569 569 1 0 1 0 99.8 % 99.8 % processed
nAOD_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GSTqCut25_run0 0 1 045 608 1 045 608 582 582 574 574 8 0 8 0 98.6 % 98.6 % processed
nAOD_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GSTqCut15_run0 0 1 115 428 1 115 428 800 800 768 768 32 0 32 0 96.0 % 96.0 % processed
nAOD_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GSTqCut25_run0 0 1 171 267 1 171 267 814 814 807 807 7 0 7 0 99.1 % 99.1 % processed
Total 0 6 413 097 6 413 097 4 060 4 060 3 994 3 994 66 0 66 0 98.4 % 98.4 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 6502 0 4221
root 10165 0 3840 381

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

Task Resources

Task Timing

statisticsprofile show timeline breakdown

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 1 1754
143 4 427 423 418 415
179 193 1319 1318 1317 1316 1315 1314 1313 1310 1308 1307
210 194 970 968 967 966 960 958 957 956 955 954
211 2 896 585
8020 1994 6411 6409 6407 6406 6405 6403 6402 6401 6400 6399

Hosts with Task Failures

Hostname Exit Codes
All 8020 210 179 211
q16copt058.crc.nd.edu 82 73 1 8 0
d32cepyc016.crc.nd.edu 79 66 13 0 0
d32cepyc015.crc.nd.edu 76 62 13 1 0
d32cepyc010.crc.nd.edu 75 69 6 0 0
q16copt078.crc.nd.edu 65 63 1 0 1
q16copt001.crc.nd.edu 55 51 4 0 0
q16copt009.crc.nd.edu 51 47 3 1 0
q16copt064.crc.nd.edu 44 40 2 2 0
d32cepyc013.crc.nd.edu 16 10 4 2 0
qa-rtx6k-039.crc.nd.edu 14 13 1 0 0