Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
mAOD_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0 0 7 500 000 7 500 000 15 000 15 000 15 000 15 000 0 0 0 0 100.0 % 100.0 % processed
mAOD_step_tllq4fNoSchanWNoHiggs0p_all22WCsStartPtCheckV2dim6TopMay20GST_run0 0 7 500 000 7 500 000 15 000 15 000 15 000 15 000 0 0 0 0 100.0 % 100.0 % processed
mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 7 994 185 7 994 185 45 000 45 000 44 999 44 999 1 0 0 0 100.0 % 100.0 % processed
mAOD_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0 0 8 104 545 8 104 545 52 500 52 500 52 500 52 500 0 0 0 0 100.0 % 100.0 % processed
mAOD_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 9 081 864 9 081 864 37 500 37 500 37 500 37 500 0 0 0 0 100.0 % 100.0 % processed
mAOD_step_tttt_FourtopsMay3v1_run0 0 7 500 000 7 500 000 15 000 15 000 15 000 15 000 0 0 0 0 100.0 % 100.0 % processed
Total 0 47 680 594 47 680 594 180 000 180 000 179 999 179 999 1 0 0 0 100.0 % 100.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 165523 0 75702
root 147074 0 66199 393
gsiftp 0 0 50 0

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

Task Resources

Task Timing

statisticsprofile show timeline breakdown

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
143 17 644412 644331 644330 644277 644275 644271 644267 644265 644199 644074
179 10 696204 696182 696175 696173 696171 696130 696128 645750 645746 645740
8002 46 557394 557393 557392 557391 557390 557389 557388 556956 556955 556954
8020 1 311385
8021 60 916102 915908 915850 915507 915498 915456 915419 915280 915200 915139
10040 2 697932 470060

Hosts with Task Failures

Hostname Exit Codes
All 8021 8002 179 143
d8civy100.crc.nd.edu 4 1 3 0 0
d32cepyc013.crc.nd.edu 3 2 1 0 0
d32cepyc054.crc.nd.edu 3 0 2 1 0
d32cepyc022.crc.nd.edu 3 1 2 0 0
q16copt031.crc.nd.edu 2 0 0 2 0
d32cepyc030.crc.nd.edu 2 2 0 0 0
d12chas539.crc.nd.edu 2 1 0 1 0
q16copt055.crc.nd.edu 2 1 0 0 1
d32cepyc051.crc.nd.edu 2 2 0 0 0
d6cneh035.crc.nd.edu 2 2 0 0 0