Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
gen_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 000 000 5 000 000 10 000 10 000 10 000 0 0 0 0 0 100.0 % 0.0 % processed
gen_step_tllq4fNoSchanWNoHiggs0p_all22WCsStartPtCheckV2dim6TopMay20GST_run0 0 5 000 000 5 000 000 10 000 10 000 10 000 0 0 0 0 0 100.0 % 0.0 % processed
gen_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 15 000 000 5 330 054 30 000 30 000 30 000 0 0 0 0 0 100.0 % 0.0 % processed
gen_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0 0 17 500 000 5 400 915 35 000 35 000 35 000 0 0 0 0 0 100.0 % 0.0 % processed
gen_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 12 500 000 6 054 051 25 000 25 000 25 000 0 0 0 0 0 100.0 % 0.0 % processed
Total 0 55 000 000 26 785 020 110 000 110 000 110 000 0 0 0 0 0 100.0 % 0.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 112084 0 110553
root 79039 0 77915 1243
gsiftp 0 0 2 0
srm 1 1 0 0

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
143 2490 286804 285849 285847 285658 285656 285250 285050 284216 283016 282563
179 950 293028 291169 284452 284451 284450 284449 280321 37527 37526 37524
185 1 26062
210 470 285844 285655 285613 283022 283020 283018 283014 282571 282570 282567
211 83 276044 147013 146975 146793 146631 35506 35452 35388 35333 35287
8020 284 288866 285850 285848 285845 285651 285251 285249 285046 284448 284215
8021 296 286427 284213 284212 284211 284210 284208 284206 284007 284004 284001
10001 3 28052 27385 27345

Hosts with Task Failures

Hostname Exit Codes
All 143 179 210 8020 8021 211
d64cepyc002.crc.nd.edu 68 34 21 10 2 1 0
d32cepyc044.crc.nd.edu 58 27 10 5 10 3 3
d32cepyc012.crc.nd.edu 57 28 17 6 5 1 0
q16copt120.crc.nd.edu 55 31 15 2 1 5 1
d32cepyc054.crc.nd.edu 51 26 16 2 3 2 2
q16copt081.crc.nd.edu 50 35 10 4 0 1 0
q16copt067.crc.nd.edu 50 34 8 3 0 4 1
d32cepyc036.crc.nd.edu 48 20 9 7 8 3 1
d32cepyc047.crc.nd.edu 48 24 9 6 6 1 2
q16copt034.crc.nd.edu 45 29 3 3 1 9 0