Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
gs_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut25_run0 0 795 000 266 351 1 600 1 600 1 590 0 0 0 0 0 99.4 % 0.0 % processed
gs_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut15_run0 0 800 000 268 700 1 600 1 600 1 600 0 0 0 0 0 100.0 % 0.0 % processed
gs_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut19_run0 0 800 000 269 474 1 600 1 600 1 600 0 0 0 0 0 100.0 % 0.0 % processed
gs_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut25_run1 0 800 000 260 550 1 600 1 600 1 600 0 0 0 0 0 100.0 % 0.0 % processed
gs_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut15_run1 0 800 000 259 748 1 600 1 600 1 600 0 0 0 0 0 100.0 % 0.0 % processed
gs_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut19_run1 0 799 000 260 137 1 600 1 600 1 598 0 0 0 0 0 99.9 % 0.0 % processed
gs_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut25_run2 0 781 000 251 728 1 600 1 600 1 562 0 0 0 0 0 97.6 % 0.0 % processed
gs_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut15_run2 0 800 000 256 784 1 600 1 600 1 600 0 0 0 0 0 100.0 % 0.0 % processed
gs_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut19_run2 0 800 000 257 850 1 600 1 600 1 600 0 0 0 0 0 100.0 % 0.0 % processed
gs_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut25_run3 0 797 500 260 387 1 600 1 600 1 595 0 0 0 0 0 99.7 % 0.0 % processed
gs_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut15_run3 0 800 000 260 247 1 600 1 600 1 600 0 0 0 0 0 100.0 % 0.0 % processed
gs_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut19_run3 0 800 000 261 374 1 600 1 600 1 600 0 0 0 0 0 100.0 % 0.0 % processed
gs_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut25_run4 0 800 000 268 627 1 600 1 600 1 600 0 0 0 0 0 100.0 % 0.0 % processed
gs_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut15_run4 0 789 500 265 455 1 600 1 600 1 579 0 0 0 0 0 98.7 % 0.0 % processed
gs_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut19_run4 0 799 000 269 612 1 600 1 600 1 598 0 0 0 0 0 99.9 % 0.0 % processed
Total 0 11 961 000 3 937 024 24 000 24 000 23 922 0 0 0 0 0 99.7 % 0.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 23924 0 23922
root 23924 0 23910 12

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 2 24582 1052
143 28 61210 59449 54357 45169 41301 41156 40914 38844 34198 31790
10001 3 38547 34227 16218

Hosts with Task Failures

Hostname Exit Codes
All 143 10001
q16copt073.crc.nd.edu 2 2 0
q16copt040.crc.nd.edu 2 2 0
q16copt069.crc.nd.edu 2 2 0
q16copt031.crc.nd.edu 1 1 0
qa-rtx6k-018.crc.nd.edu 1 0 1
q16copt029.crc.nd.edu 1 1 0
q16copt024.crc.nd.edu 1 1 0
q16copt027.crc.nd.edu 1 1 0
q16copt033.crc.nd.edu 1 1 0
q16copt017.crc.nd.edu 1 1 0