Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut25_run0 0 134 595 134 595 1 600 1 600 805 0 0 0 0 713 50.3 % 0.0 % processed
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut15_run0 0 211 811 211 811 1 600 1 600 1 263 0 0 0 0 277 78.9 % 0.0 % processed
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut19_run0 0 162 463 162 463 1 600 1 600 968 0 0 0 0 549 60.5 % 0.0 % processed
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut25_run1 0 145 974 145 974 1 600 1 600 897 0 0 0 0 643 56.1 % 0.0 % processed
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut15_run1 0 186 877 186 877 1 600 1 600 1 154 0 0 0 0 372 72.1 % 0.0 % processed
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut19_run1 0 119 913 119 913 1 600 1 600 737 0 0 0 0 784 46.1 % 0.0 % processed
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut25_run2 0 155 853 155 853 1 600 1 600 970 0 0 0 0 555 60.6 % 0.0 % processed
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut15_run2 0 183 740 183 740 1 600 1 600 1 145 0 0 0 0 381 71.6 % 0.0 % processed
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut19_run2 0 134 912 134 912 1 600 1 600 841 0 0 0 0 674 52.6 % 0.0 % processed
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut25_run3 0 126 046 126 046 1 600 1 600 779 0 0 0 0 740 48.7 % 0.0 % processed
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut15_run3 0 116 308 116 308 1 600 1 600 721 0 0 0 0 800 45.1 % 0.0 % processed
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut19_run3 0 190 305 190 305 1 600 1 600 1 168 0 0 0 0 362 73.0 % 0.0 % processed
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut25_run4 0 167 088 167 088 1 600 1 600 997 0 0 0 0 521 62.3 % 0.0 % processed
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut15_run4 0 114 464 114 464 1 600 1 600 679 0 0 0 0 841 42.4 % 0.0 % processed
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut19_run4 0 147 606 147 606 1 600 1 600 877 0 0 0 0 640 54.8 % 0.0 % processed
Total 0 2 297 955 2 297 955 24 000 24 000 14 001 0 0 0 0 8 852 58.3 % 0.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 14638 0 14001
root 14638 0 13992 9

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 19 40522 40175 39721 38965 38018 36834 36503 35332 30598 30439
-6 2 21215 11238
85 5 40023 40017 32881 17945 9932
8001 1 23946
8020 13 37683 37674 35447 33850 31928 28859 23419 21827 21109 18969
8021 139 41021 40514 39965 39605 39264 38486 38256 37856 37807 37746
8028 458 41374 41253 40994 40721 40686 40659 40549 40524 40200 39990
10001 1 35481

Hosts with Task Failures

Hostname Exit Codes
All 8028 8021 -11
q16copt006.crc.nd.edu 9 4 3 2
qa-rtx6k-010.crc.nd.edu 9 6 2 1
q16copt031.crc.nd.edu 7 6 1 0
q16copt068.crc.nd.edu 7 4 1 2
qa-rtx6k-043.crc.nd.edu 7 6 1 0
qa-rtx6k-012.crc.nd.edu 7 5 2 0
qa-v100-005.crc.nd.edu 7 5 2 0
q16copt012.crc.nd.edu 7 6 1 0
q16copt099.crc.nd.edu 7 4 2 1
qa-xp-009.crc.nd.edu 6 5 1 0