Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut25_run0 0 245 713 245 713 1 600 1 600 1 467 0 0 0 0 16 91.7 % 0.0 % processed
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut15_run0 0 268 225 268 225 1 600 1 600 1 597 0 0 0 0 0 99.8 % 0.0 % processed
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut19_run0 0 264 710 264 710 1 600 1 600 1 572 0 0 0 0 2 98.2 % 0.0 % processed
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut25_run1 0 260 550 260 550 1 600 1 600 1 600 0 0 0 0 0 100.0 % 0.0 % processed
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut15_run1 0 259 257 259 257 1 600 1 600 1 597 0 0 0 0 0 99.8 % 0.0 % processed
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut19_run1 0 257 050 257 050 1 600 1 600 1 579 0 0 0 0 3 98.7 % 0.0 % processed
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut25_run2 0 239 480 239 480 1 600 1 600 1 486 0 0 0 0 45 92.9 % 0.0 % processed
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut15_run2 0 251 842 251 842 1 600 1 600 1 570 0 0 0 0 0 98.1 % 0.0 % processed
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut19_run2 0 257 206 257 206 1 600 1 600 1 596 0 0 0 0 1 99.8 % 0.0 % processed
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut25_run3 0 254 794 254 794 1 600 1 600 1 561 0 0 0 0 6 97.6 % 0.0 % processed
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut15_run3 0 257 170 257 170 1 600 1 600 1 581 0 0 0 0 0 98.8 % 0.0 % processed
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut19_run3 0 261 021 261 021 1 600 1 600 1 598 0 0 0 0 0 99.9 % 0.0 % processed
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut25_run4 0 268 107 268 107 1 600 1 600 1 597 0 0 0 0 0 99.8 % 0.0 % processed
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut15_run4 0 254 203 254 203 1 600 1 600 1 512 0 0 0 0 26 94.5 % 0.0 % processed
digi_step_ttHJet_cptcptHanV4ttHjetAxisScanAxisScanqCut19_run4 0 267 913 267 913 1 600 1 600 1 588 0 0 0 0 3 99.3 % 0.0 % processed
Total 0 3 867 241 3 867 241 24 000 24 000 23 501 0 0 0 0 102 97.9 % 0.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 23887 0 23501
root 23887 0 23478 23

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 35 66885 66739 66365 65590 62558 60310 56609 55980 54496 53202
-6 4 44036 38305 16504 11556
85 8 66267 64353 60338 58979 28984 22465 9687 8797
92 2 16107 6280
8001 5 55026 52372 21743 18608 4799
8006 1 25680
8020 7 58484 58141 57090 30036 25048 23698 18174
8021 135 66351 66207 65840 65716 65454 64988 64986 64924 64815 64814
8028 189 67173 66744 66724 66358 65931 65896 65886 65874 65463 65385
10001 6 56342 41672 34732 29285 25302 10056

Hosts with Task Failures

Hostname Exit Codes
All 8028 8021 -11 8020
qa-rtx6k-010.crc.nd.edu 8 3 3 1 1
qa-rtx6k-022.crc.nd.edu 8 2 3 1 2
d64cepyc001.crc.nd.edu 7 2 2 3 0
qa-v100-004.crc.nd.edu 7 4 2 0 1
q16copt099.crc.nd.edu 6 2 4 0 0
qa-v100-005.crc.nd.edu 6 4 1 1 0
q16copt054.crc.nd.edu 5 5 0 0 0
q16copt001.crc.nd.edu 5 3 2 0 0
q16copt060.crc.nd.edu 5 3 2 0 0
q16copt093.crc.nd.edu 5 2 2 1 0