Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
mAOD_step_tllq4fNoSchanWNoHiggs0p_HanV4Model16DttllScanpointsXQCUT0MatchOff_run1 0 9 999 500 9 999 500 20 000 20 000 19 999 19 999 1 0 0 0 100.0 % 100.0 % processed
Total 0 9 999 500 9 999 500 20 000 20 000 19 999 19 999 1 0 0 0 100.0 % 100.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 22643 0 10069
root 22641 0 0 10069
gsiftp 0 0 7 0

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

Task Resources

Task Timing

statisticsprofile show timeline breakdown

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 19 63302 62471 61605 61603 61596 60783 60689 56270 55811 55802
-4 64 65533 65506 65470 65445 65353 64966 64955 64862 64689 64687
8020 188 65490 65449 65424 65419 65386 65348 65261 65192 65121 65120
8021 980 65553 65552 65547 65545 65517 65515 65491 65469 65455 65442
10001 123 65551 65535 65484 65429 65426 65421 65352 65351 65301 65253
10040 552 65541 65534 65529 65516 65267 64089 53773 46557 46556 46555

Hosts with Task Failures

Hostname Exit Codes
All 8021 10040 8020 10001 -4 -11
d64cepyc002.crc.nd.edu 58 28 17 3 7 3 0
q16copt045.crc.nd.edu 37 26 4 5 2 0 0
q16copt052.crc.nd.edu 36 12 12 5 6 1 0
d12chas326.crc.nd.edu 32 13 12 3 3 0 1
d64cepyc003.crc.nd.edu 28 22 1 1 3 1 0
q16copt044.crc.nd.edu 27 11 8 4 2 2 0
d12chas124.crc.nd.edu 26 12 13 1 0 0 0
q16copt050.crc.nd.edu 25 14 4 2 4 0 1
d12chas324.crc.nd.edu 24 8 12 2 2 0 0
qa-1080ti-013.crc.nd.edu 23 5 12 4 1 1 0