Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
mAOD_step_ttHJet_HanV4ttXJetStartPtChecks_run2 0 6 402 442 6 402 442 40 000 40 000 40 000 40 000 0 0 0 0 100.0 % 100.0 % processed
mAOD_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2 0 5 654 332 5 654 332 40 000 40 000 40 000 40 000 0 0 0 0 100.0 % 100.0 % processed
mAOD_step_ttlnuJet_HanV4ttXJetStartPtChecks_run1 0 4 897 636 4 897 636 20 000 20 000 20 000 20 000 0 0 0 0 100.0 % 100.0 % processed
Total 0 16 954 410 16 954 410 100 000 100 000 100 000 100 000 0 0 0 0 100.0 % 100.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 100143 0 40754
root 106750 0 0 40754
gsiftp 0 0 589 0

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

Task Resources

Task Timing

statisticsprofile show timeline breakdown

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 70 298508 298501 298474 298437 298412 298410 298409 298333 298301 298215
-4 225 298496 298489 298481 298472 298449 298430 298429 298421 298418 298415
143 1 222075
210 9 269200 268575 268572 268183 268181 268175 268140 267720 267214
8020 320 298460 298422 298388 298386 298383 298372 298357 298307 298250 298244
8021 1310 298511 298509 298503 298498 298485 298479 298478 298477 298469 298463
10001 321 298495 298475 298471 298466 298459 298457 298439 298435 298432 298431

Hosts with Task Failures

Hostname Exit Codes
All 8021 10001 8020 -4 -11 210 143
d12chas534.crc.nd.edu 32 18 6 6 1 0 0 1
d12chas541.crc.nd.edu 31 19 0 4 6 2 0 0
d12chas078.crc.nd.edu 31 14 9 5 1 2 0 0
d12chas537.crc.nd.edu 28 19 4 3 2 0 0 0
d12chas237.crc.nd.edu 27 14 4 3 5 1 0 0
d12chas192.crc.nd.edu 25 17 2 3 2 1 0 0
d8civy059.crc.nd.edu 24 13 2 3 5 1 0 0
d12chas538.crc.nd.edu 24 16 3 2 2 1 0 0
q16copt065.crc.nd.edu 24 12 7 4 1 0 0 0
d12chas303.crc.nd.edu 23 15 4 2 0 1 1 0