Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
digi_step_tHq4f_testUpdateGenproddim6TopMay20GST_run2 0 99 500 99 500 200 200 199 0 1 0 1 0 99.5 % 0.0 % processed
digi_step_tllq4fNoSchanWNoHiggs0p_testUpdateGenproddim6TopMay20GST_run1 0 98 000 98 000 200 200 196 0 4 0 4 0 98.0 % 0.0 % processed
digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1 0 94 544 94 544 620 620 618 0 2 0 2 0 99.7 % 0.0 % processed
digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2 0 97 842 97 842 720 720 719 0 1 0 1 0 99.9 % 0.0 % processed
digi_step_ttlnuJet_testUpdateGenproddim6TopMay20GST_run1 0 99 296 99 296 420 420 418 0 2 0 2 0 99.5 % 0.0 % processed
Total 0 489 182 489 182 2 160 2 160 2 150 0 10 0 10 0 99.5 % 0.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 3713 0 2500
root 1266 0 900 524

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 2 12145 6494
-6 72 10299 9837 9821 9816 9779 9763 9759 9743 9718 9612
85 2 7693 4929
143 94 15197 13557 13151 13121 12184 11259 11258 11253 11245 11241
179 121 8899 8843 8842 8800 8734 8729 8703 8695 8672 8660
190 3 7564 7238 6157
210 336 8847 8238 8233 8202 8183 8181 8180 8178 8176 8159
211 14 9327 7927 6190 6010 5784 5752 5702 5476 4955 4937
8001 1 6410
8020 387 14672 14664 14630 14615 14607 14604 14597 14584 14572 14565
8021 625 13580 13321 13314 13235 13234 13194 13190 13150 13115 13061
10001 62 13361 9877 9856 9851 9831 9828 9735 9398 9241 8991

Hosts with Task Failures

Hostname Exit Codes
All 8021 8020 210 179 -6 10001 143
d64cepyc005.crc.nd.edu 29 10 11 4 1 2 1 0
d64cepyc008.crc.nd.edu 27 12 5 8 0 1 0 1
d64cepyc009.crc.nd.edu 24 9 8 5 1 0 0 1
d64cepyc006.crc.nd.edu 19 9 7 0 1 0 2 0
d12chas013.crc.nd.edu 13 6 5 0 1 1 0 0
d32cepyc033.crc.nd.edu 13 4 3 4 0 0 1 1
d32cepyc031.crc.nd.edu 12 7 2 1 2 0 0 0
d12chas097.crc.nd.edu 11 7 2 1 1 0 0 0
qa-rtx6k-011.crc.nd.edu 10 4 3 2 1 0 0 0
d12chas065.crc.nd.edu 9 4 1 3 0 0 0 1