Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
digi_step_tHq4f_testUpdateGenproddim6TopMay20GST_run2 0 98 500 98 500 200 200 197 0 3 0 3 0 98.5 % 0.0 % processed
digi_step_tllq4fNoSchanWNoHiggs0p_testUpdateGenproddim6TopMay20GST_run1 0 98 000 98 000 200 200 196 0 4 0 4 0 98.0 % 0.0 % processed
digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1 0 92 289 92 289 620 620 603 0 17 0 17 0 97.3 % 0.0 % processed
digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2 0 96 453 96 453 720 720 709 0 11 0 11 0 98.5 % 0.0 % processed
digi_step_ttlnuJet_testUpdateGenproddim6TopMay20GST_run1 0 94 343 94 343 420 420 397 0 23 0 23 0 94.5 % 0.0 % processed
Total 0 479 585 479 585 2 160 2 160 2 102 0 58 0 58 0 97.3 % 0.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 4506 0 2109
root 3961 0 1797 312

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 1 8867
-6 34 8203 7160 7155 7139 6861 6740 6701 6608 6597 6596
143 237 13784 13606 13534 13286 9252 8934 8931 8922 8895 8893
190 1 7019
211 7 7017 6733 5735 5629 5221 4748 4427
8020 1818 16086 16061 16060 16059 16026 16010 15992 15984 15983 15982
8021 543 16468 16463 16438 16428 16419 16402 16397 16390 13924 13442
10001 17 9403 7047 5836 5771 5763 5694 5305 5294 5245 5030

Hosts with Task Failures

Hostname Exit Codes
All 8020 8021 143 -6 10001
q16copt016.crc.nd.edu 31 19 4 8 0 0
d32cepyc006.crc.nd.edu 31 24 6 0 0 1
d32cepyc010.crc.nd.edu 28 24 4 0 0 0
q16copt006.crc.nd.edu 27 22 2 3 0 0
d12chas243.crc.nd.edu 11 11 0 0 0 0
d12chas079.crc.nd.edu 11 4 4 2 1 0
d12chas252.crc.nd.edu 10 9 1 0 0 0
d12chas020.crc.nd.edu 10 5 5 0 0 0
d12chas075.crc.nd.edu 8 7 1 0 0 0
d12chas014.crc.nd.edu 8 7 1 0 0 0