Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
digi_step_tHq4f_HanV4startPt2017DataLimsMatchOff_run0 0 200 000 200 000 400 400 400 0 0 0 0 0 100.0 % 0.0 % processed
digi_step_tHq4f_HanV4startPt2017DataLimsMatchOff_run1 0 200 000 200 000 400 400 400 0 0 0 0 0 100.0 % 0.0 % processed
digi_step_tllq4fNoSchanWNoHiggs0p_HanV4startPt2017DataLimsMatchOff_run0 0 200 000 200 000 400 400 400 0 0 0 0 0 100.0 % 0.0 % processed
digi_step_tllq4fNoSchanWNoHiggs0p_HanV4startPt2017DataLimsMatchOff_run1 0 200 000 200 000 400 400 400 0 0 0 0 0 100.0 % 0.0 % processed
digi_step_ttHJet_HanV4startPt2017DataLims_run0 0 246 782 246 782 1 600 1 600 1 599 0 1 1 0 0 99.9 % 0.0 % processed
digi_step_ttHJet_HanV4startPt2017DataLims_run1 0 253 654 253 654 1 600 1 600 1 597 0 1 1 0 0 99.8 % 0.0 % processed
digi_step_ttllNuNuJetNoHiggs_HanV4startPt2017DataLims_run0 0 222 312 222 312 1 600 1 600 1 600 0 0 0 0 0 100.0 % 0.0 % processed
digi_step_ttllNuNuJetNoHiggs_HanV4startPt2017DataLims_run1 0 226 626 226 626 1 600 1 600 1 600 0 0 0 0 0 100.0 % 0.0 % processed
digi_step_ttlnuJet_HanV4startPt2017DataLims_run0 0 193 255 193 255 800 800 799 0 0 0 0 0 99.9 % 0.0 % processed
digi_step_ttlnuJet_HanV4startPt2017DataLims_run1 0 192 234 192 234 800 800 800 0 0 0 0 0 100.0 % 0.0 % processed

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 9265 580 9034 561

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 6 23815 14756 12774 7545 973 769
-6 2 23035 20597
85 1 26937
8001 5 23337 19506 19488 11573 4995
8020 2 17182 2235
8021 119 29927 29756 29350 29248 28852 28772 28367 28282 27867 27825
8028 115 35347 34331 33348 32595 31884 31275 30646 29928 29297 29254

Hosts with Task Failures

Hostname Exit Codes
All 8028 8021 -6 -11 8020
d12chas576.crc.nd.edu 15 6 8 0 1 0
d12chas582.crc.nd.edu 13 6 6 0 0 1
d12chas556.crc.nd.edu 10 6 3 1 0 0
d12chas544.crc.nd.edu 10 3 7 0 0 0
d12chas590.crc.nd.edu 10 6 4 0 0 0
d12chas562.crc.nd.edu 9 6 3 0 0 0
d12chas574.crc.nd.edu 9 6 3 0 0 0
d12chas584.crc.nd.edu 9 5 4 0 0 0
d12chas575.crc.nd.edu 8 1 7 0 0 0
d12chas563.crc.nd.edu 7 4 3 0 0 0