Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
digi_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0 0 4 961 500 4 961 500 10 000 10 000 9 923 0 77 0 34 0 99.2 % 0.0 % processed
digi_step_tllq4fNoSchanWNoHiggs0p_all22WCsStartPtCheckV2dim6TopMay20GST_run0 0 4 995 000 4 995 000 10 000 10 000 9 990 0 10 0 2 0 99.9 % 0.0 % processed
digi_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 322 474 5 322 474 30 000 30 000 29 948 0 52 0 15 0 99.8 % 0.0 % processed
digi_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 373 567 5 373 567 35 000 35 000 34 791 0 209 0 84 0 99.4 % 0.0 % processed
digi_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 6 040 384 6 040 384 25 000 25 000 24 929 0 71 0 30 0 99.7 % 0.0 % processed
Total 0 26 692 925 26 692 925 110 000 110 000 109 581 0 419 0 165 0 99.6 % 0.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 125910 0 110241
root 108332 0 96952 807

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 22 564351 545521 538790 531845 518077 495104 457072 455506 430009 413831
-6 600 573398 573382 573377 557275 549481 549321 548908 542781 539676 537016
84 1 56321
85 39 520265 470654 458824 446906 428960 413431 411040 408510 405898 399182
143 792 597810 590901 573019 569065 561512 557270 545258 518838 518820 509358
179 3202 189266 189265 189264 189262 189261 189260 189259 189258 189255 189197
190 52 505507 485515 484732 483753 480858 474561 463027 459454 454838 452792
210 654 187053 186887 186884 186882 186881 186879 186878 186877 186874 186848
211 6 194783 193896 181380 181063 100600 41532
8020 5766 601321 601299 601298 601297 601288 601264 601263 601262 601261 601260
8021 5810 596971 591159 591109 590945 590900 590806 590805 590804 590802 589941
8028 177 584096 542333 542300 541204 540183 529623 489173 486654 463375 454196
10001 618 576838 549327 542824 537041 528155 527954 525250 523604 519297 514533

Hosts with Task Failures

Hostname Exit Codes
All 8020 8021 179 10001 -6 210 8028 143 85 190
d32cepyc018.crc.nd.edu 180 66 64 25 11 7 4 1 1 0 1
d32cepyc022.crc.nd.edu 171 69 52 34 6 4 3 2 0 1 0
d32cepyc001.crc.nd.edu 165 66 44 29 10 3 6 2 3 1 1
d32cepyc057.crc.nd.edu 162 66 50 20 9 9 2 2 2 2 0
d32cepyc058.crc.nd.edu 153 74 36 28 3 2 6 0 2 0 1
d32cepyc003.crc.nd.edu 153 62 54 22 3 5 4 1 1 1 0
d32cepyc012.crc.nd.edu 151 64 49 22 2 7 4 2 1 0 0
d32cepyc006.crc.nd.edu 143 45 45 28 9 7 5 2 1 0 0
d32cepyc007.crc.nd.edu 139 56 55 9 4 7 4 2 0 1 1
d32cepyc002.crc.nd.edu 136 60 45 4 8 9 7 1 1 1 0