Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
digi_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0 0 4 996 500 4 996 500 10 000 10 000 9 993 0 7 0 4 0 99.9 % 0.0 % processed
digi_step_tllq4fNoSchanWNoHiggs0p_all22WCsStartPtCheckV2dim6TopMay20GST_run0 0 4 997 000 4 997 000 10 000 10 000 9 994 0 6 0 2 0 99.9 % 0.0 % processed
digi_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 324 194 5 324 194 30 000 30 000 29 972 0 28 0 13 0 99.9 % 0.0 % processed
digi_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 400 309 5 400 309 35 000 35 000 34 982 0 18 0 9 0 99.9 % 0.0 % processed
digi_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 6 050 015 6 050 015 25 000 25 000 24 986 0 14 0 12 0 99.9 % 0.0 % processed
Total 0 26 768 018 26 768 018 110 000 110 000 109 927 0 73 0 40 0 99.9 % 0.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 121686 0 109929
root 121686 0 109609 320

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 20 415781 383485 378844 372409 371900 362074 344168 341777 340854 329512
-6 36 493575 492808 480308 474570 453702 427275 424439 422936 417153 380124
65 1 108121
85 13 498935 450280 417343 358153 283541 280321 268351 229774 180145 139163
86 2 107554 96895
92 2 103453 86610
143 288 507332 500455 500454 500443 500252 496359 496266 496265 495927 491788
190 36 499622 499165 453283 452794 452724 410848 374697 306772 299841 280168
211 2 170214 170209
8001 2 100832 97866
8004 1 447528
8020 2243 552191 549157 549156 549150 549149 549142 549141 549140 549139 549138
8021 6505 543887 543672 543671 543670 543669 543668 543667 543666 543603 543465
8022 4 324491 141863 132354 94540
8028 2892 531997 463203 449339 438584 436737 424493 415276 377308 365979 361965
10001 66 539984 537449 528884 516254 511729 505729 502160 500891 500877 478512
10040 1 151120

Hosts with Task Failures

Hostname Exit Codes
All 8021 8020 8028 10001 190 143 -6 -11 85
d32cepyc020.crc.nd.edu 170 89 44 33 0 2 1 0 1 0
d32cepyc009.crc.nd.edu 146 82 35 23 2 0 0 3 1 0
d32cepyc016.crc.nd.edu 135 71 36 27 0 1 0 0 0 0
d32cepyc015.crc.nd.edu 131 77 29 23 1 0 1 0 0 0
d32cepyc005.crc.nd.edu 128 70 35 22 1 0 0 0 0 0
d32cepyc018.crc.nd.edu 125 75 29 21 0 0 0 0 0 0
d32cepyc019.crc.nd.edu 122 74 26 18 1 0 1 1 1 0
d32cepyc014.crc.nd.edu 119 71 33 14 1 0 0 0 0 0
d32cepyc007.crc.nd.edu 119 67 28 21 1 2 0 0 0 0
d32cepyc013.crc.nd.edu 99 56 19 22 0 0 1 0 0 1