Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
reco_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0 0 4 978 500 4 978 500 10 000 10 000 9 957 0 43 0 11 0 99.6 % 0.0 % processed
reco_step_tllq4fNoSchanWNoHiggs0p_all22WCsStartPtCheckV2dim6TopMay20GST_run0 0 4 980 500 4 980 500 10 000 10 000 9 961 0 39 0 4 0 99.6 % 0.0 % processed
reco_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 314 557 5 314 557 30 000 30 000 29 913 0 87 0 22 0 99.7 % 0.0 % processed
reco_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 385 542 5 385 542 35 000 35 000 34 900 0 100 0 18 0 99.7 % 0.0 % processed
reco_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 6 030 639 6 030 639 25 000 25 000 24 904 0 96 0 26 0 99.6 % 0.0 % processed
Total 0 26 689 738 26 689 738 110 000 110 000 109 635 0 365 0 81 0 99.7 % 0.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 133151 0 55681
root 81822 0 38956 674

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 89 497294 478275 472163 470265 463444 424277 423664 423201 421059 420421
84 7 497342 367052 351720 349496 323225 323168 267373
85 2 373526 284940
143 2109 478705 478704 478703 478492 478491 478490 478487 478486 478484 478483
179 4609 448383 448374 448373 448371 448370 448369 448367 448365 448364 448362
185 4 451765 418646 407013 406684
210 540 477184 477151 477137 477125 476632 476624 476621 475235 468938 468925
211 16 467725 423784 423647 420551 420267 420143 420138 420133 419810 419729
8020 3035 629251 629245 629244 629209 629208 629200 629199 629185 629184 629175
8021 3273 497366 497363 497293 496824 496756 496491 496294 496212 495930 495672
10001 98 599909 508618 487596 482127 478485 478199 478197 424329 423779 420868
10040 33 470267 470259 469891 469573 469242 469228 468609 467979 467355 466105

Hosts with Task Failures

Hostname Exit Codes
All 179 8021 8020 143 210 -11 10001 10040 211
d64cepyc005.crc.nd.edu 139 74 34 13 5 9 1 2 1 0
d64cepyc008.crc.nd.edu 95 74 14 1 3 2 0 0 0 1
q16copt004.crc.nd.edu 89 53 15 8 11 2 0 0 0 0
q16copt070.crc.nd.edu 83 34 18 16 11 1 2 1 0 0
q16copt006.crc.nd.edu 83 27 20 19 16 0 1 0 0 0
d32cepyc045.crc.nd.edu 83 49 4 20 7 2 0 0 1 0
q16copt018.crc.nd.edu 82 34 10 29 8 0 0 1 0 0
d12chas111.crc.nd.edu 82 36 21 9 10 3 1 1 0 1
d32cepyc013.crc.nd.edu 79 43 14 11 4 7 0 0 0 0
d32cepyc019.crc.nd.edu 77 26 28 11 6 4 1 1 0 0