Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
digi_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0 0 4 992 000 4 992 000 10 000 10 000 9 984 0 16 0 13 0 99.8 % 0.0 % processed
digi_step_tllq4fNoSchanWNoHiggs0p_all22WCsStartPtCheckV2dim6TopMay20GST_run0 0 4 986 500 4 986 500 10 000 10 000 9 973 0 27 0 16 0 99.7 % 0.0 % processed
digi_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 321 959 5 321 959 30 000 30 000 29 955 0 45 0 32 0 99.8 % 0.0 % processed
digi_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 393 173 5 393 173 35 000 35 000 34 950 0 50 0 40 0 99.9 % 0.0 % processed
digi_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 6 044 389 6 044 389 25 000 25 000 24 960 0 40 0 28 0 99.8 % 0.0 % processed

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 139687 0 111978
root 33951 0 27298 1237

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 34 577578 571035 546868 531249 529355 495762 492113 469294 451012 412330
-6 28 602572 584923 556445 540461 503837 501351 494724 474256 457733 394704
65 2 408257 278212
84 1 356331
85 45 548863 548717 548314 545476 541063 540660 538691 517586 474236 471427
86 1 357033
135 1 368156
143 1050 615044 610758 610141 602721 602718 602579 602364 595236 595082 591327
179 10754 470389 470388 470387 470386 470384 470383 470381 470380 470379 470372
190 83 558030 557127 557105 550902 550038 546382 546014 545506 544807 542547
210 2239 477930 477929 477927 477815 477810 477809 477510 477506 477494 477492
211 79 468688 468577 424040 424039 423857 423733 422777 422774 420960 420949
8020 6297 624961 624960 624950 624949 624928 624899 624898 624897 624896 624895
8021 10393 615885 615641 615640 615468 615456 615053 615038 615037 614624 614609
8028 112 555687 493251 470883 464360 461829 452082 451514 450325 406922 384482
10001 58 526116 526103 520169 518630 511298 510742 463147 457397 424036 419554
10040 1 523731

Hosts with Task Failures

Hostname Exit Codes
All 179 8021 8020 210 143 8028 211 -11 85 10001
d64cepyc008.crc.nd.edu 278 189 55 15 14 2 0 2 1 0 0
d12chas328.crc.nd.edu 170 71 45 36 16 2 0 0 0 0 0
d32cepyc018.crc.nd.edu 164 122 29 7 4 1 0 0 0 0 1
d32cepyc023.crc.nd.edu 158 56 45 46 6 2 2 0 0 1 0
d12chas259.crc.nd.edu 156 88 37 13 14 2 0 1 0 0 0
d64cepyc005.crc.nd.edu 153 50 66 15 15 2 3 0 1 0 0
d12chas442.crc.nd.edu 150 122 16 7 5 0 0 0 0 0 0
d64cepyc001.crc.nd.edu 148 47 72 13 11 3 1 1 0 0 0
q16copt067.crc.nd.edu 143 66 33 34 4 5 0 0 1 0 0
d12chas456.crc.nd.edu 136 121 5 5 3 1 0 1 0 0 0