Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
hlt_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0 0 4 888 000 4 888 000 10 000 10 000 9 776 0 138 0 45 70 97.8 % 0.0 % processed
hlt_step_tllq4fNoSchanWNoHiggs0p_all22WCsStartPtCheckV2dim6TopMay20GST_run0 0 4 758 500 4 758 500 10 000 10 000 9 517 0 185 0 14 216 95.2 % 0.0 % processed
hlt_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 214 391 5 214 391 30 000 30 000 29 353 0 647 0 193 0 97.8 % 0.0 % processed
hlt_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 308 381 5 308 381 35 000 35 000 34 365 0 627 0 176 8 98.2 % 0.0 % processed
hlt_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 980 078 5 980 078 25 000 25 000 24 692 0 298 0 123 10 98.8 % 0.0 % processed
Total 0 26 149 350 26 149 350 110 000 110 000 107 703 0 1 895 0 551 304 97.9 % 0.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 149006 0 108661
root 78143 0 64547 1316

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 5 916285 818258 815432 750661 663363
-6 1 816420
143 305 833308 833307 833306 833305 833304 833303 833302 833301 833300 833299
179 22186 470349 470342 470340 470275 470274 470234 470220 470218 470215 470211
210 949 469832 469701 469697 469550 469542 469537 469530 469528 469297 469296
211 54 540599 540586 540559 540541 539044 537459 536028 524887 513132 513117
8020 16810 905747 905511 905331 905276 905275 905200 905199 905198 905119 905118
8021 1372 909977 895765 888710 881498 813572 669491 669453 669002 668969 543749
10001 3 911797 809867 809596
10050 1 757842

Hosts with Task Failures

Hostname Exit Codes
All 179 8020 8021 210 211 143
d32cepyc027.crc.nd.edu 396 249 135 7 4 0 1
d32cepyc019.crc.nd.edu 366 256 98 7 4 0 1
d32cepyc006.crc.nd.edu 366 255 95 10 3 3 0
d32cepyc026.crc.nd.edu 365 227 119 7 10 1 1
d32cepyc025.crc.nd.edu 334 191 127 5 7 2 2
d32cepyc014.crc.nd.edu 332 232 91 4 5 0 0
d32cepyc055.crc.nd.edu 313 177 111 12 12 1 0
d32cepyc062.crc.nd.edu 289 189 83 8 9 0 0
d32cepyc005.crc.nd.edu 288 164 118 3 3 0 0
d32cepyc013.crc.nd.edu 283 187 79 6 11 0 0