Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
hlt_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0 0 4 958 500 4 958 500 10 000 10 000 9 917 0 83 0 6 0 99.2 % 0.0 % processed
hlt_step_tllq4fNoSchanWNoHiggs0p_all22WCsStartPtCheckV2dim6TopMay20GST_run0 0 4 993 500 4 993 500 10 000 10 000 9 987 0 13 0 3 0 99.9 % 0.0 % processed
hlt_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 321 932 5 321 932 30 000 30 000 29 945 0 55 0 3 0 99.8 % 0.0 % processed
hlt_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 369 151 5 369 151 35 000 35 000 34 763 0 237 0 28 0 99.3 % 0.0 % processed
hlt_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 6 038 249 6 038 249 25 000 25 000 24 920 0 80 0 9 0 99.7 % 0.0 % processed
Total 0 26 681 332 26 681 332 110 000 110 000 109 532 0 468 0 49 0 99.6 % 0.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 113547 0 110001
root 103043 0 101387 338

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 1 424486
143 16 600266 593030 566909 562977 502602 465620 454431 408189 400429 351262
179 1454 189317 189316 189313 189312 189311 189310 189309 189308 189253 189151
210 463 187400 187393 187387 187172 187156 187106 187105 187103 187101 187099
211 6 193157 100473 99285 49713 41766 20906
8020 1586 601320 601319 601310 601309 601300 601296 601295 601287 601286 601285
8021 505 187679 187572 187570 187533 187463 187462 187445 187444 187443 187442

Hosts with Task Failures

Hostname Exit Codes
All 179 8020 210 8021 211
d32cepyc009.crc.nd.edu 67 34 27 2 4 0
d32cepyc025.crc.nd.edu 49 41 2 4 2 0
d32cepyc008.crc.nd.edu 48 28 9 3 8 0
d32cepyc057.crc.nd.edu 41 12 19 7 2 1
d32cepyc016.crc.nd.edu 40 22 12 5 1 0
d32cepyc003.crc.nd.edu 40 18 14 7 1 0
d32cepyc004.crc.nd.edu 39 14 16 6 3 0
d64cepyc004.crc.nd.edu 38 0 38 0 0 0
d32cepyc010.crc.nd.edu 35 13 10 6 6 0
d12chas326.crc.nd.edu 35 25 6 4 0 0