Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
gen_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 000 000 5 000 000 10 000 10 000 10 000 0 0 0 0 0 100.0 % 0.0 % processed
gen_step_tllq4fNoSchanWNoHiggs0p_all22WCsStartPtCheckV2dim6TopMay20GST_run0 0 5 000 000 5 000 000 10 000 10 000 10 000 0 0 0 0 0 100.0 % 0.0 % processed
gen_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 15 000 500 5 329 605 30 001 30 001 30 001 0 0 0 0 0 100.0 % 0.0 % processed
gen_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0 0 17 503 000 5 407 659 35 006 35 006 35 006 0 0 0 0 0 100.0 % 0.0 % processed
gen_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 12 502 500 6 055 690 25 005 25 005 25 005 0 0 0 0 0 100.0 % 0.0 % processed
Total 0 55 006 000 26 792 954 110 012 110 012 110 012 0 0 0 0 0 100.0 % 0.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 119647 0 113487
root 15523 0 14119 1461

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
143 1742 283486 283481 283473 283447 283442 283403 283151 283148 283128 283127
179 3176 285534 285533 285532 285531 285530 285529 285527 285526 285519 285351
210 3130 283494 283490 283487 283484 283483 283479 283476 283468 283466 283464
211 345 278123 272227 220302 220014 220001 219798 210629 210382 210211 210189
8020 1796 283831 283830 283820 283814 283806 283805 283785 283783 283777 283775
8021 1188 282561 282108 282068 281314 280250 280247 280239 280049 280044 280025
10001 17 280047 165816 165723 165720 134861 123896 96692 96675 96672 96667

Hosts with Task Failures

Hostname Exit Codes
All 179 210 143 8021 8020 211
q16copt046.crc.nd.edu 119 25 36 24 17 14 3
q16copt012.crc.nd.edu 99 32 23 19 10 11 4
q16copt049.crc.nd.edu 98 36 18 10 15 15 4
q16copt045.crc.nd.edu 94 21 25 13 21 12 2
q16copt006.crc.nd.edu 92 30 20 10 21 10 1
q16copt048.crc.nd.edu 92 24 27 14 18 7 2
q16copt034.crc.nd.edu 90 36 20 15 13 6 0
q16copt052.crc.nd.edu 89 17 25 17 15 13 2
q16copt072.crc.nd.edu 86 23 17 22 11 11 2
q16copt121.crc.nd.edu 80 23 19 12 14 8 4