Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
digi_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0 0 7 500 000 7 500 000 15 000 15 000 15 000 0 0 0 0 0 100.0 % 0.0 % processed
digi_step_tllq4fNoSchanWNoHiggs0p_all22WCsStartPtCheckV2dim6TopMay20GST_run0 0 7 500 000 7 500 000 15 000 15 000 15 000 0 0 0 0 0 100.0 % 0.0 % processed
digi_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 7 994 185 7 994 185 45 000 45 000 44 999 0 1 0 0 0 100.0 % 0.0 % processed
digi_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0 0 8 104 545 8 104 545 52 500 52 500 52 500 0 0 0 0 0 100.0 % 0.0 % processed
digi_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 9 081 864 9 081 864 37 500 37 500 37 500 0 0 0 0 0 100.0 % 0.0 % processed
digi_step_tttt_FourtopsMay3v1_run0 0 7 500 000 7 500 000 15 000 15 000 15 000 0 0 0 0 0 100.0 % 0.0 % processed

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 202712 0 179999
root 40179 0 35283 71

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 71 869313 808788 806504 778876 778187 769909 763520 753402 747267 732924
-6 80 857074 830237 817427 806162 799063 789405 754117 743280 742938 742003
65 1 363508
84 3 434192 416627 357608
85 72 852102 845922 845247 836724 810575 788240 787516 785817 772964 766313
92 1 393341
143 3154 900184 894860 894858 894849 894838 894837 894801 894800 894799 894796
179 232 696115 696114 696113 696112 696111 696110 696109 696108 696107 696106
190 167 861034 859923 858491 850044 849720 847924 840550 839454 835212 832510
8001 2 734621 541189
8002 223 557537 557536 557535 557534 557532 557531 557530 557528 557527 557526
8020 1775 879151 878558 878541 878488 873907 873801 873683 873677 873214 873200
8021 17178 895449 894850 894840 894804 894798 894797 894795 894793 894724 889881
8022 1 468782
8028 2907 884528 882075 799101 774516 745538 741650 729786 715877 705000 701097
10001 123 869590 862507 837291 806778 800634 800633 784547 784182 779289 778971
10040 3 836699 786508 707990

Hosts with Task Failures

Hostname Exit Codes
All 8021 8028 8020 143 8002 10001 -6 179 -11 190
d64cepyc002.crc.nd.edu 236 161 36 21 10 0 2 2 2 0 2
d32cepyc057.crc.nd.edu 196 135 36 19 1 2 2 0 0 1 0
d32cepyc022.crc.nd.edu 166 119 23 19 1 1 0 1 0 1 1
d32cepyc012.crc.nd.edu 152 106 29 11 1 3 0 0 1 0 0
d32cepyc016.crc.nd.edu 140 109 14 11 0 6 0 0 0 0 0
qa-rtx6k-012.crc.nd.edu 140 96 7 11 24 0 1 0 1 0 0
d32cepyc007.crc.nd.edu 128 97 19 11 0 1 0 0 0 0 0
qa-rtx6k-041.crc.nd.edu 123 82 16 6 18 0 0 1 0 0 0
d32cepyc013.crc.nd.edu 116 79 25 9 0 3 0 0 0 0 0
d32cepyc039.crc.nd.edu 114 70 29 9 1 3 1 0 0 1 0