Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
digi_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0 0 4 920 000 4 920 000 10 000 10 000 9 840 0 93 0 58 30 98.4 % 0.0 % processed
digi_step_tllq4fNoSchanWNoHiggs0p_all22WCsStartPtCheckV2dim6TopMay20GST_run0 0 4 810 000 4 810 000 10 000 10 000 9 620 0 171 0 75 25 96.2 % 0.0 % processed
digi_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 248 603 5 248 603 30 000 30 000 29 546 0 454 0 226 0 98.5 % 0.0 % processed
digi_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 335 588 5 335 588 35 000 35 000 34 541 0 451 0 259 8 98.7 % 0.0 % processed
digi_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 6 009 715 6 009 715 25 000 25 000 24 815 0 175 0 113 10 99.3 % 0.0 % processed

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 196828 0 109973
root 111367 0 83348 2501

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 34 918138 917930 915902 914990 914537 914536 911092 854794 778937 778242
-6 973 919299 918519 918400 918049 916678 916410 916315 915855 915054 914819
84 1 345335
85 60 729101 715656 680412 621869 610091 599842 592624 591639 589951 588801
86 2 339945 294695
139 1 916877
143 978 918516 918198 918068 917979 917927 917820 917815 917666 917212 916923
179 53060 470199 470194 470193 470187 470186 470185 470184 470182 470179 470177
185 1 288774
190 56 811542 777386 721323 713776 685251 655709 609778 599922 592120 592089
210 1552 540911 469823 469820 469819 469818 469812 469811 469809 469807 469801
211 62 541008 541003 540883 540759 540754 540440 540421 540402 540374 539981
8001 1 107494
8004 1 672256
8020 23290 917558 906273 906263 906183 906182 906168 906164 906163 906162 906158
8021 9248 919131 918262 917414 917211 917205 917134 916304 916096 915893 915881
8022 1 345314
8028 290 917245 857357 788350 778223 778201 777475 777442 754505 734492 726256
10001 900 918850 916857 916520 916312 916163 916063 915897 915892 915887 915853
10040 3 480230 345764 267824

Hosts with Task Failures

Hostname Exit Codes
All 179 8020 8021 210 10001 8028 143 211 85 190
d64cepyc002.crc.nd.edu 769 595 59 90 4 7 8 3 1 0 0
d32cepyc008.crc.nd.edu 728 462 191 48 9 4 3 0 1 0 1
d32cepyc010.crc.nd.edu 673 387 195 63 12 5 6 1 1 0 0
d32cepyc023.crc.nd.edu 666 424 167 54 7 5 2 2 2 1 0
d32cepyc061.crc.nd.edu 664 408 163 68 7 7 4 0 0 1 0
d32cepyc060.crc.nd.edu 652 410 163 54 8 10 0 1 1 0 0
d32cepyc005.crc.nd.edu 637 344 217 57 5 4 1 1 0 0 5
d32cepyc025.crc.nd.edu 629 319 227 66 6 2 4 2 0 1 0
d32cepyc032.crc.nd.edu 599 338 151 86 10 6 1 1 0 2 0
d32cepyc026.crc.nd.edu 574 266 196 71 16 11 3 0 0 1 0