Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
digi_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GSTqCut25_run0 0 1 229 105 1 229 105 30 000 30 000 6 939 0 0 0 0 22 776 23.1 % 0.0 % processed
digi_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GSTqCut15_run0 0 2 047 088 2 047 088 30 000 30 000 11 529 0 0 0 0 18 173 38.4 % 0.0 % processed
digi_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GSTqCut20_run0 0 2 971 738 2 971 738 30 000 30 000 16 720 0 0 0 0 12 994 55.7 % 0.0 % processed
digi_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GSTqCut25_run0 0 2 112 696 2 112 696 35 000 35 000 13 697 0 0 0 0 21 037 39.1 % 0.0 % processed
digi_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GSTqCut15_run0 0 1 570 512 1 570 512 35 000 35 000 10 198 0 0 0 0 24 436 29.1 % 0.0 % processed
digi_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GSTqCut20_run0 0 1 363 532 1 363 532 35 000 35 000 8 832 0 0 0 0 26 005 25.2 % 0.0 % processed
digi_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GSTqCut25_run0 0 2 273 633 2 273 633 25 000 25 000 9 432 0 1 0 0 15 404 37.7 % 0.0 % processed
digi_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GSTqCut15_run0 0 988 723 988 723 25 000 25 000 4 086 0 0 0 0 20 701 16.3 % 0.0 % processed
digi_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GSTqCut20_run0 0 2 238 215 2 238 215 25 000 25 000 9 241 0 0 0 0 15 636 37.0 % 0.0 % processed
Total 0 16 795 242 16 795 242 270 000 270 000 90 674 0 1 0 0 177 162 33.6 % 0.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 140449 0 92947
root 17470 0 3889 58
gsiftp 0 0 2 0

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 125 674293 670882 669008 662768 659921 653042 646728 644424 640292 637471
-6 366 686393 686370 686289 685920 685529 684028 683979 683753 683434 683199
84 1 365817
85 7 571658 563307 500133 489700 487095 434037 364903
143 6231 685909 685878 685828 685783 685536 684051 684038 684037 684030 684022
179 6710 633076 633075 633074 633073 633072 633071 633070 633069 633068 633067
185 1 643163
190 5 663155 572121 569654 402248 365650
210 2276 614926 614903 614898 614888 614853 614817 614811 614695 614688 614580
211 2 600000 144899
8001 3 648172 641354 640306
8020 9396 688478 688472 688467 688465 688376 688367 688351 688348 688344 688317
8021 31217 688364 688356 688347 688335 688295 687889 687859 687652 687546 687530
8022 7 684000 654061 653931 650928 636940 488746 365964
8028 102 683961 679872 671283 668018 665155 656661 639204 611140 606396 599585
10001 411 686389 686375 686305 686212 686030 685883 685779 685708 685706 683752

Hosts with Task Failures

Hostname Exit Codes
All 8021 143 8020 179 210 -11 -6 8028 8022 85
d64cepyc008.crc.nd.edu 495 282 1 144 4 32 25 4 0 0 0
q16copt060.crc.nd.edu 460 151 200 21 80 5 0 1 0 0 0
q16copt068.crc.nd.edu 441 168 184 24 52 10 0 0 0 0 0
q16copt070.crc.nd.edu 427 144 170 32 73 5 0 1 0 0 1
q16copt079.crc.nd.edu 414 154 186 21 46 6 0 0 0 0 0
q16copt066.crc.nd.edu 405 145 169 29 59 1 0 1 0 0 0
d64cepyc010.crc.nd.edu 393 233 3 122 0 20 5 8 0 0 0
d64cepyc009.crc.nd.edu 389 239 0 119 2 16 0 8 1 0 0
q16copt076.crc.nd.edu 380 122 162 17 69 3 0 2 1 0 0
q16copt062.crc.nd.edu 371 156 166 39 0 7 0 1 0 1 0