Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
digi_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0 0 4 936 500 4 936 500 10 000 10 000 9 873 0 127 0 57 0 98.7 % 0.0 % processed
digi_step_tllq4fNoSchanWNoHiggs0p_all22WCsStartPtCheckV2dim6TopMay20GST_run0 0 4 934 500 4 934 500 10 000 10 000 9 869 0 131 0 57 0 98.7 % 0.0 % processed
digi_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 301 113 5 301 113 30 001 30 001 29 841 0 160 0 68 0 99.5 % 0.0 % processed
digi_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 355 915 5 355 915 35 006 35 006 34 673 0 333 0 132 0 99.0 % 0.0 % processed
digi_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 978 726 5 978 726 25 005 25 005 24 688 0 317 0 139 0 98.7 % 0.0 % processed

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 138352 0 109949
root 87196 0 60475 8826

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 27 569390 553684 546993 544034 538877 512482 507873 489277 454664 451107
-6 535 575899 555478 548622 547956 522567 509809 505824 502640 494947 488548
68 1 416327
84 6 510050 296089 271356 270948 270815 43266
85 58 554548 551899 548624 534118 531706 528419 517158 500189 496592 494976
92 3 269999 269791 63021
143 2613 606960 595463 595455 591904 585810 585808 583237 582152 580898 580896
179 1698 284905 284904 284903 284902 284878 284877 284875 284873 284869 284868
185 2 276027 159255
190 58 565663 557268 556807 541229 541228 539337 535951 533491 533047 512486
210 989 282773 282676 282649 282495 282482 282361 282355 282286 282213 282203
211 16 282179 277197 276011 275598 275573 274717 274522 220448 122527 108909
8001 2 55401 21350
8020 16352 645106 645105 645062 644990 644989 644988 644922 644921 644920 644919
8021 9235 619182 618110 617649 617538 616578 616091 606970 606537 606536 606509
8028 426 556318 556045 529431 528994 526584 512075 483859 446156 444372 441980
10001 532 603576 588483 585295 583340 575455 560484 540605 538134 536007 535831

Hosts with Task Failures

Hostname Exit Codes
All 8020 8021 143 179 210 -6 10001 8028 190 211
d64cepyc002.crc.nd.edu 312 232 51 4 7 8 3 4 3 0 0
d32cepyc061.crc.nd.edu 208 147 45 1 5 0 4 0 6 0 0
d32cepyc006.crc.nd.edu 198 137 44 0 1 2 3 4 6 0 0
q16copt025.crc.nd.edu 188 87 48 40 8 0 4 1 0 0 0
d32cepyc007.crc.nd.edu 178 115 26 5 8 12 5 4 2 0 1
q16copt099.crc.nd.edu 175 87 51 19 8 4 1 3 0 0 0
d32cepyc017.crc.nd.edu 173 157 15 0 0 0 0 0 0 1 0
d32cepyc014.crc.nd.edu 142 96 41 0 0 1 1 1 0 2 0
d32cepyc013.crc.nd.edu 100 79 14 1 1 2 1 1 1 0 0
d12chas007.crc.nd.edu 62 35 21 1 1 3 0 1 0 0 0