Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
digi_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 000 000 5 000 000 10 000 10 000 10 000 0 0 0 0 0 100.0 % 0.0 % processed
digi_step_tllq4fNoSchanWNoHiggs0p_all22WCsStartPtCheckV2dim6TopMay20GST_run0 0 4 999 500 4 999 500 10 000 10 000 9 999 0 1 0 0 0 100.0 % 0.0 % processed
digi_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 329 554 5 329 554 30 000 30 000 29 999 0 1 0 0 0 100.0 % 0.0 % processed
digi_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 405 396 5 405 396 35 000 35 000 35 000 0 0 0 0 0 100.0 % 0.0 % processed
digi_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 6 053 549 6 053 549 25 000 25 000 25 000 0 0 0 0 0 100.0 % 0.0 % processed

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 120907 0 110526
root 2921 0 2635 51

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 31 515820 505414 501433 494279 491750 486611 473187 444734 432306 432162
-6 33 510850 491763 479939 465794 463479 459175 451710 444510 442079 406274
84 1 163918
85 31 533655 528453 518070 517532 505415 505037 453332 453059 451475 451367
143 710 560042 556561 556559 556556 556554 556552 556264 556217 549592 549578
179 1299 528534 528532 528531 528457 528456 528268 528267 528266 528265 528263
185 8 426964 387379 352744 342373 325163 318772 248852 209857
190 52 534245 534062 533633 530483 529931 517735 517131 517120 505043 504935
210 496 526022 525912 525664 525663 525662 525659 525657 525654 525650 525649
211 32 525613 524969 524944 389980 389966 389961 389960 389871 389870 389680
8001 5 34444 34172 34163 34158 33883
8002 2 33630 33622
8019 1 33623
8020 1088 560040 552674 549576 544147 544140 542208 540440 540192 540181 540175
8021 7798 560041 560038 559022 559016 558258 556562 556560 556557 556555 556216
8028 32 510226 475903 467845 463321 453315 450080 377832 347716 342263 298682
10001 70 532855 531677 530513 522285 506418 505301 476629 475883 473166 452046

Hosts with Task Failures

Hostname Exit Codes
All 8021 179 8020 210 10001 8028 -11 85 190 143
d64cepyc001.crc.nd.edu 140 106 13 14 6 0 1 0 0 0 0
d64cepyc002.crc.nd.edu 137 95 11 16 9 2 1 1 0 1 0
d32cepyc036.crc.nd.edu 92 63 15 7 5 2 0 0 0 0 0
d32cepyc017.crc.nd.edu 90 66 13 6 4 0 0 0 0 0 1
d32cepyc039.crc.nd.edu 86 62 6 10 3 2 1 0 0 0 0
d32cepyc056.crc.nd.edu 83 61 8 7 4 1 0 0 1 1 0
d32cepyc002.crc.nd.edu 81 63 7 6 3 0 1 1 0 0 0
d32cepyc057.crc.nd.edu 79 59 10 6 2 0 0 1 0 0 0
d32cepyc040.crc.nd.edu 79 55 13 9 2 0 0 0 0 0 0
d32cepyc009.crc.nd.edu 77 54 10 7 4 0 0 0 1 0 1