Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
hlt_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0 0 4 984 000 4 984 000 10 000 10 000 9 968 0 32 0 16 0 99.7 % 0.0 % processed
hlt_step_tllq4fNoSchanWNoHiggs0p_all22WCsStartPtCheckV2dim6TopMay20GST_run0 0 4 982 500 4 982 500 10 000 10 000 9 965 0 35 0 8 0 99.7 % 0.0 % processed
hlt_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 318 448 5 318 448 30 000 30 000 29 935 0 65 0 20 0 99.8 % 0.0 % processed
hlt_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 388 258 5 388 258 35 000 35 000 34 918 0 82 0 32 0 99.8 % 0.0 % processed
hlt_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 6 036 998 6 036 998 25 000 25 000 24 930 0 70 0 30 0 99.7 % 0.0 % processed
Total 0 26 710 204 26 710 204 110 000 110 000 109 716 0 284 0 106 0 99.7 % 0.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 132434 0 112111
root 55958 0 51873 1531

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
179 12078 470473 470472 470471 470470 470469 470468 470466 470465 470463 470461
210 2475 478052 478046 478030 477923 477599 477321 477101 477073 477061 477048
211 98 468785 468773 468491 468467 424081 424067 424065 423956 423927 423919
8020 4638 625009 625000 624999 624998 624990 624989 624988 624975 624974 624973
8021 3607 497283 497281 497278 489402 488992 488985 488856 488852 488850 488490
10001 1 357698

Hosts with Task Failures

Hostname Exit Codes
All 179 8020 8021 210 211
d64cepyc005.crc.nd.edu 212 146 10 25 29 2
q16copt004.crc.nd.edu 174 120 9 31 14 0
q16copt018.crc.nd.edu 158 100 40 13 5 0
q16copt070.crc.nd.edu 150 94 33 16 7 0
d64cepyc008.crc.nd.edu 146 124 2 6 13 1
q16copt074.crc.nd.edu 138 105 7 17 9 0
d32cepyc045.crc.nd.edu 138 85 36 7 10 0
d32cepyc013.crc.nd.edu 137 98 5 14 19 1
d12chas209.crc.nd.edu 129 108 12 5 3 1
d12chas206.crc.nd.edu 122 73 42 4 3 0