Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
hlt_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0 0 4 922 000 4 922 000 10 000 10 000 9 844 0 156 0 29 0 98.4 % 0.0 % processed
hlt_step_tllq4fNoSchanWNoHiggs0p_all22WCsStartPtCheckV2dim6TopMay20GST_run0 0 4 915 500 4 915 500 10 000 10 000 9 831 0 169 0 38 0 98.3 % 0.0 % processed
hlt_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 296 034 5 296 034 30 001 30 001 29 812 0 189 0 29 0 99.4 % 0.0 % processed
hlt_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 348 552 5 348 552 35 006 35 006 34 625 0 381 0 48 0 98.9 % 0.0 % processed
hlt_step_ttlnuJet_all22WCsStartPtCheckdim6TopMay20GST_run0 0 5 963 910 5 963 910 25 005 25 005 24 627 0 378 0 61 0 98.5 % 0.0 % processed
Total 0 26 445 996 26 445 996 110 012 110 012 108 739 0 1 273 0 205 0 98.8 % 0.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 119723 0 109927
root 90289 0 73861 10482

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 3 515760 421777 394227
143 86 605456 592569 592512 590577 590576 581724 581452 580465 577578 573236
179 1145 285290 285289 285288 285287 285286 285285 285284 285283 285282 285281
210 1101 282942 282940 282935 282788 282785 282709 282705 282704 282702 282699
211 87 281823 279046 276007 273225 220246 220241 219578 219575 219571 216477
8020 6878 645154 645116 645115 645114 645113 645072 645071 645070 645069 645068
8021 1770 563113 317260 316977 290952 282937 282936 282789 282786 282710 282707
10001 1 368270
10050 1 521590

Hosts with Task Failures

Hostname Exit Codes
All 8020 8021 179 210 143 10050
d64cepyc002.crc.nd.edu 91 80 6 2 3 0 0
q16copt049.crc.nd.edu 81 53 17 6 5 0 0
q16copt102.crc.nd.edu 69 49 10 6 4 0 0
q16copt040.crc.nd.edu 69 44 8 9 3 4 1
q16copt035.crc.nd.edu 68 41 12 9 5 1 0
q16copt103.crc.nd.edu 60 54 4 2 0 0 0
q16copt036.crc.nd.edu 58 40 10 5 3 0 0
d32cepyc057.crc.nd.edu 57 57 0 0 0 0 0
d32cepyc010.crc.nd.edu 55 55 0 0 0 0 0
d32cepyc006.crc.nd.edu 54 49 0 1 4 0 0