Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
digi_step_tllq4fNoSchanWNoHiggs0p_HanV4Model16DttllScanpointsXQCUT0MatchOff_run1 0 4 992 500 4 992 500 10 000 10 000 9 985 0 15 15 15 0 99.8 % 0.0 % processed
digi_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2 0 5 648 291 5 648 291 40 000 40 000 39 975 0 25 25 25 0 99.9 % 0.0 % processed
digi_step_ttlnuJet_HanV4ttXJetStartPtChecks_run1 0 4 894 608 4 894 608 20 000 20 000 19 986 0 14 14 14 0 99.9 % 0.0 % processed
Total 0 15 535 399 15 535 399 70 000 70 000 69 946 0 54 54 54 0 99.9 % 0.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 81037 0 69946
root 80966 0 0 69946

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 83 214213 208958 208916 206827 206385 206169 203992 203984 202291 200257
-6 24 206187 201385 200442 192652 179353 172711 170137 169124 165986 165364
85 17 215160 195263 192430 152533 98355 91819 89003 85635 82954 81808
92 54 214942 214768 212631 208463 203977 203768 196691 192662 184729 180619
190 2 145033 80297
8001 4 181392 150666 115459 95232
8006 15 195786 138339 121608 121147 120772 120745 114271 113574 113523 113116
8020 204 215438 215218 215195 215189 215184 215156 215146 215138 215116 215100
8021 4704 215493 215469 215464 215461 215456 215455 215451 215442 215437 215434
8022 3 134009 112829 48913
8028 5981 215492 215490 215489 215488 215484 215483 215482 215481 215480 215479
10001 42 212024 208905 202262 198400 191732 190138 190064 188354 186901 186900

Hosts with Task Failures

Hostname Exit Codes
All 8028 8021 8020 -11 10001 -6 92 85 8001 8006
q16copt100.crc.nd.edu 80 52 28 0 0 0 0 0 0 0 0
q16copt099.crc.nd.edu 67 41 19 3 2 1 0 1 0 0 0
d8civy141.crc.nd.edu 67 42 23 1 0 0 0 0 1 0 0
d12chas018.crc.nd.edu 61 40 21 0 0 0 0 0 0 0 0
q16copt120.crc.nd.edu 57 32 22 1 1 0 0 0 1 0 0
d12chas118.crc.nd.edu 56 34 19 1 1 1 0 0 0 0 0
q16copt067.crc.nd.edu 55 31 24 0 0 0 0 0 0 0 0
d12chas281.crc.nd.edu 55 29 21 2 0 0 1 0 0 1 1
d12chas197.crc.nd.edu 55 25 29 0 0 0 1 0 0 0 0
q16copt049.crc.nd.edu 54 31 20 1 0 1 0 1 0 0 0