Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
mAOD_step_tllq4fNoSchanWNoHiggs0p_HanV4Model16DttllScanpointsXQCUT0MatchOff_run1 0 4 992 500 4 992 500 10 000 10 000 9 985 9 985 15 0 0 0 99.8 % 99.8 % processed
mAOD_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2 0 5 647 870 5 647 870 40 000 40 000 39 972 39 972 28 0 2 0 99.9 % 99.9 % processed
mAOD_step_ttlnuJet_HanV4ttXJetStartPtChecks_run1 0 4 894 608 4 894 608 20 000 20 000 19 986 19 986 14 0 0 0 99.9 % 99.9 % processed
Total 0 15 534 978 15 534 978 70 000 70 000 69 943 69 943 57 0 2 0 99.9 % 99.9 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 70134 0 29590
root 74481 0 0 29590
gsiftp 0 0 153 0

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

Task Resources

Task Timing

statisticsprofile show timeline breakdown

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 72 218499 218490 218459 218430 218270 218261 218237 218205 218138 218134
-4 185 218373 218320 218297 218290 218269 218253 218184 218176 218162 218158
143 7 183711 155489 153507 149715 148448 139918 104957
8020 277 218502 218426 218395 218347 218346 218344 218340 218224 218171 218018
8021 1034 218505 218504 218481 218471 218463 218451 218448 218437 218428 218425
10001 251 218498 218493 218433 218390 218358 218319 218313 218308 218295 218275

Hosts with Task Failures

Hostname Exit Codes
All 8021 10001 8020 -4 -11 143
q16copt061.crc.nd.edu 65 32 10 7 10 5 1
q16copt062.crc.nd.edu 52 5 21 7 15 4 0
q16copt056.crc.nd.edu 37 6 12 10 7 1 1
qa-xp-001.crc.nd.edu 22 17 1 1 2 1 0
d12chas045.crc.nd.edu 22 14 0 2 2 4 0
d64cepyc002.crc.nd.edu 21 15 1 3 1 1 0
qa-1080ti-001.crc.nd.edu 19 9 3 6 0 1 0
d8civy003.crc.nd.edu 17 15 0 2 0 0 0
q16copt121.crc.nd.edu 17 13 2 0 1 1 0
qa-k40c-001.crc.nd.edu 16 7 2 5 2 0 0