Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
mAOD_step_ttHJet_HanV4lModel16DttllScanpointsqCut25_run1 0 58 950 58 950 800 800 369 369 0 0 0 431 46.1 % 46.1 % processed
mAOD_step_ttHJet_HanV4lModel16DttllScanpoints_run1 0 128 929 128 929 800 800 800 800 0 0 0 0 100.0 % 100.0 % processed
mAOD_step_ttllNuNuJetNoHiggs_HanV4lModel16DttllScanpointsqCut25_run1 0 104 014 104 014 800 800 776 773 0 0 0 24 97.0 % 96.6 % processed
mAOD_step_ttllNuNuJetNoHiggs_HanV4lModel16DttllScanpoints_run1 0 104 453 104 453 800 800 772 768 0 0 0 28 96.5 % 96.0 % processed
mAOD_step_ttlnuJet_HanV4lModel16DttllScanpointsqCut25_run1 0 44 241 44 241 400 400 174 154 152 0 0 33 43.5 % 38.5 % processed
mAOD_step_ttlnuJet_HanV4lModel16DttllScanpoints_run1 0 45 688 45 688 400 400 176 171 148 0 0 42 44.0 % 42.8 % processed
Total 0 486 275 486 275 4 000 4 000 3 067 3 035 300 0 0 558 76.7 % 75.9 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 4662 0 1440
root 0 0 0 911
gsiftp 0 0 902 0
srm 3788 2492 0 0

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

Task Resources

Task Timing

statisticsprofile show timeline breakdown

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
179 450 24809 24799 24798 24645 24644 24641 24272 24220 24217 24216
210 63 23049 22788 22783 22779 22654 22643 22131 21870 21617 21608
211 6 23056 20006 14843 14542 14541 14417

Hosts with Task Failures

Hostname Exit Codes
All 179 210 211
q16copt013.crc.nd.edu 10 9 0 1
q16copt005.crc.nd.edu 10 9 1 0
d12chas055.crc.nd.edu 8 8 0 0
d12chas037.crc.nd.edu 7 6 1 0
d12chas575.crc.nd.edu 7 7 0 0
q16copt067.crc.nd.edu 7 6 1 0
d12chas045.crc.nd.edu 7 7 0 0
proteus2.crc.nd.edu 7 6 1 0
d12chas062.crc.nd.edu 7 6 1 0
d12chas070.crc.nd.edu 6 5 1 0