Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
mAOD_step_tHq4f_HanV4tXqSMCheckMatchOff_run0 0 250 000 250 000 500 500 500 500 0 0 0 0 100.0 % 100.0 % processed
mAOD_step_tHq4f_HanV4tXqSMCheck_run0 0 150 874 150 874 500 500 500 500 0 0 0 0 100.0 % 100.0 % processed
mAOD_step_tllq4fNoSchanWNoHiggs0p_HanV4tXqSMCheckMatchOff_run0 0 250 000 250 000 500 500 500 500 0 0 0 0 100.0 % 100.0 % processed
mAOD_step_tllq4fNoSchanWNoHiggs0p_HanV4tXqSMCheck_run0 0 207 382 207 382 500 500 500 500 0 0 0 0 100.0 % 100.0 % processed
Total 0 858 256 858 256 2 000 2 000 2 000 2 000 0 0 0 0 100.0 % 100.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 2252 0 1024
root 2272 0 0 1024
gsiftp 0 0 138 0

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

Task Resources

Task Timing

statisticsprofile show timeline breakdown

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 2 6249 6031
-4 9 6041 6036 6010 6006 6004 5997 5990 5980 5914
8020 4 6039 6017 5988 5977
8021 53 6247 6201 6073 6069 6065 6043 6042 6038 6032 6027
10001 18 6037 6034 6030 6029 6026 6022 6015 6009 6000 5999

Hosts with Task Failures

Hostname Exit Codes
All 8021 10001 8020 -4 -11
d8civy113.crc.nd.edu 6 1 3 1 1 0
q16copt074.crc.nd.edu 5 3 0 1 0 1
d6cneh057.crc.nd.edu 4 4 0 0 0 0
d8civy112.crc.nd.edu 3 2 1 0 0 0
d8civy019.crc.nd.edu 3 1 1 0 1 0
d6cneh075.crc.nd.edu 3 1 1 1 0 0
d8civy106.crc.nd.edu 3 3 0 0 0 0
d8civy096.crc.nd.edu 3 2 1 0 0 0
d8civy120.crc.nd.edu 3 2 1 0 0 0
d8civy065.crc.nd.edu 3 2 1 0 0 0