Workflow Summary

Events Units
category total read written total
unmasked Units which are not masked by lumi_mask. If no mask has been specified, all units are unmasked. For more information see the documentation.
written merged
stuck Units which cannot be attempted because they are either failed or skipped, or their input is a unit in a parent workflow that failed or was skipped. If you want to increase skipping/failure thresholds so that the parent units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure and/or threshold_for_skipping in the lobster.core.config.AdvancedOptions section. If the parent unit finishes successfully, the stuck units will automatically be attempted. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
failed Units for which the executable has not exited successfully more than threshold_for_failure.

If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
skipped Units for which accessing the input file has failed more than threshold_for_skipping.

If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options.
left Units which are available for processing but haven't been attempted yet:

left = unmasked - running - written - failed - skipped - stuck
Progress Merged JSON
reco_step_tllq4fNoSchanWNoHiggs0p_HanV4Model16DttllScanpointsXQCUT0MatchOff_run1 0 5 000 000 5 000 000 10 000 10 000 10 000 0 0 0 0 0 100.0 % 0.0 % processed
reco_step_ttHJet_HanV4ttXJetStartPtChecks_run0 0 6 450 524 6 450 524 40 000 40 000 40 000 0 0 0 0 0 100.0 % 0.0 % processed
reco_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2 0 5 653 664 5 653 664 40 000 40 000 40 000 0 0 0 0 0 100.0 % 0.0 % processed
Total 0 17 104 188 17 104 188 90 000 90 000 90 000 0 0 0 0 0 100.0 % 0.0 %

Task Summary

Efficiency

Transfer Protocol Summary

Protocol Stage-in Success Stage-in Failure Stageout Success Stageout Failure
hdfs 0 91748 0 45019
root 91741 0 0 45019
gsiftp 0 0 19757 0

Task Resources Utilized

Task Resources Allocated

Task Timing

statisticsprofile show timeline breakdown

No successful merge tasks yet!

A mapping of the exit codes can be found in the documentation.

Failure Modes

Task Resources

Task Logs

Exit code Count Samples
-11 76 280316 279114 278835 277924 277905 276180 272802 272259 272236 271048
143 1 228046
210 8 188934 188931 188930 188923 188918 188912 188910 188909
8020 13 251944 247153 247145 247093 243034 243032 243005 235801 174232 168723
8021 780 280849 280377 280376 280127 280126 280079 279970 279889 279805 279801
10001 58 279603 277634 272264 271980 269537 269037 265123 264904 262428 262392
10040 19 245532 12979 12776 12540 11877 11638 11434 10612 9805 9566
10050 2 8583 8531

Hosts with Task Failures

Hostname Exit Codes
All 8021 10040 210 -11 10001 8020 10050
d64cepyc002.crc.nd.edu 25 12 5 0 3 2 1 2
qa-2080ti-007.crc.nd.edu 15 8 7 0 0 0 0 0
d12chas539.crc.nd.edu 11 9 0 0 1 1 0 0
d12chas256.crc.nd.edu 11 9 0 0 1 1 0 0
d64cepyc003.crc.nd.edu 11 7 0 0 1 2 1 0
q16copt073.crc.nd.edu 10 1 0 8 0 0 1 0
d12chas138.crc.nd.edu 10 10 0 0 0 0 0 0
q16copt121.crc.nd.edu 10 7 0 0 2 1 0 0
d6cneh008.crc.nd.edu 8 4 4 0 0 0 0 0
d12chas316.crc.nd.edu 7 7 0 0 0 0 0 0