

Efficiency


Transfer Protocol Summary
Protocol | Stage-in Success | Stage-in Failure | Stageout Success | Stageout Failure |
---|---|---|---|---|
hdfs | 22020 | 0 | 4404 | 0 |
Events | Units | |||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
category | total | read | written | total |
unmasked
Units which are not masked by lumi_mask.
If no mask has been specified, all units are unmasked. For more information see the
documentation.
|
written | merged |
stuck
Units which cannot be attempted because they are either failed or skipped, or their input is
a unit in a parent workflow that failed or was skipped.
If you want to increase skipping/failure thresholds so that the parent units are attempted
again, run lobster configure /my/working/directory and increase
threshold_for_failure and/or threshold_for_skipping
in the lobster.core.config.AdvancedOptions section. If the parent unit
finishes successfully, the stuck units will automatically be attempted. For more information
see the documentation on
updating
your configuration after the start of a run, and advanced configuration
options.
|
failed
Units for which the executable has not exited successfully more than
threshold_for_failure.
If you want to increase the failure threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_failure in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options. |
skipped
Units for which accessing the input file has failed more than
threshold_for_skipping.
If you want to increase the skipping threshold so that these units are attempted again, run lobster configure /my/working/directory and increase threshold_for_skipping in the lobster.core.config.AdvancedOptions section. For more information see the documentation on updating your configuration after the start of a run, and advanced configuration options. |
left
Units which are available for processing but haven't been attempted yet:
left = unmasked - running - written - failed - skipped - stuck |
Progress | Merged | JSON |
gen_step_ttHJet_cptTestOldGenprodTestdim6TopMay20GSTAxisScan_run0 | 0 | 360 000 | 130 941 | 800 | 800 | 720 | 0 | 0 | 0 | 0 | 0 | 90.0 % | 0.0 % | processed |
gen_step_ttHJet_cptTestOldGenprodTestdim6TopMay20GSTAxisScan_run1 | 0 | 400 000 | 138 583 | 800 | 800 | 800 | 0 | 0 | 0 | 0 | 0 | 100.0 % | 0.0 % | processed |
gen_step_ttHJet_cptTestOldGenprodTestdim6TopMay20GSTAxisScan_run2 | 0 | 400 000 | 131 674 | 800 | 800 | 800 | 0 | 0 | 0 | 0 | 0 | 100.0 % | 0.0 % | processed |
gen_step_ttHJet_cptTestOldGenprodTestdim6TopMay20GSTAxisScan_run3 | 0 | 400 000 | 129 192 | 800 | 800 | 800 | 0 | 0 | 0 | 0 | 0 | 100.0 % | 0.0 % | processed |
gen_step_ttHJet_cptTestOldGenprodTestdim6TopMay20GSTAxisScan_run4 | 0 | 400 000 | 131 888 | 800 | 800 | 800 | 0 | 0 | 0 | 0 | 0 | 100.0 % | 0.0 % | processed |
gen_step_ttHJet_cptTestOldGenprodTestdim6TopMay20GSTAxisScan_run5 | 0 | 400 000 | 137 980 | 800 | 800 | 800 | 0 | 0 | 0 | 0 | 0 | 100.0 % | 0.0 % | processed |
gen_step_ttHJet_cptTestOldGenprodTestdim6TopMay20GSTAxisScan_run6 | 0 | 400 000 | 146 232 | 800 | 800 | 800 | 0 | 0 | 0 | 0 | 0 | 100.0 % | 0.0 % | processed |
gen_step_ttHJet_cptV5TestUpdateGenprodTestdim6TopMay20GSTAxisScan_run1 | 0 | 397 500 | 134 842 | 800 | 800 | 795 | 0 | 0 | 0 | 0 | 0 | 99.4 % | 0.0 % | processed |
gen_step_ttHJet_cptV5TestUpdateGenprodTestdim6TopMay20GSTAxisScan_run2 | 0 | 392 500 | 127 413 | 800 | 800 | 785 | 0 | 0 | 0 | 0 | 0 | 98.1 % | 0.0 % | processed |
gen_step_ttHJet_cptV5TestUpdateGenprodTestdim6TopMay20GSTAxisScan_run3 | 0 | 395 000 | 126 081 | 800 | 800 | 790 | 0 | 0 | 0 | 0 | 0 | 98.8 % | 0.0 % | processed |
gen_step_ttHJet_cptV5TestUpdateGenprodTestdim6TopMay20GSTAxisScan_run4 | 0 | 370 000 | 120 390 | 800 | 800 | 740 | 0 | 0 | 0 | 0 | 0 | 92.5 % | 0.0 % | processed |
gen_step_ttHJet_cptV5TestUpdateGenprodTestdim6TopMay20GSTAxisScan_run5 | 0 | 345 000 | 117 396 | 800 | 800 | 690 | 0 | 0 | 0 | 0 | 0 | 86.3 % | 0.0 % | processed |
gen_step_ttHJet_cptV5TestUpdateGenprodTestdim6TopMay20GSTAxisScan_run6 | 0 | 400 000 | 143 133 | 800 | 800 | 800 | 0 | 0 | 0 | 0 | 0 | 100.0 % | 0.0 % | processed |
gen_step_ttHJet_cptV6TestUpdateGenprodTestdim6TopMay20GSTAxisScan_run0 | 0 | 400 000 | 143 130 | 800 | 800 | 800 | 0 | 0 | 0 | 0 | 0 | 100.0 % | 0.0 % | processed |
gen_step_ttHJet_cptbTestOldGenprodTestdim6TopMay20GSTAxisScan_run0 | 0 | 400 000 | 130 844 | 800 | 800 | 800 | 0 | 0 | 0 | 0 | 0 | 100.0 % | 0.0 % | processed |
gen_step_ttHJet_cptbTestOldGenprodTestdim6TopMay20GSTAxisScan_run1 | 0 | 400 000 | 129 556 | 800 | 800 | 800 | 0 | 0 | 0 | 0 | 0 | 100.0 % | 0.0 % | processed |
gen_step_ttHJet_cptbTestOldGenprodTestdim6TopMay20GSTAxisScan_run2 | 0 | 400 000 | 128 422 | 800 | 800 | 800 | 0 | 0 | 0 | 0 | 0 | 100.0 % | 0.0 % | processed |
gen_step_ttHJet_cptbTestOldGenprodTestdim6TopMay20GSTAxisScan_run3 | 0 | 397 500 | 128 591 | 800 | 800 | 795 | 0 | 0 | 0 | 0 | 0 | 99.4 % | 0.0 % | processed |
gen_step_ttHJet_cptbTestOldGenprodTestdim6TopMay20GSTAxisScan_run4 | 0 | 395 000 | 126 764 | 800 | 800 | 790 | 0 | 0 | 0 | 0 | 0 | 98.8 % | 0.0 % | processed |
gen_step_ttHJet_cptbTestOldGenprodTestdim6TopMay20GSTAxisScan_run5 | 0 | 400 000 | 129 694 | 800 | 800 | 800 | 0 | 0 | 0 | 0 | 0 | 100.0 % | 0.0 % | processed |
gen_step_ttHJet_cptbTestOldGenprodTestdim6TopMay20GSTAxisScan_run6 | 0 | 387 500 | 126 704 | 800 | 800 | 775 | 0 | 0 | 0 | 0 | 0 | 96.9 % | 0.0 % | processed |
gen_step_ttHJet_cptbV2TestUpdateGenprodTestdim6TopMay20GSTAxisScan_run5 | 0 | 400 000 | 125 234 | 800 | 800 | 800 | 0 | 0 | 0 | 0 | 0 | 100.0 % | 0.0 % | processed |
gen_step_ttHJet_cptbV4TestUpdateGenprodTestdim6TopMay20GSTAxisScan_run0 | 0 | 400 000 | 123 702 | 800 | 800 | 800 | 0 | 0 | 0 | 0 | 0 | 100.0 % | 0.0 % | processed |
gen_step_ttHJet_cptbV4TestUpdateGenprodTestdim6TopMay20GSTAxisScan_run1 | 0 | 397 500 | 124 448 | 800 | 800 | 795 | 0 | 0 | 0 | 0 | 0 | 99.4 % | 0.0 % | processed |
gen_step_ttHJet_cptbV4TestUpdateGenprodTestdim6TopMay20GSTAxisScan_run2 | 0 | 400 000 | 127 299 | 800 | 800 | 800 | 0 | 0 | 0 | 0 | 0 | 100.0 % | 0.0 % | processed |
gen_step_ttHJet_cptbV4TestUpdateGenprodTestdim6TopMay20GSTAxisScan_run3 | 0 | 385 000 | 122 919 | 800 | 800 | 770 | 0 | 0 | 0 | 0 | 0 | 96.3 % | 0.0 % | processed |
gen_step_ttHJet_cptbV4TestUpdateGenprodTestdim6TopMay20GSTAxisScan_run4 | 0 | 400 000 | 126 969 | 800 | 800 | 800 | 0 | 0 | 0 | 0 | 0 | 100.0 % | 0.0 % | processed |
gen_step_ttHJet_cptbV4TestUpdateGenprodTestdim6TopMay20GSTAxisScan_run6 | 0 | 400 000 | 124 284 | 800 | 800 | 800 | 0 | 0 | 0 | 0 | 0 | 100.0 % | 0.0 % | processed |
Total | 0 | 11 022 500 | 3 634 305 | 22 400 | 22 400 | 22 045 | 0 | 0 | 0 | 0 | 0 | 98.4 % | 0.0 % |
Protocol | Stage-in Success | Stage-in Failure | Stageout Success | Stageout Failure |
---|---|---|---|---|
hdfs | 22020 | 0 | 4404 | 0 |
statisticsprofile show timeline breakdown
No successful merge tasks yet!
No failed tasks yet!