==== wrapper started @ Thu Nov 28 12:31:53 EST 2019 ==== == startup: hostname: qa-2080ti-003.crc.nd.edu == startup: kernel: Linux qa-2080ti-003.crc.nd.edu 3.10.0-957.el7.x86_64 #1 SMP Thu Oct 4 20:48:51 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux ==== tracing google @ Thu Nov 28 12:31:58 EST 2019 ==== wrapper.sh: line 20: traceroute: command not found ==== environment at startup @ Thu Nov 28 12:32:03 EST 2019 ==== == env: VC3_VERSION_SED=4.2 == env: CCTOOLS_RESOURCE_PROCESS_START=1574962323294296 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: VC3_ROOT_GZIP=/ == env: SHELL=/bin/sh == env: TERM=xterm-256color == env: MAKEFLAGS=-j4 == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-62554/t.200257/cctools-temp-t.200257.E2o8km == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-62554/t.200257/librmonitor_helper.so.6EG5eA == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: LOBSTER_CMSSW_VERSION=CMSSW_9_4_0_patch1 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: USER=kmohrman == env: TEMP=/disk/vc3-root/tmp/worker-230547-62554/t.200257/cctools-temp-t.200257.E2o8km == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: LD_LIBRARY_PATH=/opt/crc/usr/local/lib:/.singularity.d/libs == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_ROOT_MAKE=/ == env: VC3_DISTFILES=/disk/vc3-distfiles == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-62554/cache/tmp == env: VC3_VERSION_TAR=1.26 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-5fwDTx == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: VC3_VERSION_GZIP=1.5 == env: VC3_ENV_TAG_GLOBAL=62302 == env: PATH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:/bin == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-5fwDTx == env: VC3_ROOT_PKG_CONFIG=/ == env: PWD=/disk/vc3-root/tmp/worker-230547-62554/t.200257 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_FULL_SED=4.2.2 == env: VC3_VERSION_WHICH=2.20 == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-62554 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_ROOT_SED=/ == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: CXX=g++ == env: SHLVL=3 == env: HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_MAKE=3.82 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: DISK=6000 == env: MEMORY=7800 == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: TMP=/disk/vc3-root/tmp/worker-230547-62554/t.200257/cctools-temp-t.200257.E2o8km == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_VERSION_PKG_CONFIG=0.27 == env: VC3_ROOT_TAR=/ == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-5fwDTx.wrapper == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: CC=gcc == env: CORES=6 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CCTOOLS_RESOURCE_MONITOR_INFO=1025 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_ALL_postLHE.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=37627 == env: _=/bin/env ==== cpu info @ Thu Nov 28 12:32:08 EST 2019 ==== == cpu: processor : 0 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 800.061 == cpu: cache size : 11264 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 0 == cpu: cpu cores : 8 == cpu: apicid : 0 == cpu: initial apicid : 0 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4200.00 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 1 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 799.932 == cpu: cache size : 11264 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 1 == cpu: cpu cores : 8 == cpu: apicid : 2 == cpu: initial apicid : 2 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4200.00 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 2 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 799.932 == cpu: cache size : 11264 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 2 == cpu: cpu cores : 8 == cpu: apicid : 4 == cpu: initial apicid : 4 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4200.00 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 3 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 799.932 == cpu: cache size : 11264 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 3 == cpu: cpu cores : 8 == cpu: apicid : 6 == cpu: initial apicid : 6 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4200.00 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 4 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 800.061 == cpu: cache size : 11264 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 4 == cpu: cpu cores : 8 == cpu: apicid : 8 == cpu: initial apicid : 8 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4200.00 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 5 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 800.061 == cpu: cache size : 11264 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 5 == cpu: cpu cores : 8 == cpu: apicid : 10 == cpu: initial apicid : 10 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4200.00 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 6 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 799.932 == cpu: cache size : 11264 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 6 == cpu: cpu cores : 8 == cpu: apicid : 12 == cpu: initial apicid : 12 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4200.00 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 7 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 800.061 == cpu: cache size : 11264 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 7 == cpu: cpu cores : 8 == cpu: apicid : 14 == cpu: initial apicid : 14 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4200.00 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 8 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 800.061 == cpu: cache size : 11264 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 0 == cpu: cpu cores : 8 == cpu: apicid : 16 == cpu: initial apicid : 16 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4205.14 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 9 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 799.932 == cpu: cache size : 11264 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 1 == cpu: cpu cores : 8 == cpu: apicid : 18 == cpu: initial apicid : 18 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4205.14 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 10 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 2865.197 == cpu: cache size : 11264 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 2 == cpu: cpu cores : 8 == cpu: apicid : 20 == cpu: initial apicid : 20 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4205.14 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 11 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 799.932 == cpu: cache size : 11264 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 3 == cpu: cpu cores : 8 == cpu: apicid : 22 == cpu: initial apicid : 22 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4205.14 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 12 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 799.932 == cpu: cache size : 11264 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 4 == cpu: cpu cores : 8 == cpu: apicid : 24 == cpu: initial apicid : 24 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4205.14 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 13 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 800.061 == cpu: cache size : 11264 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 5 == cpu: cpu cores : 8 == cpu: apicid : 26 == cpu: initial apicid : 26 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4205.14 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 14 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 799.932 == cpu: cache size : 11264 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 6 == cpu: cpu cores : 8 == cpu: apicid : 28 == cpu: initial apicid : 28 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4205.14 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 15 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 799.932 == cpu: cache size : 11264 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 7 == cpu: cpu cores : 8 == cpu: apicid : 30 == cpu: initial apicid : 30 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4205.14 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: === using CVMFS proxy: http://eddie.crc.nd.edu:3128 @ Thu Nov 28 12:32:33 EST 2019 === using Frontier proxy: http://eddie.crc.nd.edu:3128 @ Thu Nov 28 12:32:33 EST 2019 === parrot helper: /disk/vc3-root/tmp/worker-230547-62554/t.200257/lib/libparrot_helper.so @ Thu Nov 28 12:32:38 EST 2019 ==== content of /disk/vc3-root/tmp/worker-230547-62554/cache/tmp @ Thu Nov 28 12:32:38 EST 2019 ==== == cache: total 28 == cache: drwx------ 263 kmohrman campus 8192 Nov 28 12:31 ex_parrot_kmohrman == cache: -rw-r--r-- 1 kmohrman campus 10 Nov 27 22:13 hot_cache == cache: drwxr-x--- 260 kmohrman campus 8192 Nov 27 21:55 cvmfs === OSG certificate location: /cvmfs/oasis.opensciencegrid.org/mis/certificates @ Thu Nov 28 12:32:43 EST 2019 === testing parrot usage @ Thu Nov 28 12:32:43 EST 2019 === parrot OK @ Thu Nov 28 12:32:48 EST 2019 === starting parrot to access CMSSW... @ Thu Nov 28 12:32:48 EST 2019 ==== wrapper started @ Thu Nov 28 12:32:48 EST 2019 ==== == startup: hostname: qa-2080ti-003.crc.nd.edu == startup: kernel: Linux qa-2080ti-003.crc.nd.edu 3.10.0-957.el7.x86_64 #1 SMP Thu Oct 4 20:48:51 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux ==== tracing google @ Thu Nov 28 12:32:49 EST 2019 ==== wrapper.sh: line 20: traceroute: command not found ==== environment at startup @ Thu Nov 28 12:32:49 EST 2019 ==== == env: VC3_VERSION_SED=4.2 == env: CCTOOLS_RESOURCE_PROCESS_START=1574962369053084 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/ == env: LOBSTER_GFAL_COPY= == env: MAKEFLAGS=-j4 == env: PARROT_HELPER=/disk/vc3-root/tmp/worker-230547-62554/t.200257/lib/libparrot_helper.so == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-62554/t.200257/cctools-temp-t.200257.E2o8km == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-62554/t.200257/librmonitor_helper.so.6EG5eA == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: LOBSTER_CMSSW_VERSION=CMSSW_9_4_0_patch1 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: LD_LIBRARY_PATH=/opt/crc/usr/local/lib:/.singularity.d/libs:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-62554/t.200257/cctools-temp-t.200257.E2o8km == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/ == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-5fwDTx == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-62554/cache/tmp == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: PARROT_CVMFS_REPO=*:try_local_filesystem == env: *.cern.ch:pubkey=,url=http://cvmfs.fnal.gov:8000/opt/*;http://cvmfs.racf.bnl.gov:8000/opt/* == env: *.opensciencegrid.org:pubkey=,url=http://oasis-replica.opensciencegrid.org:8000/cvmfs/*;http://cvmfs.fnal.gov:8000/cvmfs/*;http://cvmfs.racf.bnl.gov:8000/cvmfs/* == env: VC3_VERSION_GZIP=1.5 == env: PATH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:/bin == env: VC3_ENV_TAG_GLOBAL=62302 == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-5fwDTx == env: PWD=/disk/vc3-root/tmp/worker-230547-62554/t.200257 == env: VC3_ROOT_PKG_CONFIG=/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_WHICH=2.20 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: LOBSTER_LCG_CP= == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-62554 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: CXX=g++ == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: DISK=6000 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-62554/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-62554/cache/tmp/cvmfs == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=7800 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TMP=/disk/vc3-root/tmp/worker-230547-62554/t.200257/cctools-temp-t.200257.E2o8km == env: PYTHONPATH=python: == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_ROOT_TAR=/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-5fwDTx.wrapper == env: CC=gcc == env: CCTOOLS_RESOURCE_MONITOR_INFO=1025 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=6 == env: PARROT_DEBUG_FLAGS= == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_ALL_postLHE.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=37627 == env: _=/bin/env ==== cpu info @ Thu Nov 28 12:32:49 EST 2019 ==== == cpu: processor : 0 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 2399.926 == cpu: cache size : 11264 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 0 == cpu: cpu cores : 8 == cpu: apicid : 0 == cpu: initial apicid : 0 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4200.00 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 1 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 799.932 == cpu: cache size : 11264 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 1 == cpu: cpu cores : 8 == cpu: apicid : 2 == cpu: initial apicid : 2 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4200.00 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 2 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 925.158 == cpu: cache size : 11264 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 2 == cpu: cpu cores : 8 == cpu: apicid : 4 == cpu: initial apicid : 4 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4200.00 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 3 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 2399.926 == cpu: cache size : 11264 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 3 == cpu: cpu cores : 8 == cpu: apicid : 6 == cpu: initial apicid : 6 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4200.00 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 4 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 904.266 == cpu: cache size : 11264 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 4 == cpu: cpu cores : 8 == cpu: apicid : 8 == cpu: initial apicid : 8 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4200.00 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 5 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 799.932 == cpu: cache size : 11264 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 5 == cpu: cpu cores : 8 == cpu: apicid : 10 == cpu: initial apicid : 10 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4200.00 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 6 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 2399.798 == cpu: cache size : 11264 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 6 == cpu: cpu cores : 8 == cpu: apicid : 12 == cpu: initial apicid : 12 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4200.00 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 7 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 1795.587 == cpu: cache size : 11264 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 7 == cpu: cpu cores : 8 == cpu: apicid : 14 == cpu: initial apicid : 14 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4200.00 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 8 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 800.061 == cpu: cache size : 11264 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 0 == cpu: cpu cores : 8 == cpu: apicid : 16 == cpu: initial apicid : 16 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4205.14 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 9 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 800.061 == cpu: cache size : 11264 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 1 == cpu: cpu cores : 8 == cpu: apicid : 18 == cpu: initial apicid : 18 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4205.14 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 10 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 1884.411 == cpu: cache size : 11264 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 2 == cpu: cpu cores : 8 == cpu: apicid : 20 == cpu: initial apicid : 20 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4205.14 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 11 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 2781.756 == cpu: cache size : 11264 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 3 == cpu: cpu cores : 8 == cpu: apicid : 22 == cpu: initial apicid : 22 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4205.14 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 12 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 1037.567 == cpu: cache size : 11264 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 4 == cpu: cpu cores : 8 == cpu: apicid : 24 == cpu: initial apicid : 24 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4205.14 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 13 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 800.061 == cpu: cache size : 11264 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 5 == cpu: cpu cores : 8 == cpu: apicid : 26 == cpu: initial apicid : 26 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4205.14 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 14 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 2574.371 == cpu: cache size : 11264 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 6 == cpu: cpu cores : 8 == cpu: apicid : 28 == cpu: initial apicid : 28 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4205.14 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 15 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 85 == cpu: model name : Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz == cpu: stepping : 4 == cpu: microcode : 0x2000050 == cpu: cpu MHz : 800.061 == cpu: cache size : 11264 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 7 == cpu: cpu cores : 8 == cpu: apicid : 30 == cpu: initial apicid : 30 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 22 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4205.14 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: === using parrot @ Thu Nov 28 12:32:51 EST 2019 === sourcing CMS setup @ Thu Nov 28 12:32:51 EST 2019 LibCvmfs version 2.4, revision 25 === sourcing OSG setup @ Thu Nov 28 12:32:51 EST 2019 ==== environment after sourcing startup scripts @ Thu Nov 28 12:32:51 EST 2019 ==== == env: VC3_VERSION_SED=4.2 == env: MANPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/share/man:/cvmfs/cms.cern.ch/share/man: == env: CCTOOLS_RESOURCE_PROCESS_START=1574962371647423 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: GFAL_PLUGIN_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib64/gfal2-plugins/ == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/ == env: LOBSTER_GFAL_COPY=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/bin/gfal-copy == env: VOMS_USERCONF=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/etc/vomses == env: MAKEFLAGS=-j4 == env: GLOBUS_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-62554/t.200257/cctools-temp-t.200257.E2o8km == env: PERL5LIB=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/share/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib64/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib64/perl5 == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: CVSROOT=:gserver:cmssw.cvs.cern.ch:/local/reps/CMSSW == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-62554/t.200257/librmonitor_helper.so.6EG5eA == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: X509_CERT_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/etc/grid-security/certificates == env: SCRAM_ARCH=slc7_amd64_gcc493 == env: LOBSTER_CMSSW_VERSION=CMSSW_9_4_0_patch1 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: LD_LIBRARY_PATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib64/dcap:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib64/lcgdm:/opt/crc/usr/local/lib:/.singularity.d/libs:lib:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-62554/t.200257/cctools-temp-t.200257.E2o8km == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/ == env: OSG_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-5fwDTx == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-62554/cache/tmp == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: PARROT_CVMFS_REPO=*:try_local_filesystem == env: *.cern.ch:pubkey=,url=http://cvmfs.fnal.gov:8000/opt/*;http://cvmfs.racf.bnl.gov:8000/opt/* == env: *.opensciencegrid.org:pubkey=,url=http://oasis-replica.opensciencegrid.org:8000/cvmfs/*;http://cvmfs.fnal.gov:8000/cvmfs/*;http://cvmfs.racf.bnl.gov:8000/cvmfs/* == env: VC3_VERSION_GZIP=1.5 == env: PATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/sbin:/cvmfs/cms.cern.ch/common:/cvmfs/cms.cern.ch/bin:/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:/bin == env: VC3_ENV_TAG_GLOBAL=62302 == env: CMS_PATH=/cvmfs/cms.cern.ch == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-5fwDTx == env: PWD=/disk/vc3-root/tmp/worker-230547-62554/t.200257 == env: VC3_ROOT_PKG_CONFIG=/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_WHICH=2.20 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: X509_VOMS_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/etc/grid-security/vomsdir == env: LOBSTER_LCG_CP= == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-62554 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: CXX=g++ == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: DISK=6000 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-62554/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-62554/cache/tmp/cvmfs == env: GFAL_CONFIG_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/etc/gfal2.d/ == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=7800 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TMP=/disk/vc3-root/tmp/worker-230547-62554/t.200257/cctools-temp-t.200257.E2o8km == env: PYTHONPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib/python2.7/site-packages:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib64/python2.7/site-packages:python:python: == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_ROOT_TAR=/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-5fwDTx.wrapper == env: CC=gcc == env: CCTOOLS_RESOURCE_MONITOR_INFO=1025 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=6 == env: PARROT_DEBUG_FLAGS= == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_ALL_postLHE.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=37627 == env: _=/bin/env ==== proxy information @ Thu Nov 28 12:32:52 EST 2019 ==== == proxy: subject : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman/CN=2026837974 == proxy: issuer : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman == proxy: identity : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman == proxy: type : RFC compliant proxy == proxy: strength : 1024 bits == proxy: path : proxy == proxy: timeleft : 117:02:31 ==== working directory at startup @ Thu Nov 28 12:32:52 EST 2019 ==== == dir: total 28288 == dir: -rw-r--r-- 3 kmohrman campus 28090622 Nov 27 22:40 HIG-RunIIFall17DRPremix-00823_1_cfg.py == dir: drwxr-xr-x 2 kmohrman campus 91 Nov 28 12:31 bin == dir: -rwxr-xr-x 3 kmohrman campus 627272 Nov 27 21:54 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 Nov 28 12:31 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 Nov 28 12:31 cctools-temp-t.200257.E2o8km == dir: -rw------- 1 kmohrman campus 51 Nov 28 12:32 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 Nov 28 12:32 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 Nov 28 12:31 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 Nov 28 12:31 librmonitor_helper.so.6EG5eA == dir: -rw-r--r-- 2 kmohrman campus 2201 Nov 28 12:31 parameters.json == dir: -rw------- 2 kmohrman campus 9194 Nov 28 12:31 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 Nov 28 12:31 python == dir: -rw-r--r-- 3 kmohrman campus 570 Nov 27 21:54 report.json.in == dir: -rw-r--r-- 3 kmohrman campus 492 Nov 27 21:54 sandbox-CMSSW_9_4_0_patch1-slc7_amd64_gcc630.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 49 Nov 28 12:31 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 Nov 28 12:32 t_wrapper_start == dir: -rwxr-xr-x 3 kmohrman campus 47217 Nov 27 21:54 task.py == dir: -rwxr-xr-x 3 kmohrman campus 6296 Nov 27 21:54 wrapper.sh === creating new release CMSSW_9_4_0_patch1 for scram arch slc7_amd64_gcc630 @ Thu Nov 28 12:32:52 EST 2019 Attaching cms-ib.cern.ch failed: Failed to initialize root file catalog (16) Attaching cms-ib.cern.ch failed: Failed to initialize root file catalog (16) Attaching cms-ib.cern.ch failed: Failed to initialize root file catalog (16) Attaching cms-ib.cern.ch failed: Failed to initialize root file catalog (16) WARNING: In non-interactive mode release checks e.g. deprecated releases, production architectures are disabled. === unpacking sandbox-CMSSW_9_4_0_patch1-slc7_amd64_gcc630.tar.bz2 @ Thu Nov 28 12:32:59 EST 2019 ==== machine load @ Thu Nov 28 12:33:02 EST 2019 ==== top: unknown option 'M' Usage: top -hv | -bcHiOSs -d secs -n max -u|U user -p pid(s) -o field -w [cols] ==== environment before execution @ Thu Nov 28 12:33:02 EST 2019 ==== == env: G4LEVELGAMMADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4PhotonEvaporation/3.2/data/PhotonEvaporation3.2 == env: UTM_XSD_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/utm/utm_0.6.5-fmblme == env: SRT_G4LEVELGAMMADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4PhotonEvaporation/3.2/data/PhotonEvaporation3.2 == env: VC3_VERSION_SED=4.2 == env: CMSSW_RELEASE_BASE=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1 == env: SCRAMRT_SET=CMSSW:CMSSW_9_4_0_patch1:slc7_amd64_gcc630:V2_2_9_pre05:SRT_ == env: MANPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/share/man:/cvmfs/cms.cern.ch/share/man: == env: CCTOOLS_RESOURCE_PROCESS_START=1574962382575529 == env: CMSSW_FWLITE_INCLUDE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sherpa/2.2.4-fmblme2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/hepmc/2.06.07/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/clhep/2.3.4.2-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/boost/1.63.0-fmblme/include == env: COMPILER_RUNTIME_OBJECTS=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0 == env: SRT_MALLOC_CONF_SCRAMRTDEL=lg_chunk:18,lg_dirty_mult:4 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: ROOT_INCLUDE_PATH=/disk/vc3-root/tmp/worker-230547-62554/t.200257/CMSSW_9_4_0_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw/CMSSW_9_4_0/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/coral/CORAL_2_3_21-fmblme3/include/LCG:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/mctester/1.25.0a-fmblme3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/lcg/root/6.10.08/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include/QtDesigner:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/tauolapp/1.1.5-fmblme2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/charybdis/1.003-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/thepeg/1.9.2p1-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sherpa/2.2.4-fmblme2/include/SHERPA-MC:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include/QtOpenGL:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include/QtGui:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/pythia8/230/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/herwig/6.521-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/rivet/2.5.4/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include/Qt3Support:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/lwtnn/1.0-fmblme2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/classlib/3.1.3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/lhapdf/6.2.1-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/cgal/4.2-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/tkonlinesw/4.1.0-1-fmblme3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/starlight/r193-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include/Qt:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include/QtCore:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include/QtXml:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/mcdb/1.0.3/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/libungif/4.1.4/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/libtiff/4.0.3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/libpng/1.6.16/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4/10.02.p02-fmblme3/include/Geant4:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/frontier_client/2.8.20-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/pcre/8.37/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/boost/1.63.0-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/xrootd/4.6.1-fmblme/include/xrootd/private:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/vdt/0.3.9/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/valgrind/3.12.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/utm/utm_0.6.5-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/toprex/4.23/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/tbb/2018/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/tauola/27.121.5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sigcpp/2.6.2/include/sigc++-2.0:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sqlite/3.16.2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/protobuf/3.4.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/pacparser/1.3.5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/oracle/12.1.0.2.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/meschach/1.2.pCMS1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/madgraph5amcatnlo/2.4.3-fmblme3:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/libhepml/0.2.1/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/ktjet/1.06-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/jimmy/4.2-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/jemalloc/4.5.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/xz/5.2.2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/heppdt/3.03.00-fmblme2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/hector/1.3.4_patch1-fmblme3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gsl/2.2.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/libjpeg-turbo/1.3.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/giflib/4.2.3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/xerces-c/3.1.3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gdbm/1.10/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/freetype/2.5.3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/fftw3/3.3.2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/fftjet/1.5.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/fastjet/3.1.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/expat/2.1.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/hepmc/2.06.07/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/dpm/1.8.0.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/dcap/2.47.8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/libxml2/2.9.1/include/libxml2:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/curl/7.52.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/cppunit/1.12.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/clhep/2.3.4.2-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/openssl/1.0.2d/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/pythia6/426/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/photos/215.5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/zlib-x86_64/1.2.11/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/libuuid/2.22.2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/castor/2.1.13.9/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/castor/2.1.13.9/include/shift:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/cascade/2.2.04-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/bz2lib/1.0.6/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/python/2.7.11-fmblme/include/python2.7:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/ittnotify/16.06.18-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0/include/c++/6.3.0:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0/include/c++/6.3.0/x86_64-unknown-linux-gnu:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0/include/c++/6.3.0/backward:/usr/local/include:/usr/include == env: INTEL_LICENSE_FILE=28518@lxlicen01.cern.ch,28518@lxlicen02.cern.ch,28518@lxlicen03.cern.ch == env: SRT_TEXMFHOME_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/rivet/2.5.4/share/Rivet/texmf == env: SRT_GEANT4_PARFULLCMS_CONFIG_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-parfullcms/2014.01.27-fmblme3/share/ParFullCMS == env: GFAL_PLUGIN_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib64/gfal2-plugins/ == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/ == env: LOBSTER_GFAL_COPY=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/bin/gfal-copy == env: PDFPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/rivet/2.5.4/share == env: DBSCMD_HOME=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/dbs-client/DBS_2_1_9-fmblme/lib/DBSAPI == env: CMSSW_FULL_RELEASE_BASE=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw/CMSSW_9_4_0 == env: SRT_TNS_ADMIN_SCRAMRTDEL=/etc == env: VOMS_USERCONF=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/etc/vomses == env: MAKEFLAGS=-j4 == env: ROOT_GCC_TOOLCHAIN=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0 == env: GLOBUS_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-62554/t.200257/cctools-temp-t.200257.E2o8km == env: G4FORCENUMBEROFTHREADS=max == env: OPENBLAS_NUM_THREADS=1 == env: SRT_PDFPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/rivet/2.5.4/share == env: PERL5LIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/git/2.13.0/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/share/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib64/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib64/perl5 == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: CMSSW_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms == env: LHAPDF_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/lhapdf/6.2.1-fmblme/share/LHAPDF == env: CVSROOT=:gserver:cmssw.cvs.cern.ch:/local/reps/CMSSW == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-62554/t.200257/librmonitor_helper.so.6EG5eA == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: CMSSW_GIT_HASH=CMSSW_9_4_0_patch1 == env: SRT_G4ABLADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4ABLA/3.0/data/G4ABLA3.0 == env: QTDIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7 == env: SRT_SCONS_LIB_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/scons/1.2.0-fmblme/lib == env: OLDPWD=/disk/vc3-root/tmp/worker-230547-62554/t.200257/CMSSW_9_4_0_patch1 == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: G4NEUTRONXSDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4NEUTRONXS/1.4/data/G4NEUTRONXS1.4 == env: QTINC=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include == env: SRT_COMPILER_RUNTIME_OBJECTS_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0 == env: X509_CERT_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/etc/grid-security/certificates == env: SCRAM_ARCH=slc7_amd64_gcc630 == env: GIT_SSL_CAINFO=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/git/2.13.0/share/ssl/certs/ca-bundle.crt == env: DBS_CLIENT_CONFIG=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/dbs-client/DBS_2_1_9-fmblme/lib/DBSAPI/dbs.config == env: SRT_CMS_OPENLOOPS_PREFIX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/openloops/1.3.1-fmblme == env: SRT_GIT_EXEC_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/git/2.13.0/libexec/git-core == env: LOBSTER_CMSSW_VERSION=CMSSW_9_4_0_patch1 == env: ROOT_TTREECACHE_SIZE=0 == env: EVTGENDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/evtgen/1.6.0-fmblme2/share == env: SRT_INTEL_LICENSE_FILE_SCRAMRTDEL=28518@lxlicen01.cern.ch,28518@lxlicen02.cern.ch,28518@lxlicen03.cern.ch == env: SRT_ROOT_INCLUDE_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-62554/t.200257/CMSSW_9_4_0_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw/CMSSW_9_4_0/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/coral/CORAL_2_3_21-fmblme3/include/LCG:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/mctester/1.25.0a-fmblme3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/lcg/root/6.10.08/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include/QtDesigner:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/tauolapp/1.1.5-fmblme2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/charybdis/1.003-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/thepeg/1.9.2p1-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sherpa/2.2.4-fmblme2/include/SHERPA-MC:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include/QtOpenGL:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include/QtGui:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/pythia8/230/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/herwig/6.521-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/rivet/2.5.4/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include/Qt3Support:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/lwtnn/1.0-fmblme2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/classlib/3.1.3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/lhapdf/6.2.1-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/cgal/4.2-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/tkonlinesw/4.1.0-1-fmblme3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/starlight/r193-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include/Qt:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include/QtCore:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include/QtXml:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/mcdb/1.0.3/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/libungif/4.1.4/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/libtiff/4.0.3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/libpng/1.6.16/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4/10.02.p02-fmblme3/include/Geant4:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/frontier_client/2.8.20-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/pcre/8.37/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/boost/1.63.0-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/xrootd/4.6.1-fmblme/include/xrootd/private:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/vdt/0.3.9/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/valgrind/3.12.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/utm/utm_0.6.5-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/toprex/4.23/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/tbb/2018/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/tauola/27.121.5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sigcpp/2.6.2/include/sigc++-2.0:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sqlite/3.16.2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/protobuf/3.4.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/pacparser/1.3.5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/oracle/12.1.0.2.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/meschach/1.2.pCMS1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/madgraph5amcatnlo/2.4.3-fmblme3:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/libhepml/0.2.1/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/ktjet/1.06-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/jimmy/4.2-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/jemalloc/4.5.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/xz/5.2.2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/heppdt/3.03.00-fmblme2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/hector/1.3.4_patch1-fmblme3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gsl/2.2.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/libjpeg-turbo/1.3.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/giflib/4.2.3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/xerces-c/3.1.3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gdbm/1.10/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/freetype/2.5.3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/fftw3/3.3.2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/fftjet/1.5.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/fastjet/3.1.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/expat/2.1.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/hepmc/2.06.07/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/dpm/1.8.0.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/dcap/2.47.8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/libxml2/2.9.1/include/libxml2:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/curl/7.52.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/cppunit/1.12.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/clhep/2.3.4.2-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/openssl/1.0.2d/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/pythia6/426/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/photos/215.5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/zlib-x86_64/1.2.11/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/libuuid/2.22.2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/castor/2.1.13.9/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/castor/2.1.13.9/include/shift:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/cascade/2.2.04-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/bz2lib/1.0.6/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/python/2.7.11-fmblme/include/python2.7:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/ittnotify/16.06.18-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0/include/c++/6.3.0:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0/include/c++/6.3.0/x86_64-unknown-linux-gnu:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0/include/c++/6.3.0/backward:/usr/local/include:/usr/include == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: G4LEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4EMLOW/6.48/data/G4EMLOW6.48 == env: SRT_VINCIADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/vincia/2.2.01-fmblme/share/Vincia/xmldoc == env: SRT_ROOT_TTREECACHE_PREFILL_SCRAMRTDEL=0 == env: OPAL_PREFIX=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/openmpi/2.1.2rc4 == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: ROOT_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/madgraph5amcatnlo/2.4.3-fmblme3 == env: SHERPA_INCLUDE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sherpa/2.2.4-fmblme2/include/SHERPA-MC == env: SRT_LHAPDF_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/lhapdf/6.2.1-fmblme/share/LHAPDF == env: LD_LIBRARY_PATH=/disk/vc3-root/tmp/worker-230547-62554/t.200257/CMSSW_9_4_0_patch1/biglib/slc7_amd64_gcc630:/disk/vc3-root/tmp/worker-230547-62554/t.200257/CMSSW_9_4_0_patch1/lib/slc7_amd64_gcc630:/disk/vc3-root/tmp/worker-230547-62554/t.200257/CMSSW_9_4_0_patch1/external/slc7_amd64_gcc630/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/biglib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/lib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/external/slc7_amd64_gcc630/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw/CMSSW_9_4_0/biglib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw/CMSSW_9_4_0/lib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/llvm/4.0.1/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib64/dcap:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib64/lcgdm:/opt/crc/usr/local/lib:/.singularity.d/libs:lib:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-62554/t.200257/cctools-temp-t.200257.E2o8km == env: SRT_CMSSW_RELEASE_BASE_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1 == env: SRT_RIVET_ANALYSIS_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-62554/t.200257/CMSSW_9_4_0_patch1/lib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/lib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/rivet/2.5.4/lib == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: SRT_PERL5LIB_SCRAMRT=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/git/2.13.0/share/perl5 == env: SRT_CMSSW_VERSION_SCRAMRTDEL=CMSSW_9_4_0_patch1 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/ == env: VALGRIND_LIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/valgrind/3.12.0/lib/valgrind == env: SRT_CMSSW_GIT_HASH_SCRAMRTDEL=CMSSW_9_4_0_patch1 == env: SRT_ROOTSYS_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/lcg/root/6.10.08/ == env: OSG_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-5fwDTx == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-62554/cache/tmp == env: G4NEUTRONHPDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4NDL/4.5/data/G4NDL4.5 == env: GEANT4_PARFULLCMS_CONFIG_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-parfullcms/2014.01.27-fmblme3/share/ParFullCMS == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: CSC_TRACK_FINDER_DATA_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/CSCTrackFinderEmulation/1.2/data/ == env: SRT_QTINC_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: G4ENSDFSTATEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4ENSDFSTATE/1.2.3/data/G4ENSDFSTATE1.2.3 == env: G4RADIOACTIVEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4RadioactiveDecay/4.3.2/data/RadioactiveDecay4.3.2 == env: ROOFITSYS=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/lcg/root/6.10.08/ == env: SRT_ROOFITSYS_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/lcg/root/6.10.08/ == env: SRT_G4RADIOACTIVEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4RadioactiveDecay/4.3.2/data/RadioactiveDecay4.3.2 == env: SRT_G4ENSDFSTATEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4ENSDFSTATE/1.2.3/data/G4ENSDFSTATE1.2.3 == env: SRT_CLHEP_PARAM_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/clhep/2.3.4.2-fmblme == env: G4ABLADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4ABLA/3.0/data/G4ABLA3.0 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: SRT_SHERPA_INCLUDE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sherpa/2.2.4-fmblme2/include/SHERPA-MC == env: SRT_G4FORCENUMBEROFTHREADS_SCRAMRTDEL=max == env: SRT_WORKER_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/blackhat/0.9.9-fmblme/share/blackhat/datafiles/ == env: PARROT_CVMFS_REPO=*:try_local_filesystem == env: *.cern.ch:pubkey=,url=http://cvmfs.fnal.gov:8000/opt/*;http://cvmfs.racf.bnl.gov:8000/opt/* == env: *.opensciencegrid.org:pubkey=,url=http://oasis-replica.opensciencegrid.org:8000/cvmfs/*;http://cvmfs.fnal.gov:8000/cvmfs/*;http://cvmfs.racf.bnl.gov:8000/cvmfs/* == env: VC3_VERSION_GZIP=1.5 == env: TNS_ADMIN=/etc == env: SRT_HEPPDT_PARAM_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/heppdt/3.03.00-fmblme2 == env: PATH=/cvmfs/cms.cern.ch/share/overrides/bin:/disk/vc3-root/tmp/worker-230547-62554/t.200257/CMSSW_9_4_0_patch1/bin/slc7_amd64_gcc630:/disk/vc3-root/tmp/worker-230547-62554/t.200257/CMSSW_9_4_0_patch1/external/slc7_amd64_gcc630/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/bin/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/external/slc7_amd64_gcc630/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw/CMSSW_9_4_0/bin/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/llvm/4.0.1/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/sbin:/cvmfs/cms.cern.ch/common:/cvmfs/cms.cern.ch/bin:/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:/bin == env: VC3_ENV_TAG_GLOBAL=62302 == env: SRT_DBS_CLIENT_CONFIG_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/dbs-client/DBS_2_1_9-fmblme/lib/DBSAPI/dbs.config == env: SRT_CMSSW_SEARCH_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-62554/t.200257/CMSSW_9_4_0_patch1/src:/disk/vc3-root/tmp/worker-230547-62554/t.200257/CMSSW_9_4_0_patch1/external/slc7_amd64_gcc630/data:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/external/slc7_amd64_gcc630/data == env: SRT_GIT_SSL_CAINFO_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/git/2.13.0/share/ssl/certs/ca-bundle.crt == env: CMS_PATH=/cvmfs/cms.cern.ch == env: VC3_ROOT=/disk/vc3-root == env: SRT_UTM_XSD_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/utm/utm_0.6.5-fmblme == env: SRT_PATH_SCRAMRT=/cvmfs/cms.cern.ch/share/overrides/bin:/disk/vc3-root/tmp/worker-230547-62554/t.200257/CMSSW_9_4_0_patch1/bin/slc7_amd64_gcc630:/disk/vc3-root/tmp/worker-230547-62554/t.200257/CMSSW_9_4_0_patch1/external/slc7_amd64_gcc630/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/bin/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/external/slc7_amd64_gcc630/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw/CMSSW_9_4_0/bin/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/llvm/4.0.1/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0/bin == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-5fwDTx == env: RIVET_ANALYSIS_PATH=/disk/vc3-root/tmp/worker-230547-62554/t.200257/CMSSW_9_4_0_patch1/lib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/lib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/rivet/2.5.4/lib == env: SRT_LOCALRT_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-62554/t.200257/CMSSW_9_4_0_patch1 == env: SRT_CMSSW_BASE_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-62554/t.200257/CMSSW_9_4_0_patch1 == env: PWD=/disk/vc3-root/tmp/worker-230547-62554/t.200257 == env: VC3_ROOT_PKG_CONFIG=/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: SRT_OPAL_PREFIX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/openmpi/2.1.2rc4 == env: VC3_VERSION_WHICH=2.20 == env: LANG=C == env: SRT_QTDIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: SRT_G4NEUTRONHPDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4NDL/4.5/data/G4NDL4.5 == env: X509_VOMS_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/etc/grid-security/vomsdir == env: LOBSTER_LCG_CP= == env: SRT_SHERPA_SHARE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sherpa/2.2.4-fmblme2/share/SHERPA-MC == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-62554 == env: CASCADE_PDFPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/cascade/2.2.04-fmblme/share == env: SRT_ROOT_GCC_TOOLCHAIN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0 == env: SRT_CASCADE_PDFPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/cascade/2.2.04-fmblme/share == env: WORKER_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/blackhat/0.9.9-fmblme/share/blackhat/datafiles/ == env: GIT_TEMPLATE_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/git/2.13.0/share/git-core/templates == env: G4SAIDXSDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4SAIDDATA/1.1/data/G4SAIDDATA1.1 == env: SRT_DBSCMD_HOME_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/dbs-client/DBS_2_1_9-fmblme/lib/DBSAPI == env: SRT_CMSSW_FULL_RELEASE_BASE_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw/CMSSW_9_4_0 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: SRT_CMSSW_FWLITE_INCLUDE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sherpa/2.2.4-fmblme2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/hepmc/2.06.07/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/clhep/2.3.4.2-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/boost/1.63.0-fmblme/include == env: SRT_PYTHONPATH_SCRAMRT=/disk/vc3-root/tmp/worker-230547-62554/t.200257/CMSSW_9_4_0_patch1/python:/disk/vc3-root/tmp/worker-230547-62554/t.200257/CMSSW_9_4_0_patch1/lib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/lib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw/CMSSW_9_4_0/bin/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw/CMSSW_9_4_0/lib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/coral/CORAL_2_3_21-fmblme3/slc7_amd64_gcc630/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/coral/CORAL_2_3_21-fmblme3/slc7_amd64_gcc630/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/professor2/2.2.1-fmblme4/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/pyqt/4.11.4-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sherpa/2.2.4-fmblme2/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/rivet/2.5.4/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/python-ldap/2.4.10-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-matplotlib/1.5.2-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sip/4.17-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/llvm/4.0.1/lib64/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-sqlalchemy/1.1.4-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-lint/0.25.1-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-dxr/1.0-fmblme3/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-cx-oracle/5.2.1-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-numpy/1.12.1-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/frontier_client/2.8.20-fmblme/python/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/das_client/v03.01.00-fmblme/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/xrootd/4.6.1-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/yoda/1.6.7/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/lcg/root/6.10.08/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/pyminuit2/0.0.1-fmblme3/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-PyYAML/3.11-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-pygithub/1.23.0-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-pip/9.0.1-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-dablooms/0.9.1-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-pippkgs_depscipy/3.0-fmblme3/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-pippkgs/6.0-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/professor/1.4.0-fmblme3/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/dbs-client/DBS_2_1_9-fmblme/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/dbs-client/DBS_2_1_9-fmblme/lib/DBSAPI:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/cvs2git/5419-fmblme/lib == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: ROOTSYS=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/lcg/root/6.10.08/ == env: SRT_PYTHIA8DATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/pythia8/230/share/Pythia8/xmldoc == env: SRT_HERWIGPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/herwigpp/2.7.1-fmblme/share/Herwig++ == env: CXX=g++ == env: SRT_QTLIB_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/lib == env: SHERPA_LIBRARY_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sherpa/2.2.4-fmblme2/lib/SHERPA-MC == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: CMSSW_SEARCH_PATH=/disk/vc3-root/tmp/worker-230547-62554/t.200257/CMSSW_9_4_0_patch1/src:/disk/vc3-root/tmp/worker-230547-62554/t.200257/CMSSW_9_4_0_patch1/external/slc7_amd64_gcc630/data:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/external/slc7_amd64_gcc630/data == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: DISK=6000 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-62554/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-62554/cache/tmp/cvmfs == env: ROOT_TTREECACHE_PREFILL=0 == env: GENREFLEX=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/lcg/root/6.10.08/bin/genreflex == env: VINCIADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/vincia/2.2.01-fmblme/share/Vincia/xmldoc == env: SRT_G4LEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4EMLOW/6.48/data/G4EMLOW6.48 == env: SRT_GENREFLEX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/lcg/root/6.10.08/bin/genreflex == env: MALLOC_CONF=lg_chunk:18,lg_dirty_mult:4 == env: SRT_ROOT_TTREECACHE_SIZE_SCRAMRTDEL=0 == env: SRT_EVTGENDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/evtgen/1.6.0-fmblme2/share == env: GFAL_CONFIG_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/etc/gfal2.d/ == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=7800 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: SRT_CMSSW_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms == env: HEPPDT_PARAM_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/heppdt/3.03.00-fmblme2 == env: SRT_LD_LIBRARY_PATH_SCRAMRT=/disk/vc3-root/tmp/worker-230547-62554/t.200257/CMSSW_9_4_0_patch1/biglib/slc7_amd64_gcc630:/disk/vc3-root/tmp/worker-230547-62554/t.200257/CMSSW_9_4_0_patch1/lib/slc7_amd64_gcc630:/disk/vc3-root/tmp/worker-230547-62554/t.200257/CMSSW_9_4_0_patch1/external/slc7_amd64_gcc630/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/biglib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/lib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/external/slc7_amd64_gcc630/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw/CMSSW_9_4_0/biglib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw/CMSSW_9_4_0/lib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/llvm/4.0.1/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0/lib == env: TMP=/disk/vc3-root/tmp/worker-230547-62554/t.200257/cctools-temp-t.200257.E2o8km == env: PYTHONPATH=/disk/vc3-root/tmp/worker-230547-62554/t.200257/CMSSW_9_4_0_patch1/python:/disk/vc3-root/tmp/worker-230547-62554/t.200257/CMSSW_9_4_0_patch1/lib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/lib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw/CMSSW_9_4_0/bin/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw/CMSSW_9_4_0/lib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/coral/CORAL_2_3_21-fmblme3/slc7_amd64_gcc630/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/coral/CORAL_2_3_21-fmblme3/slc7_amd64_gcc630/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/professor2/2.2.1-fmblme4/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/pyqt/4.11.4-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sherpa/2.2.4-fmblme2/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/rivet/2.5.4/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/python-ldap/2.4.10-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-matplotlib/1.5.2-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sip/4.17-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/llvm/4.0.1/lib64/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-sqlalchemy/1.1.4-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-lint/0.25.1-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-dxr/1.0-fmblme3/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-cx-oracle/5.2.1-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-numpy/1.12.1-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/frontier_client/2.8.20-fmblme/python/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/das_client/v03.01.00-fmblme/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/xrootd/4.6.1-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/yoda/1.6.7/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/lcg/root/6.10.08/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/pyminuit2/0.0.1-fmblme3/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-PyYAML/3.11-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-pygithub/1.23.0-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-pip/9.0.1-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-dablooms/0.9.1-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-pippkgs_depscipy/3.0-fmblme3/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-pippkgs/6.0-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/professor/1.4.0-fmblme3/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/dbs-client/DBS_2_1_9-fmblme/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/dbs-client/DBS_2_1_9-fmblme/lib/DBSAPI:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/cvs2git/5419-fmblme/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib/python2.7/site-packages:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib64/python2.7/site-packages:python:python: == env: QTLIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/lib == env: SCONS_LIB_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/scons/1.2.0-fmblme/lib == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: FRONTIER_CLIENT=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/frontier_client/2.8.20-fmblme/ == env: SRT_G4NEUTRONXSDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4NEUTRONXS/1.4/data/G4NEUTRONXS1.4 == env: SRT_SHERPA_LIBRARY_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sherpa/2.2.4-fmblme2/lib/SHERPA-MC == env: VC3_ROOT_TAR=/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CLHEP_PARAM_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/clhep/2.3.4.2-fmblme == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-5fwDTx.wrapper == env: HERWIGPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/herwigpp/2.7.1-fmblme/share/Herwig++ == env: PYTHIA8DATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/pythia8/230/share/Pythia8/xmldoc == env: SRT_FRONTIER_CLIENT_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/frontier_client/2.8.20-fmblme/ == env: SRT_CSC_TRACK_FINDER_DATA_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/CSCTrackFinderEmulation/1.2/data/ == env: SRT_ROOT_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/madgraph5amcatnlo/2.4.3-fmblme3 == env: CC=gcc == env: TEXMFHOME=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/rivet/2.5.4/share/Rivet/texmf == env: SRT_OPENBLAS_NUM_THREADS_SCRAMRTDEL=1 == env: SRT_GIT_TEMPLATE_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/git/2.13.0/share/git-core/templates == env: SRT_G4SAIDXSDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4SAIDDATA/1.1/data/G4SAIDDATA1.1 == env: CMSSW_VERSION=CMSSW_9_4_0_patch1 == env: SRT_LANG_SCRAMRTDEL=C == env: CCTOOLS_RESOURCE_MONITOR_INFO=1025 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=6 == env: PARROT_DEBUG_FLAGS= == env: SHERPA_SHARE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sherpa/2.2.4-fmblme2/share/SHERPA-MC == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: CMS_OPENLOOPS_PREFIX=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/openloops/1.3.1-fmblme == env: GIT_EXEC_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/git/2.13.0/libexec/git-core == env: LOCALRT=/disk/vc3-root/tmp/worker-230547-62554/t.200257/CMSSW_9_4_0_patch1 == env: CMSSW_BASE=/disk/vc3-root/tmp/worker-230547-62554/t.200257/CMSSW_9_4_0_patch1 == env: SRT_VALGRIND_LIB_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/valgrind/3.12.0/lib/valgrind == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_ALL_postLHE.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=37627 == env: _=/bin/env === wrapper ready @ Thu Nov 28 12:33:05 EST 2019 ==== working directory before execution @ Thu Nov 28 12:33:05 EST 2019 ==== == dir: total 28292 == dir: drwxr-xr-x 17 kmohrman campus 265 Nov 28 12:32 CMSSW_9_4_0_patch1 == dir: -rw-r--r-- 3 kmohrman campus 28090622 Nov 27 22:40 HIG-RunIIFall17DRPremix-00823_1_cfg.py == dir: drwxr-xr-x 2 kmohrman campus 91 Nov 28 12:31 bin == dir: -rwxr-xr-x 3 kmohrman campus 627272 Nov 27 21:54 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 Nov 28 12:31 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 Nov 28 12:31 cctools-temp-t.200257.E2o8km == dir: -rw------- 1 kmohrman campus 51 Nov 28 12:32 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 Nov 28 12:32 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 Nov 28 12:31 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 Nov 28 12:31 librmonitor_helper.so.6EG5eA == dir: -rw-r--r-- 2 kmohrman campus 2201 Nov 28 12:31 parameters.json == dir: -rw------- 2 kmohrman campus 9194 Nov 28 12:31 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 Nov 28 12:31 python == dir: -rw-r--r-- 3 kmohrman campus 570 Nov 27 21:54 report.json.in == dir: -rw-r--r-- 3 kmohrman campus 492 Nov 27 21:54 sandbox-CMSSW_9_4_0_patch1-slc7_amd64_gcc630.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 49 Nov 28 12:31 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 Nov 28 12:33 t_wrapper_ready == dir: -rw-r--r-- 1 kmohrman campus 11 Nov 28 12:32 t_wrapper_start == dir: -rwxr-xr-x 3 kmohrman campus 47217 Nov 27 21:54 task.py == dir: -rwxr-xr-x 3 kmohrman campus 6296 Nov 27 21:54 wrapper.sh >>> data is {u'files': {u'info': {}, u'output_info': {}, u'skipped': []}, u'cpu_time': 0, u'exe_exit_code': 0, u'events_written': 0, u'output_size': 0, u'task_exit_code': 0, u'output_storage_element': u'', u'cache': {u'start_size': 0, u'type': 2, u'end_size': 0}, u'stageout_exit_code': 0, u'output_bare_size': 0, u'transfers': defaultdict(, {}), u'task_timing': {u'wrapper_ready': 0, u'wrapper_start': 0, u'prologue_end': 0, u'epilogue_end': 0, u'stage_out_end': 0, u'stage_in_end': 0, u'processing_end': 0}, u'events_per_run': 0} @ Thu Nov 28 12:33:20 2019 >>> Trying hdfs client access method @ Thu Nov 28 12:33:20 2019 >>> executing 'timeout 300 hdfs dfs -fs hdfs://eddie.crc.nd.edu:19000 -get /store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/gs_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17wmLHEGS-00040ND_180160.root HIG-RunIIFall17wmLHEGS-00040ND_180160.root' @ Thu Nov 28 12:33:20 2019 >> using /disk/vc3-root/tmp/worker-230547-62554/t.200257/cctools-temp-t.200257.E2o8km/tmphXRXGN to store command output >> cmd: timeout: failed to run command 'hdfs': No such file or directory >>>>> Unable to copy input with hdfs client @ Thu Nov 28 12:33:20 2019 >>> Trying xrootd access method @ Thu Nov 28 12:33:20 2019 >>> executing 'env XRD_LOGLEVEL=Debug timeout 300 xrdfs deepthought.crc.nd.edu stat /store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/gs_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17wmLHEGS-00040ND_180160.root' @ Thu Nov 28 12:33:20 2019 >> using /disk/vc3-root/tmp/worker-230547-62554/t.200257/cctools-temp-t.200257.E2o8km/tmpHIxRb3 to store command output >> cmd: [2019-11-28 12:33:20.452984 -0500][Warning][Utility ] Unable to process global config file: [ERROR] OS Error: No such file or directory >> cmd: [2019-11-28 12:33:20.454707 -0500][Debug ][Utility ] Unable to process user config file: [ERROR] OS Error: No such file or directory >> cmd: [2019-11-28 12:33:20.455031 -0500][Debug ][PlugInMgr ] Initializing plug-in manager... >> cmd: [2019-11-28 12:33:20.455107 -0500][Debug ][PlugInMgr ] No default plug-in, loading plug-in configs... >> cmd: [2019-11-28 12:33:20.455180 -0500][Debug ][PlugInMgr ] Processing plug-in definitions in /etc/xrootd/client.plugins.d... >> cmd: [2019-11-28 12:33:20.455328 -0500][Debug ][PlugInMgr ] Unable to process directory /etc/xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2019-11-28 12:33:20.455902 -0500][Debug ][PlugInMgr ] Processing plug-in definitions in /tmp/runos_singularity_home-105528577364123566088788955016357157944/.xrootd/client.plugins.d... >> cmd: [2019-11-28 12:33:20.456041 -0500][Debug ][PlugInMgr ] Unable to process directory /tmp/runos_singularity_home-105528577364123566088788955016357157944/.xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2019-11-28 12:33:20.456459 -0500][Debug ][App ] Executing: stat /store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/gs_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17wmLHEGS-00040ND_180160.root >> cmd: [2019-11-28 12:33:20.456656 -0500][Debug ][Poller ] Available pollers: built-in >> cmd: [2019-11-28 12:33:20.456722 -0500][Debug ][Poller ] Attempting to create a poller according to preference: built-in >> cmd: [2019-11-28 12:33:20.456787 -0500][Debug ][Poller ] Creating poller: built-in >> cmd: [2019-11-28 12:33:20.456862 -0500][Debug ][Poller ] Creating and starting the built-in poller... >> cmd: [2019-11-28 12:33:20.457520 -0500][Debug ][Poller ] Using 1 poller threads >> cmd: [2019-11-28 12:33:20.457610 -0500][Debug ][TaskMgr ] Starting the task manager... >> cmd: [2019-11-28 12:33:20.457871 -0500][Debug ][TaskMgr ] Task manager started >> cmd: [2019-11-28 12:33:20.457960 -0500][Debug ][JobMgr ] Starting the job manager... >> cmd: [2019-11-28 12:33:20.458604 -0500][Debug ][JobMgr ] Job manager started, 3 workers >> cmd: [2019-11-28 12:33:20.458694 -0500][Debug ][TaskMgr ] Registering task: "FileTimer task" to be run at: [2019-11-28 12:33:20 -0500] >> cmd: [2019-11-28 12:33:20.458832 -0500][Debug ][PostMaster ] Creating new channel to: deepthought.crc.nd.edu:1094 1 stream(s) >> cmd: [2019-11-28 12:33:20.459012 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Widnow: 1800 >> cmd: [2019-11-28 12:33:20.460932 -0500][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" to be run at: [2019-11-28 12:33:35 -0500] >> cmd: [2019-11-28 12:33:20.463056 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2019-11-28 12:33:20.463339 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2019-11-28 12:33:20.463535 -0500][Debug ][Poller ] Adding socket 0x1645790 to the poller >> cmd: [2019-11-28 12:33:20.464076 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2019-11-28 12:33:20.464309 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2019-11-28 12:33:20.465205 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Got the server hand shake response (type: manager [], protocol version 310) >> cmd: [2019-11-28 12:33:20.465562 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] kXR_protocol successful (type: manager [], protocol version 310) >> cmd: [2019-11-28 12:33:20.471214 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=qa-2080ti-003.crc.nd.edu&xrd.rn=v4.6.1, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2019-11-28 12:33:20.472009 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Logged in, session: 14d1020053943f003200000014d10200 >> cmd: [2019-11-28 12:33:20.472174 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream 0 connected. >> cmd: [2019-11-28 12:33:20.472274 -0500][Debug ][Utility ] Monitor library name not set. No monitoring >> cmd: [2019-11-28 12:33:20.473548 -0500][Debug ][PostMaster ] Creating new channel to: primeradiant03.crc.nd.edu:1096 1 stream(s) >> cmd: [2019-11-28 12:33:20.473699 -0500][Debug ][PostMaster ] [primeradiant03.crc.nd.edu:1096 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Widnow: 1800 >> cmd: [2019-11-28 12:33:20.476205 -0500][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: primeradiant03.crc.nd.edu:1096" to be run at: [2019-11-28 12:33:35 -0500] >> cmd: [2019-11-28 12:33:20.478043 -0500][Debug ][PostMaster ] [primeradiant03.crc.nd.edu:1096] Found 1 address(es): [::ffff:149.165.243.11]:1096 >> cmd: [2019-11-28 12:33:20.478337 -0500][Debug ][AsyncSock ] [primeradiant03.crc.nd.edu:1096 #0.0] Attempting connection to [::ffff:149.165.243.11]:1096 >> cmd: [2019-11-28 12:33:20.478532 -0500][Debug ][Poller ] Adding socket 0x9c0016a0 to the poller >> cmd: [2019-11-28 12:33:20.478831 -0500][Debug ][AsyncSock ] [primeradiant03.crc.nd.edu:1096 #0.0] Async connection call returned >> cmd: [2019-11-28 12:33:20.479108 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2019-11-28 12:33:20.480019 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Got the server hand shake response (type: server [], protocol version 310) >> cmd: [2019-11-28 12:33:20.480476 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] kXR_protocol successful (type: server [], protocol version 310) >> cmd: [2019-11-28 12:33:20.485189 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=qa-2080ti-003.crc.nd.edu&xrd.rn=v4.6.1, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2019-11-28 12:33:20.486011 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Logged in, session: c6010000b4690000fd010000c6010000 >> cmd: [2019-11-28 12:33:20.486112 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Authentication is required: &P=gsi,v:10300,c:ssl,ca:ba240aa8.0|f5f0dfc2.0 >> cmd: [2019-11-28 12:33:20.486215 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Sending authentication data >> cmd: [2019-11-28 12:33:20.500104 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Trying to authenticate using gsi >> cmd: [2019-11-28 12:33:20.641085 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Sending more authentication data for gsi >> cmd: [2019-11-28 12:33:20.652548 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Authenticated with gsi. >> cmd: [2019-11-28 12:33:20.652770 -0500][Debug ][PostMaster ] [primeradiant03.crc.nd.edu:1096 #0] Stream 0 connected. >> cmd: Path: /store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/gs_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17wmLHEGS-00040ND_180160.root >> cmd: Id: 0 >> cmd: Size: 118423326 >> cmd: MTime: 2019-11-28 12:30:36 >> cmd: Flags: 24 (Offline|IsReadable) >> cmd: [2019-11-28 12:33:20.703765 -0500][Debug ][JobMgr ] Stopping the job manager... >> cmd: [2019-11-28 12:33:20.705617 -0500][Debug ][JobMgr ] Job manager stopped >> cmd: [2019-11-28 12:33:20.705778 -0500][Debug ][TaskMgr ] Stopping the task manager... >> cmd: [2019-11-28 12:33:20.706274 -0500][Debug ][TaskMgr ] Task manager stopped >> cmd: [2019-11-28 12:33:20.706425 -0500][Debug ][Poller ] Stopping the poller... >> cmd: [2019-11-28 12:33:20.707235 -0500][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" >> cmd: [2019-11-28 12:33:20.707358 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2019-11-28 12:33:20.707502 -0500][Debug ][Poller ] <[::ffff:10.32.88.156]:44800><--><[::ffff:129.74.85.55]:1094> Removing socket from the poller >> cmd: [2019-11-28 12:33:20.707718 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Destroying stream >> cmd: [2019-11-28 12:33:20.707827 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2019-11-28 12:33:20.707943 -0500][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: primeradiant03.crc.nd.edu:1096" >> cmd: [2019-11-28 12:33:20.708047 -0500][Debug ][AsyncSock ] [primeradiant03.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2019-11-28 12:33:20.708150 -0500][Debug ][Poller ] <[::ffff:10.32.88.156]:57024><--><[::ffff:149.165.243.11]:1096> Removing socket from the poller >> cmd: [2019-11-28 12:33:20.708328 -0500][Debug ][PostMaster ] [primeradiant03.crc.nd.edu:1096 #0] Destroying stream >> cmd: [2019-11-28 12:33:20.708438 -0500][Debug ][AsyncSock ] [primeradiant03.crc.nd.edu:1096 #0.0] Closing the socket >>> will stream using xrootd instead of copying @ Thu Nov 28 12:33:20 2019 >>> modified input files @ Thu Nov 28 12:33:20 2019 >> input: root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/gs_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17wmLHEGS-00040ND_180160.root >>> updated parameters are @ Thu Nov 28 12:33:20 2019 >> json: { >> json: "accelerate stage-in": 3, >> json: "arguments": [], >> json: "cores": 6, >> json: "default ce": "T3_US_NotreDame", >> json: "default host": "earth.crc.nd.edu", >> json: "default se": "T3_US_NotreDame", >> json: "disable streaming": false, >> json: "epilogue": null, >> json: "executable": "cmsRun", >> json: "file map": { >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/gs_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17wmLHEGS-00040ND_180160.root": "gs_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17wmLHEGS-00040ND_180160.root" >> json: }, >> json: "gridpack": false, >> json: "input": [ >> json: "hdfs://eddie.crc.nd.edu:19000/store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2", >> json: "file:///hadoop/store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/" >> json: ], >> json: "mask": { >> json: "events": -1, >> json: "files": [ >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/gs_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17wmLHEGS-00040ND_180160.root" >> json: ], >> json: "lumis": { >> json: "1": [ >> json: [ >> json: 18131, >> json: 18131 >> json: ] >> json: ] >> json: } >> json: }, >> json: "monitoring": { >> json: "monitorid": "200257_https://T3_US_NotreDame/81a68453f4230ce5/200257", >> json: "syncid": "https://T3_US_NotreDame//lobster_kmohrman_EFT_ALL_postLHE_20191125_1406_950e38e7512e18cd//12345.200257", >> json: "taskid": "lobster_kmohrman_EFT_ALL_postLHE_20191125_1406_950e38e7512e18cd" >> json: }, >> json: "output": [ >> json: "hdfs://eddie.crc.nd.edu:19000/store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2", >> json: "file:///hadoop/store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/" >> json: ], >> json: "output files": [ >> json: [ >> json: "HIG-RunIIFall17DRPremix-00823ND_step1.root", >> json: "digi_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17DRPremix-00823ND_step1_200257.root" >> json: ] >> json: ], >> json: "prologue": null, >> json: "pset": "HIG-RunIIFall17DRPremix-00823_1_cfg.py", >> json: "want summary": true >> json: } >>> using sync CE T3_US_NotreDame @ Thu Nov 28 12:33:20 2019 >>> config file fragment @ Thu Nov 28 12:33:22 2019 >> pset: >> pset: import FWCore.ParameterSet.Config as cms >> pset: process.Timing = cms.Service("Timing", >> pset: useJobReport = cms.untracked.bool(True), >> pset: summaryOnly = cms.untracked.bool(True)) >> pset: >> pset: process.maxEvents = cms.untracked.PSet(input = cms.untracked.int32(-1)) >> pset: >> pset: import os >> pset: _, major, minor, _ = os.environ["CMSSW_VERSION"].split('_', 3) >> pset: if int(major) >= 7 and int(minor) >= 4: >> pset: xrdstats = cms.Service("XrdAdaptor::XrdStatisticsService", cms.untracked.PSet(reportToFJR = cms.untracked.bool(True))) >> pset: process.add_(xrdstats) >> pset: >> pset: for prod in process.producers.values(): >> pset: if prod.hasParameter('nEvents') and prod.type_() == 'ExternalLHEProducer': >> pset: prod.nEvents = cms.untracked.uint32(-1) >> pset: >> pset: process.source.fileNames = cms.untracked.vstring(['root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/gs_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17wmLHEGS-00040ND_180160.root']) >> pset: process.source.lumisToProcess = cms.untracked.VLuminosityBlockRange(['1:18131']) >> pset: if hasattr(process, 'options'): >> pset: process.options.wantSummary = cms.untracked.bool(True) >> pset: else: >> pset: process.options = cms.untracked.PSet(wantSummary = cms.untracked.bool(True)) >> pset: >> pset: if hasattr(process, 'options'): >> pset: process.options.numberOfThreads = cms.untracked.uint32(6) >> pset: process.options.numberOfStreams = cms.untracked.uint32(0) >> pset: else: >> pset: process.options = cms.untracked.PSet( >> pset: numberOfThreads = cms.untracked.uint32(6), >> pset: numberOfStreams = cms.untracked.uint32(0) >> pset: ) >>> executing 'cmsRun -j report.xml HIG-RunIIFall17DRPremix-00823_1_cfg_mod.py' @ Thu Nov 28 12:33:22 2019 >> using /disk/vc3-root/tmp/worker-230547-62554/t.200257/cctools-temp-t.200257.E2o8km/tmp3aG3_3 to store command output 2019/11/28 12:43:20.14 parrot_run[12092] notice: warning: system call 101 (ptrace) not supported for program /cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gdb/7.12.1/bin/gdb >> cmd: >> cmd: !!!!! WARNING: The BMTF Packer returns the entire detector information in one fed (# 1376), instead of the real BMTF which owns 2 feds (1376, 1377) !!!!! >> cmd: >> cmd: %MSG-i ThreadStreamSetup: (NoModuleName) 28-Nov-2019 12:33:53 EST pre-events >> cmd: setting # threads 6 >> cmd: setting # streams 6 >> cmd: %MSG >> cmd: 28-Nov-2019 12:34:06 EST Initiating request to open file root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/gs_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17wmLHEGS-00040ND_180160.root >> cmd: 28-Nov-2019 12:34:11 EST Successfully opened file root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/gs_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17wmLHEGS-00040ND_180160.root >> cmd: 28-Nov-2019 12:34:18 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/00011/FEFEEE1F-000F-E811-9B1C-0025905A612C.root >> cmd: 28-Nov-2019 12:34:20 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/00011/FEFEEE1F-000F-E811-9B1C-0025905A612C.root >> cmd: 28-Nov-2019 12:34:27 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/20031/3A2CF878-0412-E811-8925-0CC47A4D7602.root >> cmd: 28-Nov-2019 12:34:34 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/20031/3A2CF878-0412-E811-8925-0CC47A4D7602.root >> cmd: 28-Nov-2019 12:34:40 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/80015/E0A6F2E5-2D10-E811-8C9D-008CFAF721CA.root >> cmd: 28-Nov-2019 12:34:50 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/80015/E0A6F2E5-2D10-E811-8C9D-008CFAF721CA.root >> cmd: 28-Nov-2019 12:35:00 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/40014/3A8416EF-D50D-E811-B6E1-0CC47A4D767A.root >> cmd: 28-Nov-2019 12:35:08 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/40014/3A8416EF-D50D-E811-B6E1-0CC47A4D767A.root >> cmd: 28-Nov-2019 12:35:19 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/00002/6439FCD4-260D-E811-B614-7CD30AD09FDC.root >> cmd: 28-Nov-2019 12:35:27 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/00002/6439FCD4-260D-E811-B614-7CD30AD09FDC.root >> cmd: 28-Nov-2019 12:35:36 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/20006/2040BB1D-BA0E-E811-BC4F-0025905B8572.root >> cmd: 28-Nov-2019 12:35:39 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/20006/2040BB1D-BA0E-E811-BC4F-0025905B8572.root >> cmd: Begin processing the 1st record. Run 1, Event 21, LumiSection 18131 at 28-Nov-2019 12:37:08.436 EST >> cmd: Begin processing the 2nd record. Run 1, Event 28, LumiSection 18131 at 28-Nov-2019 12:37:08.456 EST >> cmd: Begin processing the 3rd record. Run 1, Event 54, LumiSection 18131 at 28-Nov-2019 12:37:08.474 EST >> cmd: Begin processing the 4th record. Run 1, Event 44, LumiSection 18131 at 28-Nov-2019 12:37:08.495 EST >> cmd: Begin processing the 5th record. Run 1, Event 41, LumiSection 18131 at 28-Nov-2019 12:37:08.510 EST >> cmd: Begin processing the 6th record. Run 1, Event 58, LumiSection 18131 at 28-Nov-2019 12:37:08.527 EST >> cmd: 28-Nov-2019 12:37:12 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/00002/6439FCD4-260D-E811-B614-7CD30AD09FDC.root >> cmd: 28-Nov-2019 12:37:12 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/00006/E89A160F-2E0D-E811-9B63-0CC47A4C8F2C.root >> cmd: 28-Nov-2019 12:37:16 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/00006/E89A160F-2E0D-E811-9B63-0CC47A4C8F2C.root >> cmd: 28-Nov-2019 12:37:16 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/40014/3A8416EF-D50D-E811-B6E1-0CC47A4D767A.root >> cmd: 28-Nov-2019 12:37:16 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/00011/FEFEEE1F-000F-E811-9B1C-0025905A612C.root >> cmd: 28-Nov-2019 12:37:16 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/20031/3A2CF878-0412-E811-8925-0CC47A4D7602.root >> cmd: 28-Nov-2019 12:37:16 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/80015/E0A6F2E5-2D10-E811-8C9D-008CFAF721CA.root >> cmd: 28-Nov-2019 12:37:16 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/40010/1A3D4FB0-4D0D-E811-93B3-0CC47A4C8EA8.root >> cmd: 28-Nov-2019 12:37:16 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/20013/20166458-DB10-E811-8EFE-0242AC130002.root >> cmd: 28-Nov-2019 12:37:16 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/20006/2040BB1D-BA0E-E811-BC4F-0025905B8572.root >> cmd: 28-Nov-2019 12:37:16 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/40029/D63100F2-F70F-E811-8AE0-008CFAF747AA.root >> cmd: 28-Nov-2019 12:37:16 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/40004/CAD61D73-A00C-E811-B90A-0CC47A4D769E.root >> cmd: 28-Nov-2019 12:37:16 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/20006/56DF47DA-D80D-E811-93AB-0CC47A7C34A0.root >> cmd: 28-Nov-2019 12:37:23 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/40029/D63100F2-F70F-E811-8AE0-008CFAF747AA.root >> cmd: 28-Nov-2019 12:37:31 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/40010/1A3D4FB0-4D0D-E811-93B3-0CC47A4C8EA8.root >> cmd: 28-Nov-2019 12:37:38 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/20013/20166458-DB10-E811-8EFE-0242AC130002.root >> cmd: 28-Nov-2019 12:37:45 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/20006/56DF47DA-D80D-E811-93AB-0CC47A7C34A0.root >> cmd: 28-Nov-2019 12:37:52 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/40004/CAD61D73-A00C-E811-B90A-0CC47A4D769E.root >> cmd: Begin processing the 7th record. Run 1, Event 11, LumiSection 18131 at 28-Nov-2019 12:38:21.864 EST >> cmd: Begin processing the 8th record. Run 1, Event 66, LumiSection 18131 at 28-Nov-2019 12:38:22.728 EST >> cmd: Begin processing the 9th record. Run 1, Event 78, LumiSection 18131 at 28-Nov-2019 12:38:24.196 EST >> cmd: Begin processing the 10th record. Run 1, Event 68, LumiSection 18131 at 28-Nov-2019 12:38:26.110 EST >> cmd: Begin processing the 11th record. Run 1, Event 73, LumiSection 18131 at 28-Nov-2019 12:38:27.678 EST >> cmd: Begin processing the 12th record. Run 1, Event 85, LumiSection 18131 at 28-Nov-2019 12:38:29.737 EST >> cmd: Begin processing the 13th record. Run 1, Event 84, LumiSection 18131 at 28-Nov-2019 12:38:30.046 EST >> cmd: %MSG-e CaloHitResponse: DataMixingModule:mixData 28-Nov-2019 12:38:30 EST Run: 1 Event: 85 >> cmd: Mismatched calo signals >> cmd: %MSG >> cmd: Begin processing the 14th record. Run 1, Event 86, LumiSection 18131 at 28-Nov-2019 12:38:33.270 EST >> cmd: %MSG-w InvalidInputTag: CSCHaloDataProducer:hltCSCHaloData 28-Nov-2019 12:38:34 EST Run: 1 Event: 85 >> cmd: The Cosmic Muon collection does not appear to be in the event. These beam halo identification variables will be empty >> cmd: %MSG >> cmd: Begin processing the 15th record. Run 1, Event 81, LumiSection 18131 at 28-Nov-2019 12:38:35.007 EST >> cmd: Begin processing the 16th record. Run 1, Event 90, LumiSection 18131 at 28-Nov-2019 12:38:35.341 EST >> cmd: Begin processing the 17th record. Run 1, Event 94, LumiSection 18131 at 28-Nov-2019 12:38:35.653 EST >> cmd: Begin processing the 18th record. Run 1, Event 93, LumiSection 18131 at 28-Nov-2019 12:38:38.987 EST >> cmd: %MSG-w InvalidHelix: SeedCreatorFromRegionConsecutiveHitsTripletOnlyEDProducer:hltFullIter8PixelLessSeeds 28-Nov-2019 12:38:39 EST Run: 1 Event: 84 >> cmd: PixelClusterShapeSeedComparitor helix is not valid, result is bad >> cmd: %MSG >> cmd: %MSG-w InvalidHelix: SeedCreatorFromRegionConsecutiveHitsEDProducer:hltFullIter9TobTecSeedsPair 28-Nov-2019 12:38:39 EST Run: 1 Event: 86 >> cmd: PixelClusterShapeSeedComparitor helix is not valid, result is bad >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:38:39 EST Run: 1 Event: 94 >> cmd: local error not pos-def >> cmd: [ -15055.7 -1396.89 -123.81 0.000889449-4.42702e-05 >> cmd: -1396.89 -129.605 -11.4872 8.25988e-05-4.10651e-06 >> cmd: -123.81 -11.4872 -1.01814 7.31406e-06-1.80026e-07 >> cmd: 0.000889449 8.25988e-05 7.31406e-06 1.66216e-06 4.15108e-12 >> cmd: -4.42702e-05-4.10651e-06-1.80026e-07 4.15108e-12 4.10105e-06 ] >> cmd: pos/mom/mf (-1.33877,-15.7946,32.1515) (-5.7892,-68.1208,129.343) (-8.81857e-05,-0.0010404,3.80953) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:38:39 EST Run: 1 Event: 94 >> cmd: curv error not pos-def >> cmd: [ -15055.7 -1.4923 2309.52-0.000836162 0.00011144 >> cmd: -1.4923-0.000147899 0.228916-9.90646e-08 1.34313e-07 >> cmd: 2309.52 0.228916 -354.276 0.000128384-1.71276e-05 >> cmd: -0.000836162-9.90646e-08 0.000128384 1.48408e-06-4.28749e-07 >> cmd: 0.00011144 1.34313e-07-1.71276e-05-4.28749e-07 3.30298e-06 ] >> cmd: pos/mom/mf (-1.33877,-15.7946,32.1515) (-5.7892,-68.1208,129.343) (-8.81857e-05,-0.0010404,3.80953) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:38:39 EST Run: 1 Event: 94 >> cmd: curv error not pos-def >> cmd: [ -15055.7 -1.49708 6322.86 47101.9 -2.88316 >> cmd: -1.49708-0.000148849 0.62872 4.68362 -0.00028623 >> cmd: 6322.86 0.62872 -2655.38 -19781.1 1.21083 >> cmd: 47101.9 4.68362 -19781.1 -147358 9.01998 >> cmd: -2.88316 -0.00028623 1.21083 9.01998-0.000535185 ] >> cmd: pos/mom/mf (-2.27276,-26.6673,52.7976) (-5.91322,-68.1101,129.343) (-0.000245797,-0.00288406,3.80648) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:38:39 EST Run: 1 Event: 94 >> cmd: local error not pos-def >> cmd: [ -15055.7 -6315.33 454.387 -47137.8 3346.79 >> cmd: -6315.33 -2649.05 190.599 -19772.6 1403.85 >> cmd: 454.387 190.599 -13.7136 1422.64 -101.007 >> cmd: -47137.8 -19772.6 1422.64 -147583 10478.4 >> cmd: 3346.79 1403.85 -101.007 10478.4 -743.968 ] >> cmd: pos/mom/mf (-2.27276,-26.6673,52.7976) (-5.91322,-68.1101,129.343) (-0.000245797,-0.00288406,3.80648) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:38:39 EST Run: 1 Event: 94 >> cmd: local error not pos-def >> cmd: [ -15055.7 -6315.33 454.387 -47137.8 3346.79 >> cmd: -6315.33 -2649.05 190.599 -19772.6 1403.85 >> cmd: 454.387 190.599 -13.7136 1422.64 -101.007 >> cmd: -47137.8 -19772.6 1422.64 -147583 10478.4 >> cmd: 3346.79 1403.85 -101.007 10478.4 -743.968 ] >> cmd: pos/mom/mf (-2.27276,-26.6674,52.7976) (-5.91277,-68.105,129.333) (-0.000245797,-0.00288406,3.80648) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:38:39 EST Run: 1 Event: 94 >> cmd: curv error not pos-def >> cmd: [ -15055.7 -1.49708 6322.86 47101.9 -2.88309 >> cmd: -1.49708-0.000148847 0.628718 4.68361-0.000286221 >> cmd: 6322.86 0.628718 -2655.37 -19781.1 1.21079 >> cmd: 47101.9 4.68361 -19781.1 -147358 9.01974 >> cmd: -2.88309-0.000286221 1.21079 9.01974-0.000535156 ] >> cmd: pos/mom/mf (-2.27276,-26.6674,52.7976) (-5.91277,-68.105,129.333) (-0.000245797,-0.00288406,3.80648) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:38:39 EST Run: 1 Event: 94 >> cmd: curv error not pos-def >> cmd: [ -15055.7 -1.52834 10985.4 157009 137.497 >> cmd: -1.52834-0.000155129 1.11515 15.9383 0.0139585 >> cmd: 10985.4 1.11515 -8015.52 -114562 -100.325 >> cmd: 157009 15.9383 -114562-1.63738e+06 -1433.89 >> cmd: 137.497 0.0139585 -100.325 -1433.89 -1.25564 ] >> cmd: pos/mom/mf (-3.3846,-39.3186,76.8249) (-6.05673,-68.0923,129.333) (-0.000526745,-0.00611915,3.80104) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:38:39 EST Run: 1 Event: 94 >> cmd: local error not pos-def >> cmd: [ -15055.7 -5793.13 -394.188 -156633 -10866.8 >> cmd: -5793.13 -2229.08 -151.675 -60269.1 -4181.32 >> cmd: -394.188 -151.675 -10.3206 -4100.95 -284.514 >> cmd: -156633 -60269.1 -4100.95-1.62954e+06 -113053 >> cmd: -10866.8 -4181.32 -284.514 -113053 -7843.36 ] >> cmd: pos/mom/mf (-3.3846,-39.3186,76.8249) (-6.05673,-68.0923,129.333) (-0.000526745,-0.00611915,3.80104) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:38:39 EST Run: 1 Event: 94 >> cmd: local error not pos-def >> cmd: [ -15055.7 -5793.13 -394.188 -156633 -10866.8 >> cmd: -5793.13 -2229.08 -151.675 -60269.1 -4181.32 >> cmd: -394.188 -151.675 -10.3206 -4100.95 -284.514 >> cmd: -156633 -60269.1 -4100.95-1.62954e+06 -113053 >> cmd: -10866.8 -4181.32 -284.514 -113053 -7843.36 ] >> cmd: pos/mom/mf (-3.3846,-39.3186,76.8249) (-6.05625,-68.087,129.323) (-0.000526745,-0.00611915,3.80104) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:38:39 EST Run: 1 Event: 94 >> cmd: curv error not pos-def >> cmd: [ -15055.7 -1.52839 10985.4 157009 137.495 >> cmd: -1.52839-0.000155139 1.11519 15.9389 0.0139588 >> cmd: 10985.4 1.11519 -8015.52 -114562 -100.324 >> cmd: 157009 15.9389 -114562-1.63738e+06 -1433.88 >> cmd: 137.495 0.0139588 -100.324 -1433.88 -1.25561 ] >> cmd: pos/mom/mf (-3.3846,-39.3186,76.8249) (-6.05625,-68.087,129.323) (-0.000526745,-0.00611915,3.80104) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:38:39 EST Run: 1 Event: 94 >> cmd: curv error not pos-def >> cmd: [ -15055.7 -1.57011 13490.5 240769 313.182 >> cmd: -1.57011-0.000163724 1.40688 25.1089 0.0326617 >> cmd: 13490.5 1.40688 -12088 -215739 -280.623 >> cmd: 240769 25.1089 -215739-3.85035e+06 -5008.37 >> cmd: 313.182 0.0326617 -280.623 -5008.37 -6.51458 ] >> cmd: pos/mom/mf (-3.99487,-46.1356,89.7737) (-6.13362,-68.0801,129.323) (-0.000722022,-0.00833843,3.79728) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:38:39 EST Run: 1 Event: 94 >> cmd: local error not pos-def >> cmd: [ -15055.7 -7114.7 -476.56 -240203 -16512.4 >> cmd: -7114.7 -3362.1 -225.202 -113510 -7803.05 >> cmd: -476.56 -225.202 -15.0846 -7603.15 -522.668 >> cmd: -240203 -113510 -7603.15-3.83225e+06 -263443 >> cmd: -16512.4 -7803.05 -522.668 -263443 -18110 ] >> cmd: pos/mom/mf (-3.99487,-46.1356,89.7737) (-6.13362,-68.0801,129.323) (-0.000722022,-0.00833843,3.79728) >> cmd: %MSG >> cmd: Begin processing the 19th record. Run 1, Event 95, LumiSection 18131 at 28-Nov-2019 12:38:40.345 EST >> cmd: Begin processing the 20th record. Run 1, Event 100, LumiSection 18131 at 28-Nov-2019 12:38:41.285 EST >> cmd: Begin processing the 21st record. Run 1, Event 101, LumiSection 18131 at 28-Nov-2019 12:38:43.695 EST >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:38:44 EST Run: 1 Event: 100 >> cmd: curv error not pos-def >> cmd: [ 7.23252e+06 -34.3503 -344212 -0.174646 0.864136 >> cmd: -34.3503 0.000736224 1.63481 1.89553e-06 0.0047697 >> cmd: -344212 1.63481 16381.8 0.00808726 -0.0411237 >> cmd: -0.174646 1.89553e-06 0.00808726 -0.00186889 8.29799e-06 >> cmd: 0.864136 0.0047697 -0.0411237 8.29799e-06 0.0397667 ] >> cmd: pos/mom/mf (3.04155,-10.6345,0.274951) (1.94471,-6.55755,-0.295923) (-1.03598e-05,3.62222e-05,3.81132) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:38:44 EST Run: 1 Event: 100 >> cmd: local error not pos-def >> cmd: [ 7.23252e+06 346194 -1087.21 0.175178 -0.865513 >> cmd: 346194 16571 -52.0407 0.00815838 -0.0414287 >> cmd: -1087.21 -52.0407 0.164011-2.46888e-05 0.00493109 >> cmd: 0.175178 0.00815838-2.46888e-05 -0.00187966 1.30555e-05 >> cmd: -0.865513 -0.0414287 0.00493109 1.30555e-05 0.0398411 ] >> cmd: pos/mom/mf (3.04155,-10.6345,0.274951) (1.94471,-6.55755,-0.295923) (-1.03598e-05,3.62222e-05,3.81132) >> cmd: %MSG >> cmd: Begin processing the 22nd record. Run 1, Event 98, LumiSection 18131 at 28-Nov-2019 12:38:44.987 EST >> cmd: Begin processing the 23rd record. Run 1, Event 96, LumiSection 18131 at 28-Nov-2019 12:38:45.373 EST >> cmd: Begin processing the 24th record. Run 1, Event 109, LumiSection 18131 at 28-Nov-2019 12:38:47.272 EST >> cmd: Begin processing the 25th record. Run 1, Event 107, LumiSection 18131 at 28-Nov-2019 12:38:48.361 EST >> cmd: Begin processing the 26th record. Run 1, Event 113, LumiSection 18131 at 28-Nov-2019 12:38:50.768 EST >> cmd: Begin processing the 27th record. Run 1, Event 123, LumiSection 18131 at 28-Nov-2019 12:38:52.178 EST >> cmd: Begin processing the 28th record. Run 1, Event 122, LumiSection 18131 at 28-Nov-2019 12:38:52.379 EST >> cmd: %MSG-w EnergyInDeadEB_FE: EcalRecHitProducer:hltEcalRecHit 28-Nov-2019 12:38:54 EST Run: 1 Event: 122 >> cmd: TP energy in the dead TT = 127.5 at (EcalTT subDet Barrel iz - ieta 2 iphi 43) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltFullIter6CtfWithMaterialTracks 28-Nov-2019 12:38:57 EST Run: 1 Event: 107 >> cmd: local error not pos-def >> cmd: [ -631.312 54.8575 12.7644 0.000205454 0.000180135 >> cmd: 54.8575 -4.76681 -1.10916-1.78701e-05-1.56527e-05 >> cmd: 12.7644 -1.10916 -0.258082-4.15405e-06-3.78634e-06 >> cmd: 0.000205454-1.78701e-05-4.15405e-06 4.55808e-07 1.0085e-11 >> cmd: 0.000180135-1.56527e-05-3.78634e-06 1.0085e-11 3.8057e-06 ] >> cmd: pos/mom/mf (1.09963,-15.1937,-29.9278) (876.282,-11879.4,-26984) (-7.55388e-05,0.00104373,3.80933) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltFullIter6CtfWithMaterialTracks 28-Nov-2019 12:38:57 EST Run: 1 Event: 107 >> cmd: curv error not pos-def >> cmd: [ -631.312 -0.00295886 111.033-0.000205374 0.000118953 >> cmd: -0.00295886-9.85528e-09 0.000520391-5.99883e-09 1.01074e-07 >> cmd: 111.033 0.000520391 -19.5279 3.6154e-05-2.09334e-05 >> cmd: -0.000205374-5.99883e-09 3.6154e-05 4.19594e-07-1.54964e-07 >> cmd: 0.000118953 1.01074e-07-2.09334e-05-1.54964e-07 3.09449e-06 ] >> cmd: pos/mom/mf (1.09963,-15.1937,-29.9278) (876.282,-11879.4,-26984) (-7.55388e-05,0.00104373,3.80933) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltFullIter6CtfWithMaterialTracks 28-Nov-2019 12:38:57 EST Run: 1 Event: 107 >> cmd: curv error not pos-def >> cmd: [ -631.312 -0.00301707 261.715 1574.02 -0.0573346 >> cmd: -0.00301707-1.04063e-08 0.00125075 0.00752232-8.95756e-08 >> cmd: 261.715 0.00125075 -108.496 -652.523 0.0237684 >> cmd: 1574.02 0.00752232 -652.523 -3924.45 0.142949 >> cmd: -0.0573346-8.95756e-08 0.0237684 0.142949 3.84658e-06 ] >> cmd: pos/mom/mf (1.72096,-23.6164,-49.0598) (876.378,-11879.4,-26984) (-0.000185602,0.00254699,3.80637) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltFullIter6CtfWithMaterialTracks 28-Nov-2019 12:38:57 EST Run: 1 Event: 107 >> cmd: local error not pos-def >> cmd: [ -631.312 263.329 -50.8931 -1579.6 305.256 >> cmd: 263.329 -109.838 21.2282 658.875 -127.327 >> cmd: -50.8931 21.2282 -4.10273 -127.339 24.6081 >> cmd: -1579.6 658.875 -127.339 -3952.32 763.781 >> cmd: 305.256 -127.327 24.6081 763.781 -147.599 ] >> cmd: pos/mom/mf (1.72096,-23.6164,-49.0598) (876.378,-11879.4,-26984) (-0.000185602,0.00254699,3.80637) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltFullIter6CtfWithMaterialTracks 28-Nov-2019 12:38:57 EST Run: 1 Event: 107 >> cmd: local error not pos-def >> cmd: [ -631.312 263.329 -50.8931 -1579.6 305.256 >> cmd: 263.329 -109.838 21.2282 658.875 -127.327 >> cmd: -50.8931 21.2282 -4.10273 -127.339 24.6081 >> cmd: -1579.6 658.875 -127.339 -3952.32 763.781 >> cmd: 305.256 -127.327 24.6081 763.781 -147.599 ] >> cmd: pos/mom/mf (1.72096,-23.6164,-49.0598) (876.378,-11879.4,-26984) (-0.000185602,0.00254699,3.80637) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltFullIter6CtfWithMaterialTracks 28-Nov-2019 12:38:57 EST Run: 1 Event: 107 >> cmd: curv error not pos-def >> cmd: [ -631.312 -0.00301786 261.715 1574.02 -0.0573463 >> cmd: -0.00301786-1.04138e-08 0.00125107 0.00752428-8.97036e-08 >> cmd: 261.715 0.00125107 -108.496 -652.523 0.0237733 >> cmd: 1574.02 0.00752428 -652.523 -3924.45 0.142979 >> cmd: -0.0573463-8.97036e-08 0.0237733 0.142979 3.84444e-06 ] >> cmd: pos/mom/mf (1.72096,-23.6164,-49.0598) (876.378,-11879.4,-26984) (-0.000185602,0.00254699,3.80637) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltFullIter6CtfWithMaterialTracks 28-Nov-2019 12:38:57 EST Run: 1 Event: 107 >> cmd: curv error not pos-def >> cmd: [ -631.312 -0.00317802 515.149 7100.81 -0.116358 >> cmd: -0.00317802-1.19857e-08 0.00259325 0.0357454-2.59944e-07 >> cmd: 515.149 0.00259325 -420.36 -5794.24 0.0949473 >> cmd: 7100.81 0.0357454 -5794.24 -79867.8 1.30875 >> cmd: -0.116358-2.59944e-07 0.0949473 1.30875 5.58451e-06 ] >> cmd: pos/mom/mf (2.76788,-37.8063,-81.292) (876.539,-11879.4,-26984) (-0.000474395,0.00647972,3.79831) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltFullIter6CtfWithMaterialTracks 28-Nov-2019 12:38:57 EST Run: 1 Event: 107 >> cmd: local error not pos-def >> cmd: [ -631.312 -226.787 -16.7576 7081.5 523.27 >> cmd: -226.787 -81.4688 -6.01984 2543.89 187.975 >> cmd: -16.7576 -6.01984 -0.444813 187.972 13.8897 >> cmd: 7081.5 2543.89 187.972 -79434 -5869.58 >> cmd: 523.27 187.975 13.8897 -5869.58 -433.718 ] >> cmd: pos/mom/mf (2.76788,-37.8063,-81.292) (876.539,-11879.4,-26984) (-0.000474395,0.00647972,3.79831) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltFullIter6CtfWithMaterialTracks 28-Nov-2019 12:38:57 EST Run: 1 Event: 107 >> cmd: local error not pos-def >> cmd: [ -631.312 -226.787 -16.7576 7081.5 523.27 >> cmd: -226.787 -81.4688 -6.01984 2543.89 187.975 >> cmd: -16.7576 -6.01984 -0.444813 187.972 13.8897 >> cmd: 7081.5 2543.89 187.972 -79434 -5869.58 >> cmd: 523.27 187.975 13.8897 -5869.58 -433.718 ] >> cmd: pos/mom/mf (2.76788,-37.8063,-81.292) (876.539,-11879.4,-26984) (-0.000474395,0.00647972,3.79831) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltFullIter6CtfWithMaterialTracks 28-Nov-2019 12:38:57 EST Run: 1 Event: 107 >> cmd: curv error not pos-def >> cmd: [ -631.312 -0.00317648 515.149 7100.81 -0.116305 >> cmd: -0.00317648-1.19701e-08 0.00259199 0.035728-2.59393e-07 >> cmd: 515.149 0.00259199 -420.36 -5794.24 0.0949043 >> cmd: 7100.81 0.035728 -5794.24 -79867.8 1.30816 >> cmd: -0.116305-2.59393e-07 0.0949043 1.30816 5.60396e-06 ] >> cmd: pos/mom/mf (2.76788,-37.8063,-81.292) (876.539,-11879.4,-26984) (-0.000474395,0.00647972,3.79831) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltFullIter6CtfWithMaterialTracks 28-Nov-2019 12:38:57 EST Run: 1 Event: 107 >> cmd: curv error not pos-def >> cmd: [ -631.312 -0.00324629 581.521 9153.24 -0.119683 >> cmd: -0.00324629-1.26803e-08 0.00299025 0.0470671-2.52433e-07 >> cmd: 581.521 0.00299025 -535.656 -8431.32 0.110243 >> cmd: 9153.24 0.0470671 -8431.32 -132710 1.73524 >> cmd: -0.119683-2.52433e-07 0.110243 1.73524 1.07254e-05 ] >> cmd: pos/mom/mf (3.04332,-41.5391,-89.7712) (876.581,-11879.4,-26984) (-0.000571617,0.00780216,3.79556) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltFullIter6CtfWithMaterialTracks 28-Nov-2019 12:38:57 EST Run: 1 Event: 107 >> cmd: local error not pos-def >> cmd: [ -631.312 256.116 21.3298 9121.66 759.677 >> cmd: 256.116 -103.903 -8.65325 -3700.55 -308.192 >> cmd: 21.3298 -8.65325 -0.72066 -308.189 -25.6668 >> cmd: 9121.66 -3700.55 -308.189 -131796 -10976.4 >> cmd: 759.677 -308.192 -25.6668 -10976.4 -914.143 ] >> cmd: pos/mom/mf (3.04332,-41.5391,-89.7712) (876.581,-11879.4,-26984) (-0.000571617,0.00780216,3.79556) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltFullIter6CtfWithMaterialTracks 28-Nov-2019 12:38:57 EST Run: 1 Event: 107 >> cmd: local error not pos-def >> cmd: [ -631.312 256.116 21.3298 9121.66 759.677 >> cmd: 256.116 -103.903 -8.65325 -3700.55 -308.192 >> cmd: 21.3298 -8.65325 -0.72066 -308.189 -25.6668 >> cmd: 9121.66 -3700.55 -308.189 -131796 -10976.4 >> cmd: 759.677 -308.192 -25.6668 -10976.4 -914.143 ] >> cmd: pos/mom/mf (3.04332,-41.5391,-89.7712) (876.581,-11879.4,-26984) (-0.000571617,0.00780216,3.79556) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltFullIter6CtfWithMaterialTracks 28-Nov-2019 12:38:57 EST Run: 1 Event: 107 >> cmd: curv error not pos-def >> cmd: [ -631.312 -0.00324222 581.521 9153.23 -0.119524 >> cmd: -0.00324222-1.26385e-08 0.0029865 0.047008-2.50847e-07 >> cmd: 581.521 0.0029865 -535.656 -8431.32 0.110097 >> cmd: 9153.23 0.047008 -8431.32 -132710 1.73294 >> cmd: -0.119524-2.50847e-07 0.110097 1.73294 1.07855e-05 ] >> cmd: pos/mom/mf (3.04332,-41.5391,-89.7712) (876.581,-11879.4,-26984) (-0.000571617,0.00780216,3.79556) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltFullIter6CtfWithMaterialTracks 28-Nov-2019 12:38:57 EST Run: 1 Event: 107 >> cmd: curv error not pos-def >> cmd: [ -631.312 -0.00336029 682.749 12767.4 -0.112026 >> cmd: -0.00336029-1.38733e-08 0.00363407 0.0679572-1.76484e-07 >> cmd: 682.749 0.00363407 -738.376 -13807.7 0.121153 >> cmd: 12767.4 0.0679572 -13807.7 -258203 2.26557 >> cmd: -0.112026-1.76484e-07 0.121153 2.26557 2.4618e-05 ] >> cmd: pos/mom/mf (3.46408,-47.2411,-102.723) (876.646,-11879.4,-26984) (-0.000737376,0.0100559,3.79087) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltFullIter6CtfWithMaterialTracks 28-Nov-2019 12:38:57 EST Run: 1 Event: 107 >> cmd: local error not pos-def >> cmd: [ -631.312 300.345 25.0711 12723.2 1062.11 >> cmd: 300.345 -142.888 -11.9275 -6053 -505.294 >> cmd: 25.0711 -11.9275 -0.99564 -505.271 -42.1791 >> cmd: 12723.2 -6053 -505.271 -256417 -21405.2 >> cmd: 1062.11 -505.294 -42.1791 -21405.2 -1786.87 ] >> cmd: pos/mom/mf (3.46408,-47.2411,-102.723) (876.646,-11879.4,-26984) (-0.000737376,0.0100559,3.79087) >> cmd: %MSG >> cmd: Begin processing the 29th record. Run 1, Event 127, LumiSection 18131 at 28-Nov-2019 12:38:57.729 EST >> cmd: %MSG-w InvalidHelix: SeedCreatorFromRegionConsecutiveHitsEDProducer:hltFullIter9TobTecSeedsPair 28-Nov-2019 12:38:58 EST Run: 1 Event: 107 >> cmd: PixelClusterShapeSeedComparitor helix is not valid, result is bad >> cmd: %MSG >> cmd: Begin processing the 30th record. Run 1, Event 132, LumiSection 18131 at 28-Nov-2019 12:38:59.796 EST >> cmd: Begin processing the 31st record. Run 1, Event 134, LumiSection 18131 at 28-Nov-2019 12:38:59.833 EST >> cmd: Begin processing the 32nd record. Run 1, Event 136, LumiSection 18131 at 28-Nov-2019 12:39:01.118 EST >> cmd: Begin processing the 33rd record. Run 1, Event 135, LumiSection 18131 at 28-Nov-2019 12:39:02.433 EST >> cmd: Begin processing the 34th record. Run 1, Event 139, LumiSection 18131 at 28-Nov-2019 12:39:02.776 EST >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:39:03 EST Run: 1 Event: 132 >> cmd: local error not pos-def >> cmd: [ -874923 -93612.6 453.877 0.00229399 0.00886536 >> cmd: -93612.6 -10016.1 48.5627 0.000245499 0.000948549 >> cmd: 453.877 48.5627 -0.235454-1.19026e-06-2.32491e-06 >> cmd: 0.00229399 0.000245499-1.19026e-06 4.43876e-07-1.11329e-11 >> cmd: 0.00886536 0.000948549-2.32491e-06-1.11329e-11 1.88373e-05 ] >> cmd: pos/mom/mf (-6.68439,-8.78255,19.5769) (-11.9885,-15.8322,40.2657) (-0.000262027,-0.000344275,3.81066) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:39:03 EST Run: 1 Event: 132 >> cmd: curv error not pos-def >> cmd: [ -874923 37.5347 93609.7 -0.00229428 -0.00392833 >> cmd: 37.5347 -0.00161023 -4.01591 9.84707e-08 3.65324e-07 >> cmd: 93609.7 -4.01591 -10015.5 0.000245524 0.000420301 >> cmd: -0.00229428 9.84707e-08 0.000245524 4.43871e-07 1.64333e-09 >> cmd: -0.00392833 3.65324e-07 0.000420301 1.64333e-09 3.68548e-06 ] >> cmd: pos/mom/mf (-6.68439,-8.78255,19.5769) (-11.9885,-15.8322,40.2657) (-0.000262027,-0.000344275,3.81066) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:39:03 EST Run: 1 Event: 132 >> cmd: curv error not pos-def >> cmd: [ -874923 36.8026 458957 4.468e+06 15857.7 >> cmd: 36.8026 -0.00154803 -19.3055 -187.941 -0.667036 >> cmd: 458957 -19.3055 -240754-2.34377e+06 -8318.47 >> cmd: 4.468e+06 -187.941-2.34377e+06-2.28169e+07 -80981.3 >> cmd: 15857.7 -0.667036 -8318.47 -80981.3 -287.417 ] >> cmd: pos/mom/mf (-16.5068,-21.6297,52.3666) (-12.1351,-15.7201,40.2657) (-0.00177079,-0.00232035,3.80659) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:39:03 EST Run: 1 Event: 132 >> cmd: local error not pos-def >> cmd: [ -874923 -475706 178324-4.54653e+06 1.67031e+06 >> cmd: -475706 -258647 96957.1 -2.472e+06 908165 >> cmd: 178324 96957.1 -36345.6 926662 -340437 >> cmd: -4.54653e+06 -2.472e+06 926662 -2.3626e+07 8.67973e+06 >> cmd: 1.67031e+06 908165 -340437 8.67973e+06-3.18876e+06 ] >> cmd: pos/mom/mf (-16.5068,-21.6297,52.3666) (-12.1351,-15.7201,40.2657) (-0.00177079,-0.00232035,3.80659) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:39:03 EST Run: 1 Event: 132 >> cmd: local error not pos-def >> cmd: [ -874923 -475706 178324-4.54653e+06 1.67031e+06 >> cmd: -475706 -258647 96957.1 -2.472e+06 908165 >> cmd: 178324 96957.1 -36345.6 926662 -340437 >> cmd: -4.54653e+06 -2.472e+06 926662 -2.3626e+07 8.67973e+06 >> cmd: 1.67031e+06 908165 -340437 8.67973e+06-3.18876e+06 ] >> cmd: pos/mom/mf (-16.5068,-21.6297,52.3666) (-12.132,-15.7162,40.2555) (-0.00177079,-0.00232035,3.80659) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:39:03 EST Run: 1 Event: 132 >> cmd: curv error not pos-def >> cmd: [ -874923 36.8064 458957 4.468e+06 15857.8 >> cmd: 36.8064 -0.00154834 -19.3075 -187.961 -0.667109 >> cmd: 458957 -19.3075 -240754-2.34377e+06 -8318.51 >> cmd: 4.468e+06 -187.961-2.34377e+06-2.28169e+07 -80981.7 >> cmd: 15857.8 -0.667109 -8318.51 -80981.7 -287.42 ] >> cmd: pos/mom/mf (-16.5068,-21.6297,52.3666) (-12.132,-15.7162,40.2555) (-0.00177079,-0.00232035,3.80659) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:39:03 EST Run: 1 Event: 132 >> cmd: curv error not pos-def >> cmd: [ -874923 24.6761 847467 1.57282e+07 101487 >> cmd: 24.6761-0.000695914 -23.9017 -443.594 -2.86231 >> cmd: 847467 -23.9017 -820872-1.52346e+07 -98302.2 >> cmd: 1.57282e+07 -443.594-1.52346e+07 -2.8274e+08 -1.8244e+06 >> cmd: 101487 -2.86231 -98302.2 -1.8244e+06 -11772 ] >> cmd: pos/mom/mf (-27.108,-35.2234,87.3195) (-12.2866,-15.5956,40.2555) (-0.00477132,-0.00619972,3.79799) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:39:03 EST Run: 1 Event: 132 >> cmd: local error not pos-def >> cmd: [ -874923 -417659 -16284.5 1.57206e+07 500857 >> cmd: -417659 -199376 -7773.68 7.5045e+06 239092 >> cmd: -16284.5 -7773.68 -303.096 292600 9322.21 >> cmd: 1.57206e+07 7.5045e+06 292600-2.82468e+08 -8.9994e+06 >> cmd: 500857 239092 9322.21 -8.9994e+06 -286720 ] >> cmd: pos/mom/mf (-27.108,-35.2234,87.3195) (-12.2866,-15.5956,40.2555) (-0.00477132,-0.00619972,3.79799) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:39:03 EST Run: 1 Event: 132 >> cmd: local error not pos-def >> cmd: [ 0.0313105 0.00651315-0.000488821-0.000224339 0.0490703 >> cmd: 0.00651315 0.00155461-0.000116079-0.000113517 0.0110347 >> cmd: -0.000488821-0.000116079 0.000735677 0.000242005 -0.0323967 >> cmd: -0.000224339-0.000113517 0.000242005 -0.0017503 -0.0162989 >> cmd: 0.0490703 0.0110347 -0.0323967 -0.0162989 2.20571 ] >> cmd: pos/mom/mf (-26.4334,-35.825,87.3195) (-9.74223,-13.6624,33.9212) (-0.00465253,-0.00630552,3.798) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:39:03 EST Run: 1 Event: 132 >> cmd: curv error not pos-def >> cmd: [ 0.0313105-0.000346739 -0.0131811-0.000655766 -0.0439796 >> cmd: -0.000346739 0.000473576 0.000180267 0.00042176 0.0232563 >> cmd: -0.0131811 0.000180267 0.00636717 0.000439684 0.0207696 >> cmd: -0.000655766 0.00042176 0.000439684 -0.00129306 0.0320026 >> cmd: -0.0439796 0.0232563 0.0207696 0.0320026 1.77171 ] >> cmd: pos/mom/mf (-26.4334,-35.825,87.3195) (-9.74223,-13.6624,33.9212) (-0.00465253,-0.00630552,3.798) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:39:03 EST Run: 1 Event: 132 >> cmd: local error not pos-def >> cmd: [ -2.48442e-06-3.16151e-06 1.62166e-06-4.06184e-05 2.18282e-05 >> cmd: -3.16151e-06-1.65919e-06 6.22269e-07-1.61031e-05 5.92173e-06 >> cmd: 1.62166e-06 6.22269e-07 9.62077e-07 4.56881e-06 1.35774e-05 >> cmd: -4.06184e-05-1.61031e-05 4.56881e-06-0.000109632 1.71489e-05 >> cmd: 2.18282e-05 5.92173e-06 1.35774e-05 1.71489e-05 0.0003002 ] >> cmd: pos/mom/mf (-16.2761,-21.7473,52.2714) (-9.47533,-12.9654,32.5492) (-0.00174292,-0.0023288,3.80661) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:39:03 EST Run: 1 Event: 132 >> cmd: curv error not pos-def >> cmd: [ -2.48442e-06-1.16279e-07 3.08858e-06 4.01006e-05-3.85951e-06 >> cmd: -1.16279e-07 4.44893e-08 1.55294e-08-1.19646e-07 1.30725e-06 >> cmd: 3.08858e-06 1.55294e-08-1.58024e-06-1.55029e-05 2.748e-07 >> cmd: 4.01006e-05-1.19646e-07-1.55029e-05-0.000106854-7.96197e-06 >> cmd: -3.85951e-06 1.30725e-06 2.748e-07-7.96197e-06 5.87045e-05 ] >> cmd: pos/mom/mf (-16.2761,-21.7473,52.2714) (-9.47533,-12.9654,32.5492) (-0.00174292,-0.0023288,3.80661) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:39:03 EST Run: 1 Event: 132 >> cmd: local error not pos-def >> cmd: [ -2.62087e-06-1.95599e-06 4.31327e-07-1.22091e-07 2.59121e-08 >> cmd: -1.95599e-06 5.08325e-07 -1.8053e-07 3.9394e-08 9.38687e-10 >> cmd: 4.31327e-07 -1.8053e-07 7.89657e-07-1.53959e-10 2.27378e-06 >> cmd: -1.22091e-07 3.9394e-08-1.53959e-10 4.3458e-07 6.83337e-12 >> cmd: 2.59121e-08 9.38687e-10 2.27378e-06 6.83337e-12 1.88363e-05 ] >> cmd: pos/mom/mf (-6.68439,-8.78255,19.5769) (-9.52646,-12.7219,32.2247) (-0.000262027,-0.000344275,3.81066) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:39:03 EST Run: 1 Event: 132 >> cmd: curv error not pos-def >> cmd: [ -2.62087e-06-8.59091e-08 1.95593e-06 1.22089e-07 -1.1676e-08 >> cmd: -8.59091e-08 3.02824e-08-3.58363e-08-4.50602e-11 1.96774e-07 >> cmd: 1.95593e-06-3.58363e-08 5.08291e-07 3.93928e-08-1.99384e-09 >> cmd: 1.22089e-07-4.50602e-11 3.93928e-08 4.34579e-07-4.66891e-10 >> cmd: -1.1676e-08 1.96774e-07-1.99384e-09-4.66891e-10 3.68533e-06 ] >> cmd: pos/mom/mf (-6.68439,-8.78255,19.5769) (-9.52646,-12.7219,32.2247) (-0.000262027,-0.000344275,3.81066) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:39:03 EST Run: 1 Event: 132 >> cmd: local error not pos-def >> cmd: [ -2.70387e-06-1.36382e-06 -8.2056e-08-1.35073e-05-1.42323e-08 >> cmd: -1.36382e-06 1.24827e-06-3.65414e-08 8.81067e-06 5.241e-09 >> cmd: -8.2056e-08-3.65414e-08 7.91822e-07-3.20359e-07 3.34811e-06 >> cmd: -1.35073e-05 8.81067e-06-3.20359e-07 6.04402e-05-2.52307e-10 >> cmd: -1.42323e-08 5.241e-09 3.34811e-06-2.52307e-10 2.7544e-05 ] >> cmd: pos/mom/mf (-1.69944,-2.16668,2.78113) (-9.60127,-12.6639,32.2224) (-3.80853e-06,-4.85563e-06,3.81121) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:39:03 EST Run: 1 Event: 132 >> cmd: curv error not pos-def >> cmd: [ -2.70387e-06-8.05095e-08 1.34429e-06-1.34093e-05 1.46272e-06 >> cmd: -8.05095e-08 3.19961e-08-5.10726e-08 3.52364e-07-3.26011e-07 >> cmd: 1.34429e-06-5.10726e-08 1.21267e-06-8.62108e-06 9.35179e-07 >> cmd: -1.34093e-05 3.52364e-07-8.62108e-06 5.95665e-05-6.46966e-06 >> cmd: 1.46272e-06-3.26011e-07 9.35179e-07-6.46966e-06 6.09147e-06 ] >> cmd: pos/mom/mf (-1.69944,-2.16668,2.78113) (-9.60127,-12.6639,32.2224) (-3.80853e-06,-4.85563e-06,3.81121) >> cmd: %MSG >> cmd: %MSG-w InvalidHelix: SeedCreatorFromRegionConsecutiveHitsEDProducer:hltFullIter9TobTecSeedsTripl 28-Nov-2019 12:39:03 EST Run: 1 Event: 96 >> cmd: PixelClusterShapeSeedComparitor helix is not valid, result is bad >> cmd: %MSG >> cmd: Begin processing the 35th record. Run 1, Event 153, LumiSection 18131 at 28-Nov-2019 12:39:06.828 EST >> cmd: Begin processing the 36th record. Run 1, Event 143, LumiSection 18131 at 28-Nov-2019 12:39:07.085 EST >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:39:07 EST Run: 1 Event: 135 >> cmd: local error not pos-def >> cmd: [ -15741.5 962.182 189.789 0.000409118-0.000240584 >> cmd: 962.182 -58.8124 -11.6007-2.50269e-05 1.47052e-05 >> cmd: 189.789 -11.6007 -2.28822 -4.9325e-06 2.85571e-06 >> cmd: 0.000409118-2.50269e-05 -4.9325e-06 4.9952e-07-6.58314e-13 >> cmd: -0.000240584 1.47052e-05 2.85571e-06-6.58314e-13 1.12217e-06 ] >> cmd: pos/mom/mf (-11.8344,0.228451,-29.8999) (-47.407,0.762825,-139.915) (0.000812395,-1.56825e-05,3.80925) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:39:07 EST Run: 1 Event: 135 >> cmd: curv error not pos-def >> cmd: [ -15741.5 1.36235 2533.73-0.000365436-0.000300584 >> cmd: 1.36235-0.000117893 -0.219282 3.20216e-08 6.13813e-08 >> cmd: 2533.73 -0.219282 -407.825 5.88694e-05 4.83822e-05 >> cmd: -0.000365436 3.20216e-08 5.88694e-05 4.44535e-07 9.29836e-09 >> cmd: -0.000300584 6.13813e-08 4.83822e-05 9.29836e-09 9.95213e-07 ] >> cmd: pos/mom/mf (-11.8344,0.228451,-29.8999) (-47.407,0.762825,-139.915) (0.000812395,-1.56825e-05,3.80925) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:39:07 EST Run: 1 Event: 135 >> cmd: curv error not pos-def >> cmd: [ -15741.5 1.37318 11619.1 114855 -97.059 >> cmd: 1.37318-0.000119775 -1.01357 -10.0192 0.00846744 >> cmd: 11619.1 -1.01357 -8576.25 -84777 71.641 >> cmd: 114855 -10.0192 -84777 -838027 708.178 >> cmd: -97.059 0.00846744 71.641 708.178 -0.598412 ] >> cmd: pos/mom/mf (-28.0625,0.521239,-77.7964) (-47.4037,0.947576,-139.915) (0.00462336,-8.58753e-05,3.79884) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:39:07 EST Run: 1 Event: 135 >> cmd: local error not pos-def >> cmd: [ -15741.5 -3937.88 71.921 114839 -1950.2 >> cmd: -3937.88 -985.096 17.9917 28728.1 -487.862 >> cmd: 71.921 17.9917 -0.328599 -524.686 8.91026 >> cmd: 114839 28728.1 -524.686 -837787 14227.4 >> cmd: -1950.2 -487.862 8.91026 14227.4 -241.61 ] >> cmd: pos/mom/mf (-28.0625,0.521239,-77.7964) (-47.4037,0.947576,-139.915) (0.00462336,-8.58753e-05,3.79884) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:39:07 EST Run: 1 Event: 135 >> cmd: local error not pos-def >> cmd: [ -15741.5 -3937.88 71.921 114839 -1950.2 >> cmd: -3937.88 -985.096 17.9917 28728.1 -487.862 >> cmd: 71.921 17.9917 -0.328599 -524.686 8.91026 >> cmd: 114839 28728.1 -524.686 -837787 14227.4 >> cmd: -1950.2 -487.862 8.91026 14227.4 -241.61 ] >> cmd: pos/mom/mf (-28.0625,0.521239,-77.7964) (-47.4,0.947502,-139.904) (0.00462336,-8.58753e-05,3.79884) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:39:07 EST Run: 1 Event: 135 >> cmd: curv error not pos-def >> cmd: [ -15741.5 1.37319 11619.1 114855 -97.0588 >> cmd: 1.37319-0.000119775 -1.01358 -10.0193 0.00846747 >> cmd: 11619.1 -1.01358 -8576.25 -84777 71.6409 >> cmd: 114855 -10.0193 -84777 -838027 708.176 >> cmd: -97.0588 0.00846747 71.6409 708.176 -0.598409 ] >> cmd: pos/mom/mf (-28.0625,0.521239,-77.7964) (-47.4,0.947502,-139.904) (0.00462336,-8.58753e-05,3.79884) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:39:07 EST Run: 1 Event: 135 >> cmd: curv error not pos-def >> cmd: [ -15741.5 1.39968 14060.3 171173 -219.269 >> cmd: 1.39968-0.000124441 -1.2502 -15.2202 0.0194975 >> cmd: 14060.3 -1.2502 -12558.8 -152893 195.852 >> cmd: 171173 -15.2202 -152893-1.86135e+06 2384.34 >> cmd: -219.269 0.0194975 195.852 2384.34 -3.05422 ] >> cmd: pos/mom/mf (-32.4478,0.611201,-90.7401) (-47.399,0.997208,-139.904) (0.00616332,-0.000116095,3.79452) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:39:07 EST Run: 1 Event: 135 >> cmd: local error not pos-def >> cmd: [ -15741.5 -4760.23 100.013 171142 -3308.27 >> cmd: -4760.23 -1439.5 30.244 51753.3 -1000.42 >> cmd: 100.013 30.244 -0.635431 -1087.34 21.019 >> cmd: 171142 51753.3 -1087.34-1.86066e+06 35967.6 >> cmd: -3308.27 -1000.42 21.019 35967.6 -695.276 ] >> cmd: pos/mom/mf (-32.4478,0.611201,-90.7401) (-47.399,0.997208,-139.904) (0.00616332,-0.000116095,3.79452) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:39:07 EST Run: 1 Event: 135 >> cmd: local error not pos-def >> cmd: [ -15741.5 -4760.23 100.013 171142 -3308.27 >> cmd: -4760.23 -1439.5 30.244 51753.3 -1000.42 >> cmd: 100.013 30.244 -0.635431 -1087.34 21.019 >> cmd: 171142 51753.3 -1087.34-1.86066e+06 35967.6 >> cmd: -3308.27 -1000.42 21.019 35967.6 -695.276 ] >> cmd: pos/mom/mf (-32.4478,0.611201,-90.7401) (-47.3972,0.99717,-139.898) (0.00616332,-0.000116095,3.79452) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:39:07 EST Run: 1 Event: 135 >> cmd: curv error not pos-def >> cmd: [ -15741.5 1.39969 14060.3 171173 -219.269 >> cmd: 1.39969-0.000124442 -1.25021 -15.2203 0.0194976 >> cmd: 14060.3 -1.25021 -12558.7 -152893 195.852 >> cmd: 171173 -15.2203 -152893-1.86135e+06 2384.33 >> cmd: -219.269 0.0194976 195.852 2384.33 -3.05421 ] >> cmd: pos/mom/mf (-32.4478,0.611201,-90.7401) (-47.3972,0.99717,-139.898) (0.00616332,-0.000116095,3.79452) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:39:07 EST Run: 1 Event: 135 >> cmd: curv error not pos-def >> cmd: [ -15741.5 1.45769 17155.2 258164 -462.806 >> cmd: 1.45769-0.000134971 -1.5886 -23.9065 0.0428578 >> cmd: 17155.2 -1.5886 -18695.9 -281350 504.37 >> cmd: 258164 -23.9065 -281350-4.23396e+06 7590.14 >> cmd: -462.806 0.0428578 504.37 7590.14 -13.6066 ] >> cmd: pos/mom/mf (-38.0201,0.73214,-107.188) (-47.3958,1.06015,-139.898) (0.0084365,-0.000162459,3.78812) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 28-Nov-2019 12:39:07 EST Run: 1 Event: 135 >> cmd: local error not pos-def >> cmd: [ -15741.5 -5811.95 130.647 258111 -5241.11 >> cmd: -5811.95 -2145.84 48.2363 95298 -1935.08 >> cmd: 130.647 48.2363 -1.0843 -2142.2 43.4986 >> cmd: 258111 95298 -2142.2-4.23223e+06 85938 >> cmd: -5241.11 -1935.08 43.4986 85938 -1745.02 ] >> cmd: pos/mom/mf (-38.0201,0.73214,-107.188) (-47.3958,1.06015,-139.898) (0.0084365,-0.000162459,3.78812) >> cmd: %MSG >> cmd: Begin processing the 37th record. Run 1, Event 157, LumiSection 18131 at 28-Nov-2019 12:39:09.194 EST >> cmd: Begin processing the 38th record. Run 1, Event 161, LumiSection 18131 at 28-Nov-2019 12:39:09.696 EST >> cmd: Begin processing the 39th record. Run 1, Event 159, LumiSection 18131 at 28-Nov-2019 12:39:11.402 EST >> cmd: Begin processing the 40th record. Run 1, Event 160, LumiSection 18131 at 28-Nov-2019 12:39:14.638 EST >> cmd: Begin processing the 41st record. Run 1, Event 169, LumiSection 18131 at 28-Nov-2019 12:39:17.114 EST >> cmd: Begin processing the 42nd record. Run 1, Event 165, LumiSection 18131 at 28-Nov-2019 12:39:18.408 EST >> cmd: Begin processing the 43rd record. Run 1, Event 170, LumiSection 18131 at 28-Nov-2019 12:39:18.901 EST >> cmd: Begin processing the 44th record. Run 1, Event 191, LumiSection 18131 at 28-Nov-2019 12:39:20.427 EST >> cmd: Begin processing the 45th record. Run 1, Event 183, LumiSection 18131 at 28-Nov-2019 12:39:20.455 EST >> cmd: Begin processing the 46th record. Run 1, Event 194, LumiSection 18131 at 28-Nov-2019 12:39:23.150 EST >> cmd: Begin processing the 47th record. Run 1, Event 189, LumiSection 18131 at 28-Nov-2019 12:39:25.086 EST >> cmd: Begin processing the 48th record. Run 1, Event 171, LumiSection 18131 at 28-Nov-2019 12:39:26.772 EST >> cmd: %MSG-w InvalidHelix: SeedCreatorFromRegionConsecutiveHitsEDProducer:hltFullIter9TobTecSeedsTripl 28-Nov-2019 12:39:28 EST Run: 1 Event: 194 >> cmd: PixelClusterShapeSeedComparitor helix is not valid, result is bad >> cmd: %MSG >> cmd: Begin processing the 49th record. Run 1, Event 176, LumiSection 18131 at 28-Nov-2019 12:39:30.828 EST >> cmd: Begin processing the 50th record. Run 1, Event 211, LumiSection 18131 at 28-Nov-2019 12:39:31.590 EST >> cmd: %MSG-w InvalidHelix: SeedCreatorFromRegionConsecutiveHitsEDProducer:hltFullIter9TobTecSeedsTripl 28-Nov-2019 12:39:31 EST Run: 1 Event: 171 >> cmd: PixelClusterShapeSeedComparitor helix is not valid, result is bad >> cmd: %MSG >> cmd: Begin processing the 51st record. Run 1, Event 204, LumiSection 18131 at 28-Nov-2019 12:39:34.013 EST >> cmd: Begin processing the 52nd record. Run 1, Event 215, LumiSection 18131 at 28-Nov-2019 12:39:34.140 EST >> cmd: Begin processing the 53rd record. Run 1, Event 209, LumiSection 18131 at 28-Nov-2019 12:39:34.593 EST >> cmd: Begin processing the 54th record. Run 1, Event 218, LumiSection 18131 at 28-Nov-2019 12:39:37.782 EST >> cmd: Begin processing the 55th record. Run 1, Event 216, LumiSection 18131 at 28-Nov-2019 12:39:37.871 EST >> cmd: Begin processing the 56th record. Run 1, Event 222, LumiSection 18131 at 28-Nov-2019 12:39:40.428 EST >> cmd: Begin processing the 57th record. Run 1, Event 230, LumiSection 18131 at 28-Nov-2019 12:39:41.760 EST >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: Begin processing the 58th record. Run 1, Event 219, LumiSection 18131 at 28-Nov-2019 12:39:43.133 EST >> cmd: Begin processing the 59th record. Run 1, Event 229, LumiSection 18131 at 28-Nov-2019 12:39:47.151 EST >> cmd: Begin processing the 60th record. Run 1, Event 206, LumiSection 18131 at 28-Nov-2019 12:39:48.731 EST >> cmd: Begin processing the 61st record. Run 1, Event 235, LumiSection 18131 at 28-Nov-2019 12:39:49.264 EST >> cmd: Begin processing the 62nd record. Run 1, Event 234, LumiSection 18131 at 28-Nov-2019 12:39:49.891 EST >> cmd: Begin processing the 63rd record. Run 1, Event 249, LumiSection 18131 at 28-Nov-2019 12:39:50.198 EST >> cmd: Begin processing the 64th record. Run 1, Event 250, LumiSection 18131 at 28-Nov-2019 12:39:51.593 EST >> cmd: Begin processing the 65th record. Run 1, Event 241, LumiSection 18131 at 28-Nov-2019 12:39:55.990 EST >> cmd: Begin processing the 66th record. Run 1, Event 253, LumiSection 18131 at 28-Nov-2019 12:39:56.546 EST >> cmd: Begin processing the 67th record. Run 1, Event 265, LumiSection 18131 at 28-Nov-2019 12:39:57.071 EST >> cmd: Begin processing the 68th record. Run 1, Event 258, LumiSection 18131 at 28-Nov-2019 12:39:57.654 EST >> cmd: Begin processing the 69th record. Run 1, Event 268, LumiSection 18131 at 28-Nov-2019 12:40:01.686 EST >> cmd: Begin processing the 70th record. Run 1, Event 252, LumiSection 18131 at 28-Nov-2019 12:40:01.961 EST >> cmd: [2019-11-28 12:40:03.946699 -0500][Error ][File ] [0x72c28a80@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/gs_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17wmLHEGS-00040ND_180160.root] Fatal file state error. Message kXR_readv (handle: 0x00000000, chunks: 59, total size: 20782617) returned with [ERROR] Server responded with an error: [3010] Unable to readv /store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/gs_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17wmLHEGS-00040ND_180160.root; operation not permitted >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 28-Nov-2019 12:40:03 EST pre-events >> cmd: XrdRequestManager::handle(name='root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/gs_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17wmLHEGS-00040ND_180160.root) failure when reading from primeradiant03.crc.nd.edu:1096 (site T3_US_NotreDame); failed with error '[ERROR] Server responded with an error: [3010] Unable to readv /store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/gs_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17wmLHEGS-00040ND_180160.root; operation not permitted >> cmd: ' (errno=3010, code=400). >> cmd: %MSG >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 28-Nov-2019 12:40:03 EST pre-events >> cmd: Request failure when reading from primeradiant03.crc.nd.edu:1096 (site T3_US_NotreDame) >> cmd: %MSG >> cmd: %MSG-w XrdAdaptor: (NoModuleName) 28-Nov-2019 12:40:03 EST pre-events >> cmd: Data is now served from instead of previous T3_US_NotreDame >> cmd: %MSG >> cmd: ExtLut::getLow : can not find address -525 >> cmd: ExtLut::getHigh : can not find address -525 >> cmd: [2019-11-28 12:40:04.172551 -0500][Error ][AsyncSock ] [primeradiant03.crc.nd.edu:1096 #0.0] Socket error encountered: [ERROR] Socket error: Resource temporarily unavailable >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 28-Nov-2019 12:43:13 EST pre-events >> cmd: Caught a CMSSW exception when running connection recovery. >> cmd: %MSG >> cmd: ----- Begin Fatal Exception 28-Nov-2019 12:43:13 EST----------------------- >> cmd: An exception of category 'FileReadError' occurred while >> cmd: [0] Rethrowing an exception that happened on a different thread. >> cmd: [1] Reading branch recoGenParticles_genParticles__SIM. >> cmd: [2] Calling XrdFile::readv() >> cmd: [3] XrdAdaptor::ClientRequest::HandleResponse() failure while running connection recovery >> cmd: [4] In XrdAdaptor::RequestManager::requestFailure() >> cmd: Exception Message: >> cmd: XrdAdaptor::RequestManager::requestFailure Open(name='root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/gs_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17wmLHEGS-00040ND_180160.root', flags=0x10, permissions=0660, old source=primeradiant03.crc.nd.edu:1096 (site T3_US_NotreDame)) => timeout when waiting for file open >> cmd: Additional Info: >> cmd: [a] Original error: '[ERROR] Server responded with an error: [3010] Unable to readv /store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/gs_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17wmLHEGS-00040ND_180160.root; operation not permitted >> cmd: ' (errno=3010, code=400, source=primeradiant03.crc.nd.edu:1096 (site T3_US_NotreDame)). >> cmd: [b] Disabled source: primeradiant03.crc.nd.edu:1096 >> cmd: ----- End Fatal Exception ------------------------------------------------- >> cmd: ----- Begin Fatal Exception 28-Nov-2019 12:43:13 EST----------------------- >> cmd: An exception of category 'FileReadError' occurred while >> cmd: [0] Rethrowing an exception that happened on a different thread. >> cmd: [1] Reading branch recoGenParticles_genParticles__SIM. >> cmd: [2] Calling XrdFile::readv() >> cmd: [3] XrdAdaptor::ClientRequest::HandleResponse() failure while running connection recovery >> cmd: [4] In XrdAdaptor::RequestManager::requestFailure() >> cmd: Exception Message: >> cmd: XrdAdaptor::RequestManager::requestFailure Open(name='root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/gs_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17wmLHEGS-00040ND_180160.root', flags=0x10, permissions=0660, old source=primeradiant03.crc.nd.edu:1096 (site T3_US_NotreDame)) => timeout when waiting for file open >> cmd: Additional Info: >> cmd: [a] Original error: '[ERROR] Server responded with an error: [3010] Unable to readv /store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/gs_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17wmLHEGS-00040ND_180160.root; operation not permitted >> cmd: ' (errno=3010, code=400, source=primeradiant03.crc.nd.edu:1096 (site T3_US_NotreDame)). >> cmd: [b] Disabled source: primeradiant03.crc.nd.edu:1096 >> cmd: ----- End Fatal Exception ------------------------------------------------- >> cmd: ----- Begin Fatal Exception 28-Nov-2019 12:43:14 EST----------------------- >> cmd: An exception of category 'FileReadError' occurred while >> cmd: [0] Rethrowing an exception that happened on a different thread. >> cmd: [1] Reading branch recoGenParticles_genParticles__SIM. >> cmd: [2] Calling XrdFile::readv() >> cmd: [3] XrdAdaptor::ClientRequest::HandleResponse() failure while running connection recovery >> cmd: [4] In XrdAdaptor::RequestManager::requestFailure() >> cmd: Exception Message: >> cmd: XrdAdaptor::RequestManager::requestFailure Open(name='root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/gs_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17wmLHEGS-00040ND_180160.root', flags=0x10, permissions=0660, old source=primeradiant03.crc.nd.edu:1096 (site T3_US_NotreDame)) => timeout when waiting for file open >> cmd: Additional Info: >> cmd: [a] Original error: '[ERROR] Server responded with an error: [3010] Unable to readv /store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/gs_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17wmLHEGS-00040ND_180160.root; operation not permitted >> cmd: ' (errno=3010, code=400, source=primeradiant03.crc.nd.edu:1096 (site T3_US_NotreDame)). >> cmd: [b] Disabled source: primeradiant03.crc.nd.edu:1096 >> cmd: ----- End Fatal Exception ------------------------------------------------- >> cmd: ----- Begin Fatal Exception 28-Nov-2019 12:43:14 EST----------------------- >> cmd: An exception of category 'FileReadError' occurred while >> cmd: [0] Rethrowing an exception that happened on a different thread. >> cmd: [1] Reading branch recoGenParticles_genParticles__SIM. >> cmd: [2] Calling XrdFile::readv() >> cmd: [3] XrdAdaptor::ClientRequest::HandleResponse() failure while running connection recovery >> cmd: [4] In XrdAdaptor::RequestManager::requestFailure() >> cmd: Exception Message: >> cmd: XrdAdaptor::RequestManager::requestFailure Open(name='root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/gs_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17wmLHEGS-00040ND_180160.root', flags=0x10, permissions=0660, old source=primeradiant03.crc.nd.edu:1096 (site T3_US_NotreDame)) => timeout when waiting for file open >> cmd: Additional Info: >> cmd: [a] Original error: '[ERROR] Server responded with an error: [3010] Unable to readv /store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/gs_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17wmLHEGS-00040ND_180160.root; operation not permitted >> cmd: ' (errno=3010, code=400, source=primeradiant03.crc.nd.edu:1096 (site T3_US_NotreDame)). >> cmd: [b] Disabled source: primeradiant03.crc.nd.edu:1096 >> cmd: ----- End Fatal Exception ------------------------------------------------- >> cmd: [2019-11-28 12:43:14.964682 -0500][Error ][XRootD ] [deepthought.crc.nd.edu:1094] Impossible to send message kXR_open (file: /store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/gs_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17wmLHEGS-00040ND_180160.root?tried=primeradiant03.crc.nd.edu, mode: 0460, flags: kXR_open_read kXR_async kXR_retstat ). Trying to recover. >> cmd: [2019-11-28 12:43:14.964905 -0500][Error ][XRootD ] [deepthought.crc.nd.edu:1094] Unable to get the response to request kXR_open (file: /store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/gs_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17wmLHEGS-00040ND_180160.root?tried=primeradiant03.crc.nd.edu, mode: 0460, flags: kXR_open_read kXR_async kXR_retstat ) >> cmd: ----- Begin Fatal Exception 28-Nov-2019 12:43:15 EST----------------------- >> cmd: An exception of category 'FileReadError' occurred while >> cmd: [0] Rethrowing an exception that happened on a different thread. >> cmd: [1] Reading branch recoGenParticles_genParticles__SIM. >> cmd: [2] Calling XrdFile::readv() >> cmd: [3] XrdAdaptor::ClientRequest::HandleResponse() failure while running connection recovery >> cmd: [4] In XrdAdaptor::RequestManager::requestFailure() >> cmd: Exception Message: >> cmd: XrdAdaptor::RequestManager::requestFailure Open(name='root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/gs_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17wmLHEGS-00040ND_180160.root', flags=0x10, permissions=0660, old source=primeradiant03.crc.nd.edu:1096 (site T3_US_NotreDame)) => timeout when waiting for file open >> cmd: Additional Info: >> cmd: [a] Original error: '[ERROR] Server responded with an error: [3010] Unable to readv /store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/gs_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17wmLHEGS-00040ND_180160.root; operation not permitted >> cmd: ' (errno=3010, code=400, source=primeradiant03.crc.nd.edu:1096 (site T3_US_NotreDame)). >> cmd: [b] Disabled source: primeradiant03.crc.nd.edu:1096 >> cmd: ----- End Fatal Exception ------------------------------------------------- >> cmd: >> cmd: >> cmd: A fatal system signal has occurred: segmentation violation >> cmd: The following is the call stack containing the origin of the signal. >> cmd: >> cmd: >> cmd: Current Modules: >> cmd: >> cmd: Module: none (crashed) >> cmd: Module: none >> cmd: Module: none >> cmd: Module: none >> cmd: Module: none >> cmd: Module: none >> cmd: >> cmd: A fatal system signal has occurred: segmentation violation >>> executable returned with exit code -11. @ Thu Nov 28 12:43:22 2019 >> trace: Traceback (most recent call last): >> trace: File "task.py", line 268, in wrapper >> trace: result = fct(data, *args, **kwargs) >> trace: File "task.py", line 897, in parse_fwk_report >> trace: report.parse(report_filename) >> trace: File "/disk/vc3-root/tmp/worker-230547-62554/t.200257/python/WMCore/FwkJobReport/Report.py", line 160, in parse >> trace: raise FwkJobReportException(msg) >> trace: FwkJobReportException: FwkJobReportException >> trace: Message: Error reading XML job report file, possibly corrupt XML File: >> trace: Details: no element found: line 369, column 0 >> trace: ModuleName : WMCore.FwkJobReport.Report >> trace: MethodName : parse >> trace: ClassInstance : None >> trace: FileName : /disk/vc3-root/tmp/worker-230547-62554/t.200257/python/WMCore/FwkJobReport/Report.py >> trace: ClassName : None >> trace: LineNumber : 160 >> trace: ErrorNr : 0 >> trace: >> trace: Traceback: >> trace: File "/disk/vc3-root/tmp/worker-230547-62554/t.200257/python/WMCore/FwkJobReport/Report.py", line 147, in parse >> trace: xmlToJobReport(self, xmlfile) >> trace: >> trace: File "/disk/vc3-root/tmp/worker-230547-62554/t.200257/python/WMCore/FwkJobReport/XMLParser.py", line 495, in xmlToJobReport >> trace: node = xmlFileToNode(xmlFile) >> trace: >> trace: File "/disk/vc3-root/tmp/worker-230547-62554/t.200257/python/WMCore/Algorithms/ParseXMLFile.py", line 67, in xmlFileToNode >> trace: build(node)) >> trace: >> trace: File "/disk/vc3-root/tmp/worker-230547-62554/t.200257/python/WMCore/Algorithms/ParseXMLFile.py", line 88, in expat_parse >> trace: parser.ParseFile(f) >> trace: >> trace: >>>>> call to 'parse_fwk_report' failed, exiting with exit code -11 @ Thu Nov 28 12:43:23 2019 Thu Nov 28 12:33:20 2019: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Thu Nov 28 12:33:21 2019: ApMon[WARNING]: Not sending parameters since no destination is defined. Thu Nov 28 12:33:21 2019: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. Thu Nov 28 12:43:22 2019: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Thu Nov 28 12:43:23 2019: ApMon[WARNING]: Not sending parameters since no destination is defined. Thu Nov 28 12:43:23 2019: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. >> Execution time -1574962368 >> Exiting with code -11 >> Reporting ExeExitCode -11 >> Reporting StageOutSE >> Reporting StageOutExitCode 0 Thu Nov 28 12:43:23 2019: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Thu Nov 28 12:43:24 2019: ApMon[WARNING]: Not sending parameters since no destination is defined. Thu Nov 28 12:43:24 2019: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. ==== working directory after execution @ Thu Nov 28 12:43:24 EST 2019 ==== == dir: total 212844 == dir: drwxr-xr-x 17 kmohrman campus 265 Nov 28 12:32 CMSSW_9_4_0_patch1 == dir: -rw-r--r-- 1 kmohrman campus 160852004 Nov 28 12:40 HIG-RunIIFall17DRPremix-00823ND_step1.root == dir: -rw-r--r-- 3 kmohrman campus 28090622 Nov 27 22:40 HIG-RunIIFall17DRPremix-00823_1_cfg.py == dir: -rw-r--r-- 1 kmohrman campus 28092120 Nov 28 12:33 HIG-RunIIFall17DRPremix-00823_1_cfg_mod.py == dir: drwxr-xr-x 2 kmohrman campus 91 Nov 28 12:31 bin == dir: -rwxr-xr-x 3 kmohrman campus 627272 Nov 27 21:54 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 Nov 28 12:31 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 Nov 28 12:43 cctools-temp-t.200257.E2o8km == dir: -rw------- 1 kmohrman campus 51 Nov 28 12:32 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 Nov 28 12:32 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 Nov 28 12:31 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 Nov 28 12:31 librmonitor_helper.so.6EG5eA == dir: -rw-r--r-- 2 kmohrman campus 2201 Nov 28 12:31 parameters.json == dir: -rw------- 2 kmohrman campus 9194 Nov 28 12:31 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 Nov 28 12:31 python == dir: -rw-r--r-- 1 kmohrman campus 742 Nov 28 12:43 report.json == dir: -rw-r--r-- 3 kmohrman campus 570 Nov 27 21:54 report.json.in == dir: -rw-r--r-- 1 kmohrman campus 23225 Nov 28 12:43 report.xml == dir: -rw-r--r-- 1 kmohrman campus 1852 Nov 28 12:43 report.xml.gz == dir: -rw-r--r-- 3 kmohrman campus 492 Nov 27 21:54 sandbox-CMSSW_9_4_0_patch1-slc7_amd64_gcc630.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 49 Nov 28 12:31 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 Nov 28 12:33 t_wrapper_ready == dir: -rw-r--r-- 1 kmohrman campus 11 Nov 28 12:32 t_wrapper_start == dir: -rwxr-xr-x 3 kmohrman campus 47217 Nov 27 21:54 task.py == dir: -rwxr-xr-x 3 kmohrman campus 6296 Nov 27 21:54 wrapper.sh === wrapper done @ Thu Nov 28 12:43:24 EST 2019 === final return status = 245 @ Thu Nov 28 12:43:24 EST 2019