==== wrapper started @ Mon Dec 2 05:09:39 EST 2019 ==== == startup: hostname: d6cneh080.crc.nd.edu == startup: kernel: Linux d6cneh080.crc.nd.edu 3.10.0-957.el7.x86_64 #1 SMP Thu Oct 4 20:48:51 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux ==== tracing google @ Mon Dec 2 05:09:44 EST 2019 ==== wrapper.sh: line 20: traceroute: command not found ==== environment at startup @ Mon Dec 2 05:09:49 EST 2019 ==== == env: VC3_VERSION_SED=4.2 == env: CCTOOLS_RESOURCE_PROCESS_START=1575281389142464 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: VC3_ROOT_GZIP=/ == env: SHELL=/bin/sh == env: TERM=xterm-256color == env: MAKEFLAGS=-j4 == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-10203/t.229966/cctools-temp-t.229966.CxOLfN == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-10203/t.229966/librmonitor_helper.so.NdPOsR == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: LOBSTER_CMSSW_VERSION=CMSSW_9_4_0_patch1 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: USER=kmohrman == env: TEMP=/disk/vc3-root/tmp/worker-230547-10203/t.229966/cctools-temp-t.229966.CxOLfN == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: LD_LIBRARY_PATH=/opt/crc/usr/local/lib:/.singularity.d/libs == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_ROOT_MAKE=/ == env: VC3_DISTFILES=/disk/vc3-distfiles == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-10203/cache/tmp == env: VC3_VERSION_TAR=1.26 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-SsyGWt == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: VC3_VERSION_GZIP=1.5 == env: VC3_ENV_TAG_GLOBAL=9953 == env: PATH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:/bin == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-SsyGWt == env: VC3_ROOT_PKG_CONFIG=/ == env: PWD=/disk/vc3-root/tmp/worker-230547-10203/t.229966 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_FULL_SED=4.2.2 == env: VC3_VERSION_WHICH=2.20 == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-10203 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_ROOT_SED=/ == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: CXX=g++ == env: SHLVL=3 == env: HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_MAKE=3.82 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: DISK=6000 == env: MEMORY=7800 == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: TMP=/disk/vc3-root/tmp/worker-230547-10203/t.229966/cctools-temp-t.229966.CxOLfN == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_VERSION_PKG_CONFIG=0.27 == env: VC3_ROOT_TAR=/ == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-SsyGWt.wrapper == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: CC=gcc == env: CORES=6 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CCTOOLS_RESOURCE_MONITOR_INFO=1024 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_ALL_postLHE.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=13948 == env: _=/bin/env ==== cpu info @ Mon Dec 2 05:09:54 EST 2019 ==== == cpu: processor : 0 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2667.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 0 == cpu: cpu cores : 6 == cpu: apicid : 0 == cpu: initial apicid : 0 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.42 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 1 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1600.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 1 == cpu: cpu cores : 6 == cpu: apicid : 2 == cpu: initial apicid : 2 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.42 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 2 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2667.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 2 == cpu: cpu cores : 6 == cpu: apicid : 4 == cpu: initial apicid : 4 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.42 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 3 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1733.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 8 == cpu: cpu cores : 6 == cpu: apicid : 16 == cpu: initial apicid : 16 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.42 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 4 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2667.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 9 == cpu: cpu cores : 6 == cpu: apicid : 18 == cpu: initial apicid : 18 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.42 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 5 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2133.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 10 == cpu: cpu cores : 6 == cpu: apicid : 20 == cpu: initial apicid : 20 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.42 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 6 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2667.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 0 == cpu: cpu cores : 6 == cpu: apicid : 32 == cpu: initial apicid : 32 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.23 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 7 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2667.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 1 == cpu: cpu cores : 6 == cpu: apicid : 34 == cpu: initial apicid : 34 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.23 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 8 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2000.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 2 == cpu: cpu cores : 6 == cpu: apicid : 36 == cpu: initial apicid : 36 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.23 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 9 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2133.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 8 == cpu: cpu cores : 6 == cpu: apicid : 48 == cpu: initial apicid : 48 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.23 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 10 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2667.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 9 == cpu: cpu cores : 6 == cpu: apicid : 50 == cpu: initial apicid : 50 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.23 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 11 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1600.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 10 == cpu: cpu cores : 6 == cpu: apicid : 52 == cpu: initial apicid : 52 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.23 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: === using CVMFS proxy: http://eddie.crc.nd.edu:3128 @ Mon Dec 2 05:10:19 EST 2019 === using Frontier proxy: http://eddie.crc.nd.edu:3128 @ Mon Dec 2 05:10:19 EST 2019 === parrot helper: /disk/vc3-root/tmp/worker-230547-10203/t.229966/lib/libparrot_helper.so @ Mon Dec 2 05:10:24 EST 2019 ==== content of /disk/vc3-root/tmp/worker-230547-10203/cache/tmp @ Mon Dec 2 05:10:24 EST 2019 ==== == cache: total 28 == cache: drwx------ 261 kmohrman campus 8192 Dec 2 05:09 ex_parrot_kmohrman == cache: -rw-r--r-- 1 kmohrman campus 10 Dec 2 03:54 hot_cache == cache: drwxr-x--- 260 kmohrman campus 8192 Dec 2 03:26 cvmfs === OSG certificate location: /cvmfs/oasis.opensciencegrid.org/mis/certificates @ Mon Dec 2 05:10:29 EST 2019 === testing parrot usage @ Mon Dec 2 05:10:29 EST 2019 === parrot OK @ Mon Dec 2 05:10:34 EST 2019 === starting parrot to access CMSSW... @ Mon Dec 2 05:10:34 EST 2019 ==== wrapper started @ Mon Dec 2 05:10:34 EST 2019 ==== == startup: hostname: d6cneh080.crc.nd.edu == startup: kernel: Linux d6cneh080.crc.nd.edu 3.10.0-957.el7.x86_64 #1 SMP Thu Oct 4 20:48:51 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux ==== tracing google @ Mon Dec 2 05:10:34 EST 2019 ==== wrapper.sh: line 20: traceroute: command not found ==== environment at startup @ Mon Dec 2 05:10:34 EST 2019 ==== == env: VC3_VERSION_SED=4.2 == env: CCTOOLS_RESOURCE_PROCESS_START=1575281434600008 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/ == env: LOBSTER_GFAL_COPY= == env: MAKEFLAGS=-j4 == env: PARROT_HELPER=/disk/vc3-root/tmp/worker-230547-10203/t.229966/lib/libparrot_helper.so == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-10203/t.229966/cctools-temp-t.229966.CxOLfN == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-10203/t.229966/librmonitor_helper.so.NdPOsR == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: LOBSTER_CMSSW_VERSION=CMSSW_9_4_0_patch1 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: LD_LIBRARY_PATH=/opt/crc/usr/local/lib:/.singularity.d/libs:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-10203/t.229966/cctools-temp-t.229966.CxOLfN == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/ == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-SsyGWt == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-10203/cache/tmp == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: PARROT_CVMFS_REPO=*:try_local_filesystem == env: *.cern.ch:pubkey=,url=http://cvmfs.fnal.gov:8000/opt/*;http://cvmfs.racf.bnl.gov:8000/opt/* == env: *.opensciencegrid.org:pubkey=,url=http://oasis-replica.opensciencegrid.org:8000/cvmfs/*;http://cvmfs.fnal.gov:8000/cvmfs/*;http://cvmfs.racf.bnl.gov:8000/cvmfs/* == env: VC3_VERSION_GZIP=1.5 == env: PATH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:/bin == env: VC3_ENV_TAG_GLOBAL=9953 == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-SsyGWt == env: PWD=/disk/vc3-root/tmp/worker-230547-10203/t.229966 == env: VC3_ROOT_PKG_CONFIG=/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_WHICH=2.20 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: LOBSTER_LCG_CP= == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-10203 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: CXX=g++ == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: DISK=6000 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-10203/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-10203/cache/tmp/cvmfs == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=7800 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TMP=/disk/vc3-root/tmp/worker-230547-10203/t.229966/cctools-temp-t.229966.CxOLfN == env: PYTHONPATH=python: == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_ROOT_TAR=/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-SsyGWt.wrapper == env: CC=gcc == env: CCTOOLS_RESOURCE_MONITOR_INFO=1024 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=6 == env: PARROT_DEBUG_FLAGS= == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_ALL_postLHE.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=13948 == env: _=/bin/env ==== cpu info @ Mon Dec 2 05:10:34 EST 2019 ==== == cpu: processor : 0 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2267.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 0 == cpu: cpu cores : 6 == cpu: apicid : 0 == cpu: initial apicid : 0 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.42 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 1 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2667.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 1 == cpu: cpu cores : 6 == cpu: apicid : 2 == cpu: initial apicid : 2 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.42 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 2 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2267.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 2 == cpu: cpu cores : 6 == cpu: apicid : 4 == cpu: initial apicid : 4 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.42 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 3 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2267.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 8 == cpu: cpu cores : 6 == cpu: apicid : 16 == cpu: initial apicid : 16 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.42 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 4 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2267.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 9 == cpu: cpu cores : 6 == cpu: apicid : 18 == cpu: initial apicid : 18 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.42 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 5 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2667.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 10 == cpu: cpu cores : 6 == cpu: apicid : 20 == cpu: initial apicid : 20 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.42 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 6 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2000.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 0 == cpu: cpu cores : 6 == cpu: apicid : 32 == cpu: initial apicid : 32 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.23 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 7 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2667.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 1 == cpu: cpu cores : 6 == cpu: apicid : 34 == cpu: initial apicid : 34 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.23 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 8 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1867.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 2 == cpu: cpu cores : 6 == cpu: apicid : 36 == cpu: initial apicid : 36 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.23 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 9 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2667.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 8 == cpu: cpu cores : 6 == cpu: apicid : 48 == cpu: initial apicid : 48 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.23 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 10 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1733.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 9 == cpu: cpu cores : 6 == cpu: apicid : 50 == cpu: initial apicid : 50 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.23 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 11 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2133.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 10 == cpu: cpu cores : 6 == cpu: apicid : 52 == cpu: initial apicid : 52 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.23 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: === using parrot @ Mon Dec 2 05:10:35 EST 2019 === sourcing CMS setup @ Mon Dec 2 05:10:35 EST 2019 LibCvmfs version 2.4, revision 25 === sourcing OSG setup @ Mon Dec 2 05:10:35 EST 2019 ==== environment after sourcing startup scripts @ Mon Dec 2 05:10:35 EST 2019 ==== == env: VC3_VERSION_SED=4.2 == env: MANPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/share/man:/cvmfs/cms.cern.ch/share/man: == env: CCTOOLS_RESOURCE_PROCESS_START=1575281435818616 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: GFAL_PLUGIN_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib64/gfal2-plugins/ == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/ == env: LOBSTER_GFAL_COPY=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/bin/gfal-copy == env: VOMS_USERCONF=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/etc/vomses == env: MAKEFLAGS=-j4 == env: GLOBUS_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-10203/t.229966/cctools-temp-t.229966.CxOLfN == env: PERL5LIB=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/share/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib64/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib64/perl5 == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: CVSROOT=:gserver:cmssw.cvs.cern.ch:/local/reps/CMSSW == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-10203/t.229966/librmonitor_helper.so.NdPOsR == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: X509_CERT_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/etc/grid-security/certificates == env: SCRAM_ARCH=slc7_amd64_gcc493 == env: LOBSTER_CMSSW_VERSION=CMSSW_9_4_0_patch1 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: LD_LIBRARY_PATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib64/dcap:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib64/lcgdm:/opt/crc/usr/local/lib:/.singularity.d/libs:lib:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-10203/t.229966/cctools-temp-t.229966.CxOLfN == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/ == env: OSG_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-SsyGWt == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-10203/cache/tmp == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: PARROT_CVMFS_REPO=*:try_local_filesystem == env: *.cern.ch:pubkey=,url=http://cvmfs.fnal.gov:8000/opt/*;http://cvmfs.racf.bnl.gov:8000/opt/* == env: *.opensciencegrid.org:pubkey=,url=http://oasis-replica.opensciencegrid.org:8000/cvmfs/*;http://cvmfs.fnal.gov:8000/cvmfs/*;http://cvmfs.racf.bnl.gov:8000/cvmfs/* == env: VC3_VERSION_GZIP=1.5 == env: PATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/sbin:/cvmfs/cms.cern.ch/common:/cvmfs/cms.cern.ch/bin:/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:/bin == env: VC3_ENV_TAG_GLOBAL=9953 == env: CMS_PATH=/cvmfs/cms.cern.ch == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-SsyGWt == env: PWD=/disk/vc3-root/tmp/worker-230547-10203/t.229966 == env: VC3_ROOT_PKG_CONFIG=/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_WHICH=2.20 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: X509_VOMS_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/etc/grid-security/vomsdir == env: LOBSTER_LCG_CP= == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-10203 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: CXX=g++ == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: DISK=6000 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-10203/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-10203/cache/tmp/cvmfs == env: GFAL_CONFIG_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/etc/gfal2.d/ == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=7800 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TMP=/disk/vc3-root/tmp/worker-230547-10203/t.229966/cctools-temp-t.229966.CxOLfN == env: PYTHONPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib/python2.7/site-packages:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib64/python2.7/site-packages:python:python: == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_ROOT_TAR=/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-SsyGWt.wrapper == env: CC=gcc == env: CCTOOLS_RESOURCE_MONITOR_INFO=1024 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=6 == env: PARROT_DEBUG_FLAGS= == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_ALL_postLHE.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=13948 == env: _=/bin/env ==== proxy information @ Mon Dec 2 05:10:36 EST 2019 ==== == proxy: subject : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman/CN=500423651 == proxy: issuer : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman == proxy: identity : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman == proxy: type : RFC compliant proxy == proxy: strength : 1024 bits == proxy: path : proxy == proxy: timeleft : 113:23:12 ==== working directory at startup @ Mon Dec 2 05:10:36 EST 2019 ==== == dir: total 28288 == dir: -rw-r--r-- 2 kmohrman campus 28090622 Dec 2 03:25 HIG-RunIIFall17DRPremix-00823_1_cfg.py == dir: drwxr-xr-x 2 kmohrman campus 71 Dec 2 05:09 bin == dir: -rwxr-xr-x 5 kmohrman campus 627272 Dec 2 03:25 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 Dec 2 05:09 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 Dec 2 05:09 cctools-temp-t.229966.CxOLfN == dir: -rw------- 1 kmohrman campus 51 Dec 2 05:10 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 Dec 2 05:10 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 Dec 2 05:09 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 Dec 2 05:09 librmonitor_helper.so.NdPOsR == dir: -rw-r--r-- 2 kmohrman campus 2177 Dec 2 05:09 parameters.json == dir: -rw------- 2 kmohrman campus 9194 Dec 2 05:09 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 Dec 2 05:09 python == dir: -rw-r--r-- 5 kmohrman campus 570 Dec 2 03:25 report.json.in == dir: -rw-r--r-- 5 kmohrman campus 492 Dec 2 03:25 sandbox-CMSSW_9_4_0_patch1-slc7_amd64_gcc630.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 37 Dec 2 05:09 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 Dec 2 05:10 t_wrapper_start == dir: -rwxr-xr-x 5 kmohrman campus 47217 Dec 2 03:25 task.py == dir: -rwxr-xr-x 5 kmohrman campus 6296 Dec 2 03:25 wrapper.sh === creating new release CMSSW_9_4_0_patch1 for scram arch slc7_amd64_gcc630 @ Mon Dec 2 05:10:36 EST 2019 Attaching cms-ib.cern.ch failed: Failed to initialize root file catalog (16) Attaching cms-ib.cern.ch failed: Failed to initialize root file catalog (16) Attaching cms-ib.cern.ch failed: Failed to initialize root file catalog (16) Attaching cms-ib.cern.ch failed: Failed to initialize root file catalog (16) WARNING: In non-interactive mode release checks e.g. deprecated releases, production architectures are disabled. === unpacking sandbox-CMSSW_9_4_0_patch1-slc7_amd64_gcc630.tar.bz2 @ Mon Dec 2 05:10:39 EST 2019 ==== machine load @ Mon Dec 2 05:10:41 EST 2019 ==== top: unknown option 'M' Usage: top -hv | -bcHiOSs -d secs -n max -u|U user -p pid(s) -o field -w [cols] ==== environment before execution @ Mon Dec 2 05:10:41 EST 2019 ==== == env: G4LEVELGAMMADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4PhotonEvaporation/3.2/data/PhotonEvaporation3.2 == env: UTM_XSD_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/utm/utm_0.6.5-fmblme == env: SRT_G4LEVELGAMMADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4PhotonEvaporation/3.2/data/PhotonEvaporation3.2 == env: VC3_VERSION_SED=4.2 == env: CMSSW_RELEASE_BASE=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1 == env: SCRAMRT_SET=CMSSW:CMSSW_9_4_0_patch1:slc7_amd64_gcc630:V2_2_9_pre05:SRT_ == env: MANPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/share/man:/cvmfs/cms.cern.ch/share/man: == env: CCTOOLS_RESOURCE_PROCESS_START=1575281441602480 == env: CMSSW_FWLITE_INCLUDE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sherpa/2.2.4-fmblme2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/hepmc/2.06.07/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/clhep/2.3.4.2-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/boost/1.63.0-fmblme/include == env: COMPILER_RUNTIME_OBJECTS=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0 == env: SRT_MALLOC_CONF_SCRAMRTDEL=lg_chunk:18,lg_dirty_mult:4 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: ROOT_INCLUDE_PATH=/disk/vc3-root/tmp/worker-230547-10203/t.229966/CMSSW_9_4_0_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw/CMSSW_9_4_0/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/coral/CORAL_2_3_21-fmblme3/include/LCG:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/mctester/1.25.0a-fmblme3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/lcg/root/6.10.08/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include/QtDesigner:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/tauolapp/1.1.5-fmblme2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/charybdis/1.003-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/thepeg/1.9.2p1-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sherpa/2.2.4-fmblme2/include/SHERPA-MC:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include/QtOpenGL:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include/QtGui:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/pythia8/230/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/herwig/6.521-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/rivet/2.5.4/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include/Qt3Support:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/lwtnn/1.0-fmblme2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/classlib/3.1.3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/lhapdf/6.2.1-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/cgal/4.2-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/tkonlinesw/4.1.0-1-fmblme3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/starlight/r193-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include/Qt:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include/QtCore:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include/QtXml:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/mcdb/1.0.3/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/libungif/4.1.4/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/libtiff/4.0.3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/libpng/1.6.16/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4/10.02.p02-fmblme3/include/Geant4:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/frontier_client/2.8.20-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/pcre/8.37/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/boost/1.63.0-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/xrootd/4.6.1-fmblme/include/xrootd/private:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/vdt/0.3.9/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/valgrind/3.12.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/utm/utm_0.6.5-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/toprex/4.23/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/tbb/2018/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/tauola/27.121.5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sigcpp/2.6.2/include/sigc++-2.0:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sqlite/3.16.2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/protobuf/3.4.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/pacparser/1.3.5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/oracle/12.1.0.2.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/meschach/1.2.pCMS1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/madgraph5amcatnlo/2.4.3-fmblme3:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/libhepml/0.2.1/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/ktjet/1.06-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/jimmy/4.2-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/jemalloc/4.5.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/xz/5.2.2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/heppdt/3.03.00-fmblme2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/hector/1.3.4_patch1-fmblme3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gsl/2.2.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/libjpeg-turbo/1.3.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/giflib/4.2.3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/xerces-c/3.1.3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gdbm/1.10/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/freetype/2.5.3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/fftw3/3.3.2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/fftjet/1.5.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/fastjet/3.1.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/expat/2.1.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/hepmc/2.06.07/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/dpm/1.8.0.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/dcap/2.47.8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/libxml2/2.9.1/include/libxml2:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/curl/7.52.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/cppunit/1.12.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/clhep/2.3.4.2-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/openssl/1.0.2d/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/pythia6/426/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/photos/215.5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/zlib-x86_64/1.2.11/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/libuuid/2.22.2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/castor/2.1.13.9/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/castor/2.1.13.9/include/shift:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/cascade/2.2.04-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/bz2lib/1.0.6/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/python/2.7.11-fmblme/include/python2.7:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/ittnotify/16.06.18-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0/include/c++/6.3.0:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0/include/c++/6.3.0/x86_64-unknown-linux-gnu:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0/include/c++/6.3.0/backward:/usr/local/include:/usr/include == env: INTEL_LICENSE_FILE=28518@lxlicen01.cern.ch,28518@lxlicen02.cern.ch,28518@lxlicen03.cern.ch == env: SRT_TEXMFHOME_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/rivet/2.5.4/share/Rivet/texmf == env: SRT_GEANT4_PARFULLCMS_CONFIG_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-parfullcms/2014.01.27-fmblme3/share/ParFullCMS == env: GFAL_PLUGIN_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib64/gfal2-plugins/ == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/ == env: LOBSTER_GFAL_COPY=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/bin/gfal-copy == env: PDFPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/rivet/2.5.4/share == env: DBSCMD_HOME=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/dbs-client/DBS_2_1_9-fmblme/lib/DBSAPI == env: CMSSW_FULL_RELEASE_BASE=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw/CMSSW_9_4_0 == env: SRT_TNS_ADMIN_SCRAMRTDEL=/etc == env: VOMS_USERCONF=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/etc/vomses == env: MAKEFLAGS=-j4 == env: ROOT_GCC_TOOLCHAIN=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0 == env: GLOBUS_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-10203/t.229966/cctools-temp-t.229966.CxOLfN == env: G4FORCENUMBEROFTHREADS=max == env: OPENBLAS_NUM_THREADS=1 == env: SRT_PDFPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/rivet/2.5.4/share == env: PERL5LIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/git/2.13.0/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/share/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib64/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib64/perl5 == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: CMSSW_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms == env: LHAPDF_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/lhapdf/6.2.1-fmblme/share/LHAPDF == env: CVSROOT=:gserver:cmssw.cvs.cern.ch:/local/reps/CMSSW == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-10203/t.229966/librmonitor_helper.so.NdPOsR == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: CMSSW_GIT_HASH=CMSSW_9_4_0_patch1 == env: SRT_G4ABLADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4ABLA/3.0/data/G4ABLA3.0 == env: QTDIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7 == env: SRT_SCONS_LIB_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/scons/1.2.0-fmblme/lib == env: OLDPWD=/disk/vc3-root/tmp/worker-230547-10203/t.229966/CMSSW_9_4_0_patch1 == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: G4NEUTRONXSDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4NEUTRONXS/1.4/data/G4NEUTRONXS1.4 == env: QTINC=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include == env: SRT_COMPILER_RUNTIME_OBJECTS_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0 == env: X509_CERT_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/etc/grid-security/certificates == env: SCRAM_ARCH=slc7_amd64_gcc630 == env: GIT_SSL_CAINFO=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/git/2.13.0/share/ssl/certs/ca-bundle.crt == env: DBS_CLIENT_CONFIG=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/dbs-client/DBS_2_1_9-fmblme/lib/DBSAPI/dbs.config == env: SRT_CMS_OPENLOOPS_PREFIX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/openloops/1.3.1-fmblme == env: SRT_GIT_EXEC_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/git/2.13.0/libexec/git-core == env: LOBSTER_CMSSW_VERSION=CMSSW_9_4_0_patch1 == env: ROOT_TTREECACHE_SIZE=0 == env: EVTGENDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/evtgen/1.6.0-fmblme2/share == env: SRT_INTEL_LICENSE_FILE_SCRAMRTDEL=28518@lxlicen01.cern.ch,28518@lxlicen02.cern.ch,28518@lxlicen03.cern.ch == env: SRT_ROOT_INCLUDE_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-10203/t.229966/CMSSW_9_4_0_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw/CMSSW_9_4_0/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/coral/CORAL_2_3_21-fmblme3/include/LCG:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/mctester/1.25.0a-fmblme3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/lcg/root/6.10.08/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include/QtDesigner:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/tauolapp/1.1.5-fmblme2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/charybdis/1.003-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/thepeg/1.9.2p1-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sherpa/2.2.4-fmblme2/include/SHERPA-MC:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include/QtOpenGL:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include/QtGui:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/pythia8/230/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/herwig/6.521-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/rivet/2.5.4/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include/Qt3Support:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/lwtnn/1.0-fmblme2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/classlib/3.1.3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/lhapdf/6.2.1-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/cgal/4.2-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/tkonlinesw/4.1.0-1-fmblme3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/starlight/r193-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include/Qt:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include/QtCore:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include/QtXml:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/mcdb/1.0.3/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/libungif/4.1.4/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/libtiff/4.0.3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/libpng/1.6.16/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4/10.02.p02-fmblme3/include/Geant4:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/frontier_client/2.8.20-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/pcre/8.37/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/boost/1.63.0-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/xrootd/4.6.1-fmblme/include/xrootd/private:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/vdt/0.3.9/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/valgrind/3.12.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/utm/utm_0.6.5-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/toprex/4.23/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/tbb/2018/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/tauola/27.121.5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sigcpp/2.6.2/include/sigc++-2.0:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sqlite/3.16.2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/protobuf/3.4.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/pacparser/1.3.5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/oracle/12.1.0.2.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/meschach/1.2.pCMS1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/madgraph5amcatnlo/2.4.3-fmblme3:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/libhepml/0.2.1/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/ktjet/1.06-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/jimmy/4.2-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/jemalloc/4.5.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/xz/5.2.2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/heppdt/3.03.00-fmblme2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/hector/1.3.4_patch1-fmblme3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gsl/2.2.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/libjpeg-turbo/1.3.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/giflib/4.2.3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/xerces-c/3.1.3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gdbm/1.10/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/freetype/2.5.3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/fftw3/3.3.2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/fftjet/1.5.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/fastjet/3.1.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/expat/2.1.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/hepmc/2.06.07/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/dpm/1.8.0.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/dcap/2.47.8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/libxml2/2.9.1/include/libxml2:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/curl/7.52.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/cppunit/1.12.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/clhep/2.3.4.2-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/openssl/1.0.2d/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/pythia6/426/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/photos/215.5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/zlib-x86_64/1.2.11/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/libuuid/2.22.2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/castor/2.1.13.9/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/castor/2.1.13.9/include/shift:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/cascade/2.2.04-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/bz2lib/1.0.6/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/python/2.7.11-fmblme/include/python2.7:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/ittnotify/16.06.18-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0/include/c++/6.3.0:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0/include/c++/6.3.0/x86_64-unknown-linux-gnu:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0/include/c++/6.3.0/backward:/usr/local/include:/usr/include == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: G4LEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4EMLOW/6.48/data/G4EMLOW6.48 == env: SRT_VINCIADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/vincia/2.2.01-fmblme/share/Vincia/xmldoc == env: SRT_ROOT_TTREECACHE_PREFILL_SCRAMRTDEL=0 == env: OPAL_PREFIX=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/openmpi/2.1.2rc4 == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: ROOT_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/madgraph5amcatnlo/2.4.3-fmblme3 == env: SHERPA_INCLUDE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sherpa/2.2.4-fmblme2/include/SHERPA-MC == env: SRT_LHAPDF_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/lhapdf/6.2.1-fmblme/share/LHAPDF == env: LD_LIBRARY_PATH=/disk/vc3-root/tmp/worker-230547-10203/t.229966/CMSSW_9_4_0_patch1/biglib/slc7_amd64_gcc630:/disk/vc3-root/tmp/worker-230547-10203/t.229966/CMSSW_9_4_0_patch1/lib/slc7_amd64_gcc630:/disk/vc3-root/tmp/worker-230547-10203/t.229966/CMSSW_9_4_0_patch1/external/slc7_amd64_gcc630/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/biglib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/lib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/external/slc7_amd64_gcc630/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw/CMSSW_9_4_0/biglib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw/CMSSW_9_4_0/lib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/llvm/4.0.1/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib64/dcap:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib64/lcgdm:/opt/crc/usr/local/lib:/.singularity.d/libs:lib:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-10203/t.229966/cctools-temp-t.229966.CxOLfN == env: SRT_CMSSW_RELEASE_BASE_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1 == env: SRT_RIVET_ANALYSIS_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-10203/t.229966/CMSSW_9_4_0_patch1/lib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/lib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/rivet/2.5.4/lib == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: SRT_PERL5LIB_SCRAMRT=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/git/2.13.0/share/perl5 == env: SRT_CMSSW_VERSION_SCRAMRTDEL=CMSSW_9_4_0_patch1 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/ == env: VALGRIND_LIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/valgrind/3.12.0/lib/valgrind == env: SRT_CMSSW_GIT_HASH_SCRAMRTDEL=CMSSW_9_4_0_patch1 == env: SRT_ROOTSYS_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/lcg/root/6.10.08/ == env: OSG_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-SsyGWt == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-10203/cache/tmp == env: G4NEUTRONHPDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4NDL/4.5/data/G4NDL4.5 == env: GEANT4_PARFULLCMS_CONFIG_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-parfullcms/2014.01.27-fmblme3/share/ParFullCMS == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: CSC_TRACK_FINDER_DATA_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/CSCTrackFinderEmulation/1.2/data/ == env: SRT_QTINC_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/include == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: G4ENSDFSTATEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4ENSDFSTATE/1.2.3/data/G4ENSDFSTATE1.2.3 == env: G4RADIOACTIVEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4RadioactiveDecay/4.3.2/data/RadioactiveDecay4.3.2 == env: ROOFITSYS=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/lcg/root/6.10.08/ == env: SRT_ROOFITSYS_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/lcg/root/6.10.08/ == env: SRT_G4RADIOACTIVEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4RadioactiveDecay/4.3.2/data/RadioactiveDecay4.3.2 == env: SRT_G4ENSDFSTATEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4ENSDFSTATE/1.2.3/data/G4ENSDFSTATE1.2.3 == env: SRT_CLHEP_PARAM_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/clhep/2.3.4.2-fmblme == env: G4ABLADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4ABLA/3.0/data/G4ABLA3.0 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: SRT_SHERPA_INCLUDE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sherpa/2.2.4-fmblme2/include/SHERPA-MC == env: SRT_G4FORCENUMBEROFTHREADS_SCRAMRTDEL=max == env: SRT_WORKER_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/blackhat/0.9.9-fmblme/share/blackhat/datafiles/ == env: PARROT_CVMFS_REPO=*:try_local_filesystem == env: *.cern.ch:pubkey=,url=http://cvmfs.fnal.gov:8000/opt/*;http://cvmfs.racf.bnl.gov:8000/opt/* == env: *.opensciencegrid.org:pubkey=,url=http://oasis-replica.opensciencegrid.org:8000/cvmfs/*;http://cvmfs.fnal.gov:8000/cvmfs/*;http://cvmfs.racf.bnl.gov:8000/cvmfs/* == env: VC3_VERSION_GZIP=1.5 == env: TNS_ADMIN=/etc == env: SRT_HEPPDT_PARAM_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/heppdt/3.03.00-fmblme2 == env: PATH=/cvmfs/cms.cern.ch/share/overrides/bin:/disk/vc3-root/tmp/worker-230547-10203/t.229966/CMSSW_9_4_0_patch1/bin/slc7_amd64_gcc630:/disk/vc3-root/tmp/worker-230547-10203/t.229966/CMSSW_9_4_0_patch1/external/slc7_amd64_gcc630/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/bin/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/external/slc7_amd64_gcc630/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw/CMSSW_9_4_0/bin/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/llvm/4.0.1/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/sbin:/cvmfs/cms.cern.ch/common:/cvmfs/cms.cern.ch/bin:/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:/bin == env: VC3_ENV_TAG_GLOBAL=9953 == env: SRT_DBS_CLIENT_CONFIG_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/dbs-client/DBS_2_1_9-fmblme/lib/DBSAPI/dbs.config == env: SRT_CMSSW_SEARCH_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-10203/t.229966/CMSSW_9_4_0_patch1/src:/disk/vc3-root/tmp/worker-230547-10203/t.229966/CMSSW_9_4_0_patch1/external/slc7_amd64_gcc630/data:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/external/slc7_amd64_gcc630/data == env: SRT_GIT_SSL_CAINFO_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/git/2.13.0/share/ssl/certs/ca-bundle.crt == env: CMS_PATH=/cvmfs/cms.cern.ch == env: VC3_ROOT=/disk/vc3-root == env: SRT_UTM_XSD_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/utm/utm_0.6.5-fmblme == env: SRT_PATH_SCRAMRT=/cvmfs/cms.cern.ch/share/overrides/bin:/disk/vc3-root/tmp/worker-230547-10203/t.229966/CMSSW_9_4_0_patch1/bin/slc7_amd64_gcc630:/disk/vc3-root/tmp/worker-230547-10203/t.229966/CMSSW_9_4_0_patch1/external/slc7_amd64_gcc630/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/bin/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/external/slc7_amd64_gcc630/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw/CMSSW_9_4_0/bin/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/llvm/4.0.1/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0/bin == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-SsyGWt == env: RIVET_ANALYSIS_PATH=/disk/vc3-root/tmp/worker-230547-10203/t.229966/CMSSW_9_4_0_patch1/lib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/lib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/rivet/2.5.4/lib == env: SRT_LOCALRT_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-10203/t.229966/CMSSW_9_4_0_patch1 == env: SRT_CMSSW_BASE_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-10203/t.229966/CMSSW_9_4_0_patch1 == env: PWD=/disk/vc3-root/tmp/worker-230547-10203/t.229966 == env: VC3_ROOT_PKG_CONFIG=/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: SRT_OPAL_PREFIX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/openmpi/2.1.2rc4 == env: VC3_VERSION_WHICH=2.20 == env: LANG=C == env: SRT_QTDIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: SRT_G4NEUTRONHPDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4NDL/4.5/data/G4NDL4.5 == env: X509_VOMS_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/etc/grid-security/vomsdir == env: LOBSTER_LCG_CP= == env: SRT_SHERPA_SHARE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sherpa/2.2.4-fmblme2/share/SHERPA-MC == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-10203 == env: CASCADE_PDFPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/cascade/2.2.04-fmblme/share == env: SRT_ROOT_GCC_TOOLCHAIN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0 == env: SRT_CASCADE_PDFPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/cascade/2.2.04-fmblme/share == env: WORKER_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/blackhat/0.9.9-fmblme/share/blackhat/datafiles/ == env: GIT_TEMPLATE_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/git/2.13.0/share/git-core/templates == env: G4SAIDXSDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4SAIDDATA/1.1/data/G4SAIDDATA1.1 == env: SRT_DBSCMD_HOME_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/dbs-client/DBS_2_1_9-fmblme/lib/DBSAPI == env: SRT_CMSSW_FULL_RELEASE_BASE_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw/CMSSW_9_4_0 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: SRT_CMSSW_FWLITE_INCLUDE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sherpa/2.2.4-fmblme2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/hepmc/2.06.07/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/clhep/2.3.4.2-fmblme/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/boost/1.63.0-fmblme/include == env: SRT_PYTHONPATH_SCRAMRT=/disk/vc3-root/tmp/worker-230547-10203/t.229966/CMSSW_9_4_0_patch1/python:/disk/vc3-root/tmp/worker-230547-10203/t.229966/CMSSW_9_4_0_patch1/lib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/lib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw/CMSSW_9_4_0/bin/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw/CMSSW_9_4_0/lib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/coral/CORAL_2_3_21-fmblme3/slc7_amd64_gcc630/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/coral/CORAL_2_3_21-fmblme3/slc7_amd64_gcc630/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/professor2/2.2.1-fmblme4/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/pyqt/4.11.4-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sherpa/2.2.4-fmblme2/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/rivet/2.5.4/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/python-ldap/2.4.10-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-matplotlib/1.5.2-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sip/4.17-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/llvm/4.0.1/lib64/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-sqlalchemy/1.1.4-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-lint/0.25.1-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-dxr/1.0-fmblme3/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-cx-oracle/5.2.1-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-numpy/1.12.1-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/frontier_client/2.8.20-fmblme/python/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/das_client/v03.01.00-fmblme/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/xrootd/4.6.1-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/yoda/1.6.7/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/lcg/root/6.10.08/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/pyminuit2/0.0.1-fmblme3/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-PyYAML/3.11-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-pygithub/1.23.0-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-pip/9.0.1-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-dablooms/0.9.1-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-pippkgs_depscipy/3.0-fmblme3/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-pippkgs/6.0-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/professor/1.4.0-fmblme3/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/dbs-client/DBS_2_1_9-fmblme/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/dbs-client/DBS_2_1_9-fmblme/lib/DBSAPI:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/cvs2git/5419-fmblme/lib == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: ROOTSYS=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/lcg/root/6.10.08/ == env: SRT_PYTHIA8DATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/pythia8/230/share/Pythia8/xmldoc == env: SRT_HERWIGPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/herwigpp/2.7.1-fmblme/share/Herwig++ == env: CXX=g++ == env: SRT_QTLIB_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/lib == env: SHERPA_LIBRARY_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sherpa/2.2.4-fmblme2/lib/SHERPA-MC == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: CMSSW_SEARCH_PATH=/disk/vc3-root/tmp/worker-230547-10203/t.229966/CMSSW_9_4_0_patch1/src:/disk/vc3-root/tmp/worker-230547-10203/t.229966/CMSSW_9_4_0_patch1/external/slc7_amd64_gcc630/data:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/external/slc7_amd64_gcc630/data == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: DISK=6000 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-10203/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-10203/cache/tmp/cvmfs == env: ROOT_TTREECACHE_PREFILL=0 == env: GENREFLEX=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/lcg/root/6.10.08/bin/genreflex == env: VINCIADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/vincia/2.2.01-fmblme/share/Vincia/xmldoc == env: SRT_G4LEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4EMLOW/6.48/data/G4EMLOW6.48 == env: SRT_GENREFLEX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/lcg/root/6.10.08/bin/genreflex == env: MALLOC_CONF=lg_chunk:18,lg_dirty_mult:4 == env: SRT_ROOT_TTREECACHE_SIZE_SCRAMRTDEL=0 == env: SRT_EVTGENDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/evtgen/1.6.0-fmblme2/share == env: GFAL_CONFIG_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/etc/gfal2.d/ == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=7800 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: SRT_CMSSW_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms == env: HEPPDT_PARAM_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/heppdt/3.03.00-fmblme2 == env: SRT_LD_LIBRARY_PATH_SCRAMRT=/disk/vc3-root/tmp/worker-230547-10203/t.229966/CMSSW_9_4_0_patch1/biglib/slc7_amd64_gcc630:/disk/vc3-root/tmp/worker-230547-10203/t.229966/CMSSW_9_4_0_patch1/lib/slc7_amd64_gcc630:/disk/vc3-root/tmp/worker-230547-10203/t.229966/CMSSW_9_4_0_patch1/external/slc7_amd64_gcc630/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/biglib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/lib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/external/slc7_amd64_gcc630/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw/CMSSW_9_4_0/biglib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw/CMSSW_9_4_0/lib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/llvm/4.0.1/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gcc/6.3.0/lib == env: TMP=/disk/vc3-root/tmp/worker-230547-10203/t.229966/cctools-temp-t.229966.CxOLfN == env: PYTHONPATH=/disk/vc3-root/tmp/worker-230547-10203/t.229966/CMSSW_9_4_0_patch1/python:/disk/vc3-root/tmp/worker-230547-10203/t.229966/CMSSW_9_4_0_patch1/lib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw-patch/CMSSW_9_4_0_patch1/lib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw/CMSSW_9_4_0/bin/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/cmssw/CMSSW_9_4_0/lib/slc7_amd64_gcc630:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/coral/CORAL_2_3_21-fmblme3/slc7_amd64_gcc630/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/coral/CORAL_2_3_21-fmblme3/slc7_amd64_gcc630/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/professor2/2.2.1-fmblme4/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/pyqt/4.11.4-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sherpa/2.2.4-fmblme2/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/rivet/2.5.4/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/python-ldap/2.4.10-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-matplotlib/1.5.2-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sip/4.17-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/llvm/4.0.1/lib64/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-sqlalchemy/1.1.4-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-lint/0.25.1-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-dxr/1.0-fmblme3/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-cx-oracle/5.2.1-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-numpy/1.12.1-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/frontier_client/2.8.20-fmblme/python/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/das_client/v03.01.00-fmblme/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/xrootd/4.6.1-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/yoda/1.6.7/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/lcg/root/6.10.08/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/pyminuit2/0.0.1-fmblme3/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-PyYAML/3.11-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-pygithub/1.23.0-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-pip/9.0.1-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-dablooms/0.9.1-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-pippkgs_depscipy/3.0-fmblme3/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/py2-pippkgs/6.0-fmblme/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/professor/1.4.0-fmblme3/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/dbs-client/DBS_2_1_9-fmblme/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/dbs-client/DBS_2_1_9-fmblme/lib/DBSAPI:/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/cvs2git/5419-fmblme/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib/python2.7/site-packages:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.40/el7-x86_64/usr/lib64/python2.7/site-packages:python:python: == env: QTLIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/qt/4.8.7/lib == env: SCONS_LIB_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/scons/1.2.0-fmblme/lib == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: FRONTIER_CLIENT=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/frontier_client/2.8.20-fmblme/ == env: SRT_G4NEUTRONXSDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4NEUTRONXS/1.4/data/G4NEUTRONXS1.4 == env: SRT_SHERPA_LIBRARY_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sherpa/2.2.4-fmblme2/lib/SHERPA-MC == env: VC3_ROOT_TAR=/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CLHEP_PARAM_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/clhep/2.3.4.2-fmblme == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-SsyGWt.wrapper == env: HERWIGPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/herwigpp/2.7.1-fmblme/share/Herwig++ == env: PYTHIA8DATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/pythia8/230/share/Pythia8/xmldoc == env: SRT_FRONTIER_CLIENT_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/frontier_client/2.8.20-fmblme/ == env: SRT_CSC_TRACK_FINDER_DATA_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/cms/CSCTrackFinderEmulation/1.2/data/ == env: SRT_ROOT_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/madgraph5amcatnlo/2.4.3-fmblme3 == env: CC=gcc == env: TEXMFHOME=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/rivet/2.5.4/share/Rivet/texmf == env: SRT_OPENBLAS_NUM_THREADS_SCRAMRTDEL=1 == env: SRT_GIT_TEMPLATE_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/git/2.13.0/share/git-core/templates == env: SRT_G4SAIDXSDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/geant4-G4SAIDDATA/1.1/data/G4SAIDDATA1.1 == env: CMSSW_VERSION=CMSSW_9_4_0_patch1 == env: SRT_LANG_SCRAMRTDEL=C == env: CCTOOLS_RESOURCE_MONITOR_INFO=1024 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=6 == env: PARROT_DEBUG_FLAGS= == env: SHERPA_SHARE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/sherpa/2.2.4-fmblme2/share/SHERPA-MC == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: CMS_OPENLOOPS_PREFIX=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/openloops/1.3.1-fmblme == env: GIT_EXEC_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/git/2.13.0/libexec/git-core == env: LOCALRT=/disk/vc3-root/tmp/worker-230547-10203/t.229966/CMSSW_9_4_0_patch1 == env: CMSSW_BASE=/disk/vc3-root/tmp/worker-230547-10203/t.229966/CMSSW_9_4_0_patch1 == env: SRT_VALGRIND_LIB_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/valgrind/3.12.0/lib/valgrind == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_ALL_postLHE.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=13948 == env: _=/bin/env === wrapper ready @ Mon Dec 2 05:10:43 EST 2019 ==== working directory before execution @ Mon Dec 2 05:10:44 EST 2019 ==== == dir: total 28292 == dir: drwxr-xr-x 17 kmohrman campus 201 Dec 2 05:10 CMSSW_9_4_0_patch1 == dir: -rw-r--r-- 2 kmohrman campus 28090622 Dec 2 03:25 HIG-RunIIFall17DRPremix-00823_1_cfg.py == dir: drwxr-xr-x 2 kmohrman campus 71 Dec 2 05:09 bin == dir: -rwxr-xr-x 5 kmohrman campus 627272 Dec 2 03:25 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 Dec 2 05:09 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 Dec 2 05:09 cctools-temp-t.229966.CxOLfN == dir: -rw------- 1 kmohrman campus 51 Dec 2 05:10 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 Dec 2 05:10 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 Dec 2 05:09 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 Dec 2 05:09 librmonitor_helper.so.NdPOsR == dir: -rw-r--r-- 2 kmohrman campus 2177 Dec 2 05:09 parameters.json == dir: -rw------- 2 kmohrman campus 9194 Dec 2 05:09 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 Dec 2 05:09 python == dir: -rw-r--r-- 5 kmohrman campus 570 Dec 2 03:25 report.json.in == dir: -rw-r--r-- 5 kmohrman campus 492 Dec 2 03:25 sandbox-CMSSW_9_4_0_patch1-slc7_amd64_gcc630.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 37 Dec 2 05:09 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 Dec 2 05:10 t_wrapper_ready == dir: -rw-r--r-- 1 kmohrman campus 11 Dec 2 05:10 t_wrapper_start == dir: -rwxr-xr-x 5 kmohrman campus 47217 Dec 2 03:25 task.py == dir: -rwxr-xr-x 5 kmohrman campus 6296 Dec 2 03:25 wrapper.sh >>> data is {u'files': {u'info': {}, u'output_info': {}, u'skipped': []}, u'cpu_time': 0, u'exe_exit_code': 0, u'events_written': 0, u'output_size': 0, u'task_exit_code': 0, u'output_storage_element': u'', u'cache': {u'start_size': 0, u'type': 2, u'end_size': 0}, u'stageout_exit_code': 0, u'output_bare_size': 0, u'transfers': defaultdict(, {}), u'task_timing': {u'wrapper_ready': 0, u'wrapper_start': 0, u'prologue_end': 0, u'epilogue_end': 0, u'stage_out_end': 0, u'stage_in_end': 0, u'processing_end': 0}, u'events_per_run': 0} @ Mon Dec 2 05:10:55 2019 >>> Trying hdfs client access method @ Mon Dec 2 05:10:55 2019 >>> executing 'timeout 300 hdfs dfs -fs hdfs://eddie.crc.nd.edu:19000 -get /store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/gs_step_ttHJet_HanV4ttXJetStartPtChecks_run0/HIG-RunIIFall17wmLHEGS-00040ND_211314.root HIG-RunIIFall17wmLHEGS-00040ND_211314.root' @ Mon Dec 2 05:10:55 2019 >> using /disk/vc3-root/tmp/worker-230547-10203/t.229966/cctools-temp-t.229966.CxOLfN/tmpjrQB6e to store command output >> cmd: timeout: failed to run command 'hdfs': No such file or directory >>>>> Unable to copy input with hdfs client @ Mon Dec 2 05:10:55 2019 >>> Trying xrootd access method @ Mon Dec 2 05:10:55 2019 >>> executing 'env XRD_LOGLEVEL=Debug timeout 300 xrdfs deepthought.crc.nd.edu stat /store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/gs_step_ttHJet_HanV4ttXJetStartPtChecks_run0/HIG-RunIIFall17wmLHEGS-00040ND_211314.root' @ Mon Dec 2 05:10:55 2019 >> using /disk/vc3-root/tmp/worker-230547-10203/t.229966/cctools-temp-t.229966.CxOLfN/tmpx5jG0C to store command output >> cmd: [2019-12-02 05:10:55.787950 -0500][Warning][Utility ] Unable to process global config file: [ERROR] OS Error: No such file or directory >> cmd: [2019-12-02 05:10:55.789054 -0500][Debug ][Utility ] Unable to process user config file: [ERROR] OS Error: No such file or directory >> cmd: [2019-12-02 05:10:55.789223 -0500][Debug ][PlugInMgr ] Initializing plug-in manager... >> cmd: [2019-12-02 05:10:55.789277 -0500][Debug ][PlugInMgr ] No default plug-in, loading plug-in configs... >> cmd: [2019-12-02 05:10:55.789325 -0500][Debug ][PlugInMgr ] Processing plug-in definitions in /etc/xrootd/client.plugins.d... >> cmd: [2019-12-02 05:10:55.789423 -0500][Debug ][PlugInMgr ] Unable to process directory /etc/xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2019-12-02 05:10:55.789767 -0500][Debug ][PlugInMgr ] Processing plug-in definitions in /tmp/runos_singularity_home-223585645045058466570743438164067556748/.xrootd/client.plugins.d... >> cmd: [2019-12-02 05:10:55.789873 -0500][Debug ][PlugInMgr ] Unable to process directory /tmp/runos_singularity_home-223585645045058466570743438164067556748/.xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2019-12-02 05:10:55.790062 -0500][Debug ][App ] Executing: stat /store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/gs_step_ttHJet_HanV4ttXJetStartPtChecks_run0/HIG-RunIIFall17wmLHEGS-00040ND_211314.root >> cmd: [2019-12-02 05:10:55.790161 -0500][Debug ][Poller ] Available pollers: built-in >> cmd: [2019-12-02 05:10:55.790207 -0500][Debug ][Poller ] Attempting to create a poller according to preference: built-in >> cmd: [2019-12-02 05:10:55.790250 -0500][Debug ][Poller ] Creating poller: built-in >> cmd: [2019-12-02 05:10:55.790299 -0500][Debug ][Poller ] Creating and starting the built-in poller... >> cmd: [2019-12-02 05:10:55.790646 -0500][Debug ][Poller ] Using 1 poller threads >> cmd: [2019-12-02 05:10:55.790709 -0500][Debug ][TaskMgr ] Starting the task manager... >> cmd: [2019-12-02 05:10:55.790849 -0500][Debug ][TaskMgr ] Task manager started >> cmd: [2019-12-02 05:10:55.790911 -0500][Debug ][JobMgr ] Starting the job manager... >> cmd: [2019-12-02 05:10:55.791216 -0500][Debug ][JobMgr ] Job manager started, 3 workers >> cmd: [2019-12-02 05:10:55.791275 -0500][Debug ][TaskMgr ] Registering task: "FileTimer task" to be run at: [2019-12-02 05:10:55 -0500] >> cmd: [2019-12-02 05:10:55.791351 -0500][Debug ][PostMaster ] Creating new channel to: deepthought.crc.nd.edu:1094 1 stream(s) >> cmd: [2019-12-02 05:10:55.791419 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Widnow: 1800 >> cmd: [2019-12-02 05:10:55.792802 -0500][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" to be run at: [2019-12-02 05:11:10 -0500] >> cmd: [2019-12-02 05:10:55.794113 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2019-12-02 05:10:55.794287 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2019-12-02 05:10:55.794412 -0500][Debug ][Poller ] Adding socket 0xb68780 to the poller >> cmd: [2019-12-02 05:10:55.794723 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2019-12-02 05:10:55.794846 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2019-12-02 05:10:55.795272 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Got the server hand shake response (type: manager [], protocol version 310) >> cmd: [2019-12-02 05:10:55.795447 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] kXR_protocol successful (type: manager [], protocol version 310) >> cmd: [2019-12-02 05:10:55.798253 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=d6cneh080.crc.nd.edu&xrd.rn=v4.6.1, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2019-12-02 05:10:55.798567 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Logged in, session: c6d5000077743600b8040000c7d50000 >> cmd: [2019-12-02 05:10:55.798644 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream 0 connected. >> cmd: [2019-12-02 05:10:55.798688 -0500][Debug ][Utility ] Monitor library name not set. No monitoring >> cmd: [2019-12-02 05:10:55.799239 -0500][Debug ][PostMaster ] Creating new channel to: primeradiant05.crc.nd.edu:1096 1 stream(s) >> cmd: [2019-12-02 05:10:55.799319 -0500][Debug ][PostMaster ] [primeradiant05.crc.nd.edu:1096 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Widnow: 1800 >> cmd: [2019-12-02 05:10:55.800781 -0500][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: primeradiant05.crc.nd.edu:1096" to be run at: [2019-12-02 05:11:10 -0500] >> cmd: [2019-12-02 05:10:55.801760 -0500][Debug ][PostMaster ] [primeradiant05.crc.nd.edu:1096] Found 1 address(es): [::ffff:149.165.243.13]:1096 >> cmd: [2019-12-02 05:10:55.801891 -0500][Debug ][AsyncSock ] [primeradiant05.crc.nd.edu:1096 #0.0] Attempting connection to [::ffff:149.165.243.13]:1096 >> cmd: [2019-12-02 05:10:55.801989 -0500][Debug ][Poller ] Adding socket 0x80016a0 to the poller >> cmd: [2019-12-02 05:10:55.802134 -0500][Debug ][AsyncSock ] [primeradiant05.crc.nd.edu:1096 #0.0] Async connection call returned >> cmd: [2019-12-02 05:10:55.802240 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2019-12-02 05:10:55.802603 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Got the server hand shake response (type: server [], protocol version 310) >> cmd: [2019-12-02 05:10:55.802775 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] kXR_protocol successful (type: server [], protocol version 310) >> cmd: [2019-12-02 05:10:55.805052 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=d6cneh080.crc.nd.edu&xrd.rn=v4.6.1, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2019-12-02 05:10:55.805403 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Logged in, session: a1010000b3140000ee020000a1010000 >> cmd: [2019-12-02 05:10:55.805455 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Authentication is required: &P=gsi,v:10300,c:ssl,ca:ba240aa8.0|f5f0dfc2.0 >> cmd: [2019-12-02 05:10:55.805506 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Sending authentication data >> cmd: [2019-12-02 05:10:55.814056 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Trying to authenticate using gsi >> cmd: [2019-12-02 05:10:55.912495 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Sending more authentication data for gsi >> cmd: [2019-12-02 05:10:55.921915 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Authenticated with gsi. >> cmd: [2019-12-02 05:10:55.922018 -0500][Debug ][PostMaster ] [primeradiant05.crc.nd.edu:1096 #0] Stream 0 connected. >> cmd: Path: /store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/gs_step_ttHJet_HanV4ttXJetStartPtChecks_run0/HIG-RunIIFall17wmLHEGS-00040ND_211314.root >> cmd: Id: 0 >> cmd: Size: 153349500 >> cmd: MTime: 2019-12-02 06:31:11 >> cmd: Flags: 24 (Offline|IsReadable) >> cmd: [2019-12-02 05:10:55.934496 -0500][Debug ][JobMgr ] Stopping the job manager... >> cmd: [2019-12-02 05:10:55.935204 -0500][Debug ][JobMgr ] Job manager stopped >> cmd: [2019-12-02 05:10:55.935278 -0500][Debug ][TaskMgr ] Stopping the task manager... >> cmd: [2019-12-02 05:10:55.935482 -0500][Debug ][TaskMgr ] Task manager stopped >> cmd: [2019-12-02 05:10:55.935545 -0500][Debug ][Poller ] Stopping the poller... >> cmd: [2019-12-02 05:10:55.935969 -0500][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" >> cmd: [2019-12-02 05:10:55.936043 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2019-12-02 05:10:55.936106 -0500][Debug ][Poller ] <[::ffff:10.32.74.128]:48980><--><[::ffff:129.74.85.55]:1094> Removing socket from the poller >> cmd: [2019-12-02 05:10:55.936224 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Destroying stream >> cmd: [2019-12-02 05:10:55.936285 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2019-12-02 05:10:55.936349 -0500][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: primeradiant05.crc.nd.edu:1096" >> cmd: [2019-12-02 05:10:55.936405 -0500][Debug ][AsyncSock ] [primeradiant05.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2019-12-02 05:10:55.936462 -0500][Debug ][Poller ] <[::ffff:10.32.74.128]:43382><--><[::ffff:149.165.243.13]:1096> Removing socket from the poller >> cmd: [2019-12-02 05:10:55.936558 -0500][Debug ][PostMaster ] [primeradiant05.crc.nd.edu:1096 #0] Destroying stream >> cmd: [2019-12-02 05:10:55.936618 -0500][Debug ][AsyncSock ] [primeradiant05.crc.nd.edu:1096 #0.0] Closing the socket >>> will stream using xrootd instead of copying @ Mon Dec 2 05:10:55 2019 >>> modified input files @ Mon Dec 2 05:10:55 2019 >> input: root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/gs_step_ttHJet_HanV4ttXJetStartPtChecks_run0/HIG-RunIIFall17wmLHEGS-00040ND_211314.root >>> updated parameters are @ Mon Dec 2 05:10:55 2019 >> json: { >> json: "accelerate stage-in": 3, >> json: "arguments": [], >> json: "cores": 6, >> json: "default ce": "T3_US_NotreDame", >> json: "default host": "earth.crc.nd.edu", >> json: "default se": "T3_US_NotreDame", >> json: "disable streaming": false, >> json: "epilogue": null, >> json: "executable": "cmsRun", >> json: "file map": { >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/gs_step_ttHJet_HanV4ttXJetStartPtChecks_run0/HIG-RunIIFall17wmLHEGS-00040ND_211314.root": "gs_step_ttHJet_HanV4ttXJetStartPtChecks_run0/HIG-RunIIFall17wmLHEGS-00040ND_211314.root" >> json: }, >> json: "gridpack": false, >> json: "input": [ >> json: "hdfs://eddie.crc.nd.edu:19000/store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2", >> json: "file:///hadoop/store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/" >> json: ], >> json: "mask": { >> json: "events": -1, >> json: "files": [ >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/gs_step_ttHJet_HanV4ttXJetStartPtChecks_run0/HIG-RunIIFall17wmLHEGS-00040ND_211314.root" >> json: ], >> json: "lumis": { >> json: "1": [ >> json: [ >> json: 23325, >> json: 23325 >> json: ] >> json: ] >> json: } >> json: }, >> json: "monitoring": { >> json: "monitorid": "229966_https://T3_US_NotreDame/b57c393b38534cb7/229966", >> json: "syncid": "https://T3_US_NotreDame//lobster_kmohrman_EFT_ALL_postLHE_20191128_2250_7cd7078cb9164972//12345.229966", >> json: "taskid": "lobster_kmohrman_EFT_ALL_postLHE_20191128_2250_7cd7078cb9164972" >> json: }, >> json: "output": [ >> json: "hdfs://eddie.crc.nd.edu:19000/store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2", >> json: "file:///hadoop/store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/" >> json: ], >> json: "output files": [ >> json: [ >> json: "HIG-RunIIFall17DRPremix-00823ND_step1.root", >> json: "digi_step_ttHJet_HanV4ttXJetStartPtChecks_run0/HIG-RunIIFall17DRPremix-00823ND_step1_229966.root" >> json: ] >> json: ], >> json: "prologue": null, >> json: "pset": "HIG-RunIIFall17DRPremix-00823_1_cfg.py", >> json: "want summary": true >> json: } >>> using sync CE T3_US_NotreDame @ Mon Dec 2 05:10:55 2019 >>> config file fragment @ Mon Dec 2 05:10:56 2019 >> pset: >> pset: import FWCore.ParameterSet.Config as cms >> pset: process.Timing = cms.Service("Timing", >> pset: useJobReport = cms.untracked.bool(True), >> pset: summaryOnly = cms.untracked.bool(True)) >> pset: >> pset: process.maxEvents = cms.untracked.PSet(input = cms.untracked.int32(-1)) >> pset: >> pset: import os >> pset: _, major, minor, _ = os.environ["CMSSW_VERSION"].split('_', 3) >> pset: if int(major) >= 7 and int(minor) >= 4: >> pset: xrdstats = cms.Service("XrdAdaptor::XrdStatisticsService", cms.untracked.PSet(reportToFJR = cms.untracked.bool(True))) >> pset: process.add_(xrdstats) >> pset: >> pset: for prod in process.producers.values(): >> pset: if prod.hasParameter('nEvents') and prod.type_() == 'ExternalLHEProducer': >> pset: prod.nEvents = cms.untracked.uint32(-1) >> pset: >> pset: process.source.fileNames = cms.untracked.vstring(['root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/gs_step_ttHJet_HanV4ttXJetStartPtChecks_run0/HIG-RunIIFall17wmLHEGS-00040ND_211314.root']) >> pset: process.source.lumisToProcess = cms.untracked.VLuminosityBlockRange(['1:23325']) >> pset: if hasattr(process, 'options'): >> pset: process.options.wantSummary = cms.untracked.bool(True) >> pset: else: >> pset: process.options = cms.untracked.PSet(wantSummary = cms.untracked.bool(True)) >> pset: >> pset: if hasattr(process, 'options'): >> pset: process.options.numberOfThreads = cms.untracked.uint32(6) >> pset: process.options.numberOfStreams = cms.untracked.uint32(0) >> pset: else: >> pset: process.options = cms.untracked.PSet( >> pset: numberOfThreads = cms.untracked.uint32(6), >> pset: numberOfStreams = cms.untracked.uint32(0) >> pset: ) >>> executing 'cmsRun -j report.xml HIG-RunIIFall17DRPremix-00823_1_cfg_mod.py' @ Mon Dec 2 05:10:56 2019 >> using /disk/vc3-root/tmp/worker-230547-10203/t.229966/cctools-temp-t.229966.CxOLfN/tmpbIdKv0 to store command output 2019/12/02 05:23:28.99 parrot_run[22783] notice: warning: system call 101 (ptrace) not supported for program /cvmfs/cms.cern.ch/slc7_amd64_gcc630/external/gdb/7.12.1/bin/gdb >> cmd: >> cmd: !!!!! WARNING: The BMTF Packer returns the entire detector information in one fed (# 1376), instead of the real BMTF which owns 2 feds (1376, 1377) !!!!! >> cmd: >> cmd: %MSG-i ThreadStreamSetup: (NoModuleName) 02-Dec-2019 05:11:24 EST pre-events >> cmd: setting # threads 6 >> cmd: setting # streams 6 >> cmd: %MSG >> cmd: 02-Dec-2019 05:11:34 EST Initiating request to open file root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/gs_step_ttHJet_HanV4ttXJetStartPtChecks_run0/HIG-RunIIFall17wmLHEGS-00040ND_211314.root >> cmd: 02-Dec-2019 05:11:39 EST Successfully opened file root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/gs_step_ttHJet_HanV4ttXJetStartPtChecks_run0/HIG-RunIIFall17wmLHEGS-00040ND_211314.root >> cmd: 02-Dec-2019 05:11:49 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/80010/7C19C80D-5A0F-E811-A6F9-0242AC130002.root >> cmd: 02-Dec-2019 05:11:51 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/80010/7C19C80D-5A0F-E811-A6F9-0242AC130002.root >> cmd: 02-Dec-2019 05:12:01 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/00046/7C4F3CBA-DC12-E811-BBEC-0CC47A4D763C.root >> cmd: 02-Dec-2019 05:12:10 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/00046/7C4F3CBA-DC12-E811-BBEC-0CC47A4D763C.root >> cmd: 02-Dec-2019 05:12:21 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/40038/981B674A-3111-E811-A262-0CC47A78A418.root >> cmd: 02-Dec-2019 05:12:30 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/40038/981B674A-3111-E811-A262-0CC47A78A418.root >> cmd: 02-Dec-2019 05:12:39 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/20005/188A65F2-8310-E811-87CB-0025905B8576.root >> cmd: 02-Dec-2019 05:12:42 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/20005/188A65F2-8310-E811-87CB-0025905B8576.root >> cmd: 02-Dec-2019 05:12:55 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/40002/BA5FB626-770C-E811-BA68-0CC47A78A340.root >> cmd: 02-Dec-2019 05:13:03 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/40002/BA5FB626-770C-E811-BA68-0CC47A78A340.root >> cmd: 02-Dec-2019 05:13:14 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/40031/8C9A8CE0-3010-E811-B8F9-0242AC130002.root >> cmd: 02-Dec-2019 05:13:16 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/40031/8C9A8CE0-3010-E811-B8F9-0242AC130002.root >> cmd: Begin processing the 1st record. Run 1, Event 12, LumiSection 23325 at 02-Dec-2019 05:14:49.412 EST >> cmd: Begin processing the 2nd record. Run 1, Event 8, LumiSection 23325 at 02-Dec-2019 05:14:49.416 EST >> cmd: Begin processing the 3rd record. Run 1, Event 17, LumiSection 23325 at 02-Dec-2019 05:14:49.420 EST >> cmd: Begin processing the 4th record. Run 1, Event 11, LumiSection 23325 at 02-Dec-2019 05:14:49.424 EST >> cmd: Begin processing the 5th record. Run 1, Event 2, LumiSection 23325 at 02-Dec-2019 05:14:49.429 EST >> cmd: Begin processing the 6th record. Run 1, Event 26, LumiSection 23325 at 02-Dec-2019 05:14:49.433 EST >> cmd: 02-Dec-2019 05:14:53 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/40038/981B674A-3111-E811-A262-0CC47A78A418.root >> cmd: 02-Dec-2019 05:14:53 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/00011/46A310F8-FB0E-E811-8105-0CC47A4D762A.root >> cmd: 02-Dec-2019 05:14:53 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/80010/7C19C80D-5A0F-E811-A6F9-0242AC130002.root >> cmd: 02-Dec-2019 05:14:53 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/20021/7474FF88-8010-E811-9B10-0025905B85B2.root >> cmd: 02-Dec-2019 05:14:53 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/40002/BA5FB626-770C-E811-BA68-0CC47A78A340.root >> cmd: 02-Dec-2019 05:15:00 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/00011/46A310F8-FB0E-E811-8105-0CC47A4D762A.root >> cmd: 02-Dec-2019 05:15:00 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/00021/6C536C24-6A10-E811-BAC5-7CD30ACE188E.root >> cmd: 02-Dec-2019 05:15:07 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/20021/7474FF88-8010-E811-9B10-0025905B85B2.root >> cmd: 02-Dec-2019 05:15:07 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/00046/7C4F3CBA-DC12-E811-BBEC-0CC47A4D763C.root >> cmd: 02-Dec-2019 05:15:07 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/40031/8C9A8CE0-3010-E811-B8F9-0242AC130002.root >> cmd: 02-Dec-2019 05:15:07 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/00029/CA321CF2-0311-E811-B6D4-0CC47A7C3432.root >> cmd: 02-Dec-2019 05:15:07 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/20005/188A65F2-8310-E811-87CB-0025905B8576.root >> cmd: 02-Dec-2019 05:15:07 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/00007/8C1A6575-CE0C-E811-BCFF-0CC47A4D76CC.root >> cmd: 02-Dec-2019 05:15:07 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/40039/80DFA729-C312-E811-9AE6-0242AC130002.root >> cmd: 02-Dec-2019 05:15:09 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/00021/6C536C24-6A10-E811-BAC5-7CD30ACE188E.root >> cmd: 02-Dec-2019 05:15:16 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/00029/CA321CF2-0311-E811-B6D4-0CC47A7C3432.root >> cmd: 02-Dec-2019 05:15:23 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/40039/80DFA729-C312-E811-9AE6-0242AC130002.root >> cmd: 02-Dec-2019 05:15:30 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer17PrePremix/Neutrino_E-10_gun/GEN-SIM-DIGI-RAW/MCv2_correctPU_94X_mc2017_realistic_v9-v1/00007/8C1A6575-CE0C-E811-BCFF-0CC47A4D76CC.root >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:11 EST Run: 1 Event: 17 >> cmd: local error not pos-def >> cmd: [ -3310.38 280.551 -9.89752-0.000493207 1.56813e-05 >> cmd: 280.551 -23.7763 0.838803 4.1863e-05-1.32937e-06 >> cmd: -9.89752 0.838803 -0.029592-1.47431e-06 1.13322e-07 >> cmd: -0.000493207 4.1863e-05-1.47431e-06 2.02669e-06 4.39199e-12 >> cmd: 1.56813e-05-1.32937e-06 1.13322e-07 4.39199e-12 2.095e-06 ] >> cmd: pos/mom/mf (-14.7397,2.63049,-39.2029) (-47.3185,8.36763,-131.804) (0.00129522,-0.00023115,3.80793) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:11 EST Run: 1 Event: 17 >> cmd: curv error not pos-def >> cmd: [ -3310.38 0.419899 675.913-0.000460485-2.46305e-06 >> cmd: 0.419899-5.32515e-05 -0.0857348 6.4977e-08 5.30988e-08 >> cmd: 675.913 -0.0857348 -138.008 9.41681e-05 5.20526e-07 >> cmd: -0.000460485 6.4977e-08 9.41681e-05 1.78984e-06 2.25854e-07 >> cmd: -2.46305e-06 5.30988e-08 5.20526e-07 2.25854e-07 1.88281e-06 ] >> cmd: pos/mom/mf (-14.7397,2.63049,-39.2029) (-47.3185,8.36763,-131.804) (0.00129522,-0.00023115,3.80793) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:11 EST Run: 1 Event: 17 >> cmd: curv error not pos-def >> cmd: [ -3310.38 0.423207 2227.01 20424.7 -8.9236 >> cmd: 0.423207-5.40941e-05 -0.284706 -2.61115 0.00114127 >> cmd: 2227.01 -0.284706 -1498.18 -13740.4 6.00321 >> cmd: 20424.7 -2.61115 -13740.4 -126019 55.0578 >> cmd: -8.9236 0.00114127 6.00321 55.0578 -0.0240323 ] >> cmd: pos/mom/mf (-28.5924,5.10399,-77.8008) (-47.2904,8.52528,-131.804) (0.00471044,-0.000840854,3.7989) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:11 EST Run: 1 Event: 17 >> cmd: local error not pos-def >> cmd: [ -3310.38 -799.533 142.905 20109.9 -3572.45 >> cmd: -799.533 -193.106 34.5149 4857 -862.829 >> cmd: 142.905 34.5149 -6.16906 -868.12 154.218 >> cmd: 20109.9 4857 -868.12 -122163 21701.9 >> cmd: -3572.45 -862.829 154.218 21701.9 -3855.26 ] >> cmd: pos/mom/mf (-28.5924,5.10399,-77.8008) (-47.2904,8.52528,-131.804) (0.00471044,-0.000840854,3.7989) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:11 EST Run: 1 Event: 17 >> cmd: local error not pos-def >> cmd: [ -3310.38 -799.533 142.905 20109.9 -3572.45 >> cmd: -799.533 -193.106 34.5149 4857 -862.829 >> cmd: 142.905 34.5149 -6.16906 -868.12 154.218 >> cmd: 20109.9 4857 -868.12 -122163 21701.9 >> cmd: -3572.45 -862.829 154.218 21701.9 -3855.26 ] >> cmd: pos/mom/mf (-28.5924,5.10399,-77.8008) (-47.2864,8.52456,-131.793) (0.00471044,-0.000840854,3.7989) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:11 EST Run: 1 Event: 17 >> cmd: curv error not pos-def >> cmd: [ -3310.38 0.423204 2227.01 20424.7 -8.92369 >> cmd: 0.423204-5.40918e-05 -0.284704 -2.61113 0.00114127 >> cmd: 2227.01 -0.284704 -1498.18 -13740.4 6.00327 >> cmd: 20424.7 -2.61113 -13740.4 -126019 55.0583 >> cmd: -8.92369 0.00114127 6.00327 55.0583 -0.0240328 ] >> cmd: pos/mom/mf (-28.5924,5.10399,-77.8008) (-47.2864,8.52456,-131.793) (0.00471044,-0.000840854,3.7989) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:11 EST Run: 1 Event: 17 >> cmd: curv error not pos-def >> cmd: [ -3310.38 0.430676 2848.4 34800.9 -36.1619 >> cmd: 0.430676-5.60192e-05 -0.370573 -4.52755 0.00470525 >> cmd: 2848.4 -0.370573 -2450.89 -29944.2 31.1153 >> cmd: 34800.9 -4.52755 -29944.2 -365850 380.157 >> cmd: -36.1619 0.00470525 31.1153 380.157 -0.394984 ] >> cmd: pos/mom/mf (-34.1669,6.11278,-93.3395) (-47.275,8.58774,-131.793) (0.0066612,-0.00119175,3.79367) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:11 EST Run: 1 Event: 17 >> cmd: local error not pos-def >> cmd: [ -3310.38 -1034.79 81.9283 -34688 2801.38 >> cmd: -1034.79 -323.462 25.6098 -10843.1 875.679 >> cmd: 81.9283 25.6098 -2.02763 858.49 -69.3311 >> cmd: -34688 -10843.1 858.49 -363480 29354.4 >> cmd: 2801.38 875.679 -69.3311 29354.4 -2370.64 ] >> cmd: pos/mom/mf (-34.1669,6.11278,-93.3395) (-47.275,8.58774,-131.793) (0.0066612,-0.00119175,3.79367) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:11 EST Run: 1 Event: 17 >> cmd: local error not pos-def >> cmd: [ -3310.38 -1034.79 81.9283 -34688 2801.38 >> cmd: -1034.79 -323.462 25.6098 -10843.1 875.679 >> cmd: 81.9283 25.6098 -2.02763 858.49 -69.3311 >> cmd: -34688 -10843.1 858.49 -363480 29354.4 >> cmd: 2801.38 875.679 -69.3311 29354.4 -2370.64 ] >> cmd: pos/mom/mf (-34.1669,6.11278,-93.3395) (-47.2731,8.5874,-131.788) (0.0066612,-0.00119175,3.79367) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:11 EST Run: 1 Event: 17 >> cmd: curv error not pos-def >> cmd: [ -3310.38 0.430676 2848.4 34800.9 -36.1619 >> cmd: 0.430676-5.60187e-05 -0.370573 -4.52755 0.00470525 >> cmd: 2848.4 -0.370573 -2450.89 -29944.2 31.1153 >> cmd: 34800.9 -4.52755 -29944.2 -365850 380.157 >> cmd: -36.1619 0.00470525 31.1153 380.157 -0.394984 ] >> cmd: pos/mom/mf (-34.1669,6.11278,-93.3395) (-47.2731,8.5874,-131.788) (0.0066612,-0.00119175,3.79367) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:11 EST Run: 1 Event: 17 >> cmd: curv error not pos-def >> cmd: [ -3310.38 0.44491 3504.69 53860.3 -86.8222 >> cmd: 0.44491-5.97834e-05 -0.471024 -7.23874 0.0116696 >> cmd: 3504.69 -0.471024 -3710.4 -57021.7 91.9183 >> cmd: 53860.3 -7.23874 -57021.7 -876314 1412.61 >> cmd: -86.8222 0.0116696 91.9183 1412.61 -2.27704 ] >> cmd: pos/mom/mf (-40.0696,7.18934,-109.797) (-47.2609,8.65409,-131.788) (0.00909248,-0.00163138,3.78715) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:11 EST Run: 1 Event: 17 >> cmd: local error not pos-def >> cmd: [ -3310.38 -1273.59 102.689 -53676.9 4441.97 >> cmd: -1273.59 -489.985 39.5072 -20650.9 1708.94 >> cmd: 102.689 39.5072 -3.18544 1665.07 -137.791 >> cmd: -53676.9 -20650.9 1665.07 -870356 72025.2 >> cmd: 4441.97 1708.94 -137.791 72025.2 -5960.36 ] >> cmd: pos/mom/mf (-40.0696,7.18934,-109.797) (-47.2609,8.65409,-131.788) (0.00909248,-0.00163138,3.78715) >> cmd: %MSG >> cmd: %MSG-w Muon: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIHit 02-Dec-2019 05:16:12 EST Run: 1 Event: 12 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w RecoMuon: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIHit 02-Dec-2019 05:16:12 EST Run: 1 Event: 12 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w GlobalMuon: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIHit 02-Dec-2019 05:16:12 EST Run: 1 Event: 12 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w GlobalTrajectoryBuilderBase: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIHit 02-Dec-2019 05:16:12 EST Run: 1 Event: 12 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: Begin processing the 7th record. Run 1, Event 28, LumiSection 23325 at 02-Dec-2019 05:16:14.095 EST >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:15 EST Run: 1 Event: 26 >> cmd: local error not pos-def >> cmd: [ -159923 -15768.2 51.3672 -0.00630269 0.000226432 >> cmd: -15768.2 -1554.73 5.06476-0.000621629 2.23247e-05 >> cmd: 51.3672 5.06476 -0.0164988 2.02279e-06-7.86083e-07 >> cmd: -0.00630269-0.000621629 2.02279e-06 1.51247e-06 1.72532e-11 >> cmd: 0.000226432 2.23247e-05-7.86083e-07 1.72532e-11 5.67715e-06 ] >> cmd: pos/mom/mf (3.7886,-10.0147,19.8889) (6.26378,-16.7759,34.4633) (0.000151059,-0.000399305,3.81063) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:15 EST Run: 1 Event: 26 >> cmd: curv error not pos-def >> cmd: [ -159923 -2.85108 15769.1 -0.00630267 -9.2469e-05 >> cmd: -2.85108-5.08101e-05 0.281129-1.12876e-07 6.82871e-08 >> cmd: 15769.1 0.281129 -1554.9 0.000621661 9.11757e-06 >> cmd: -0.00630267-1.12876e-07 0.000621661 1.51246e-06-2.85433e-09 >> cmd: -9.2469e-05 6.82871e-08 9.11757e-06-2.85433e-09 1.20704e-06 ] >> cmd: pos/mom/mf (3.7886,-10.0147,19.8889) (6.26378,-16.7759,34.4633) (0.000151059,-0.000399305,3.81063) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:15 EST Run: 1 Event: 26 >> cmd: curv error not pos-def >> cmd: [ -159923 -3.049 82069.7 818719 2888.66 >> cmd: -3.049 -5.8112e-05 1.5647 15.6093 0.0550745 >> cmd: 82069.7 1.5647 -42116.8 -420153 -1482.42 >> cmd: 818719 15.6093 -420153 -4.1914e+06 -14788.4 >> cmd: 2888.66 0.0550745 -1482.42 -14788.4 -52.1776 ] >> cmd: pos/mom/mf (9.55905,-25.7245,52.0986) (6.08453,-16.8417,34.4633) (0.00102027,-0.00274567,3.80666) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:15 EST Run: 1 Event: 26 >> cmd: local error not pos-def >> cmd: [ -159923 -86698.2 38806.9 -842646 370796 >> cmd: -86698.2 -47001.3 21038.2 -456820 201018 >> cmd: 38806.9 21038.2 -9416.9 204477 -89977.4 >> cmd: -842646 -456820 204477-4.43998e+06 1.95375e+06 >> cmd: 370796 201018 -89977.4 1.95375e+06 -859724 ] >> cmd: pos/mom/mf (9.55905,-25.7245,52.0986) (6.08453,-16.8417,34.4633) (0.00102027,-0.00274567,3.80666) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:15 EST Run: 1 Event: 26 >> cmd: local error not pos-def >> cmd: [ -159923 -86698.2 38806.9 -842646 370796 >> cmd: -86698.2 -47001.3 21038.2 -456820 201018 >> cmd: 38806.9 21038.2 -9416.9 204477 -89977.4 >> cmd: -842646 -456820 204477-4.43998e+06 1.95375e+06 >> cmd: 370796 201018 -89977.4 1.95375e+06 -859724 ] >> cmd: pos/mom/mf (9.55905,-25.7245,52.0986) (6.08282,-16.837,34.4536) (0.00102027,-0.00274567,3.80666) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:15 EST Run: 1 Event: 26 >> cmd: curv error not pos-def >> cmd: [ -159923 -3.04836 82069.7 818719 2888.68 >> cmd: -3.04836-5.80694e-05 1.56437 15.606 0.0550632 >> cmd: 82069.7 1.56437 -42116.8 -420153 -1482.42 >> cmd: 818719 15.606 -420153 -4.1914e+06 -14788.5 >> cmd: 2888.68 0.0550632 -1482.42 -14788.5 -52.1781 ] >> cmd: pos/mom/mf (9.55905,-25.7245,52.0986) (6.08282,-16.837,34.4536) (0.00102027,-0.00274567,3.80666) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:15 EST Run: 1 Event: 26 >> cmd: curv error not pos-def >> cmd: [ -159923 -5.81059 154397 2.98234e+06 21170.7 >> cmd: -5.81059-0.000211084 5.60984 108.359 0.769214 >> cmd: 154397 5.60984 -149063 -2.8793e+06 -20439.3 >> cmd: 2.98234e+06 108.359 -2.8793e+06-5.56165e+07 -394805 >> cmd: 21170.7 0.769214 -20439.3 -394805 -2802.6 ] >> cmd: pos/mom/mf (15.6769,-42.9719,87.3187) (5.88672,-16.9066,34.4536) (0.00275872,-0.00756189,3.7981) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:15 EST Run: 1 Event: 26 >> cmd: local error not pos-def >> cmd: [ -159923 -80209.6 1665.73 2.98119e+06 -86048.8 >> cmd: -80209.6 -40229.4 835.453 1.49522e+06 -43158 >> cmd: 1665.73 835.453 -17.3501 -31051.7 896.273 >> cmd: 2.98119e+06 1.49522e+06 -31051.7-5.55737e+07 1.60407e+06 >> cmd: -86048.8 -43158 896.273 1.60407e+06 -46299.8 ] >> cmd: pos/mom/mf (15.6769,-42.9719,87.3187) (5.88672,-16.9066,34.4536) (0.00275872,-0.00756189,3.7981) >> cmd: %MSG >> cmd: %MSG-w InvalidInputTag: CSCHaloDataProducer:hltCSCHaloData 02-Dec-2019 05:16:17 EST Run: 1 Event: 28 >> cmd: The Cosmic Muon collection does not appear to be in the event. These beam halo identification variables will be empty >> cmd: %MSG >> cmd: Begin processing the 8th record. Run 1, Event 27, LumiSection 23325 at 02-Dec-2019 05:16:17.372 EST >> cmd: Begin processing the 9th record. Run 1, Event 20, LumiSection 23325 at 02-Dec-2019 05:16:17.972 EST >> cmd: Begin processing the 10th record. Run 1, Event 30, LumiSection 23325 at 02-Dec-2019 05:16:19.111 EST >> cmd: Begin processing the 11th record. Run 1, Event 18, LumiSection 23325 at 02-Dec-2019 05:16:20.524 EST >> cmd: Begin processing the 12th record. Run 1, Event 34, LumiSection 23325 at 02-Dec-2019 05:16:21.112 EST >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: %MSG-w EnergyInDeadEB_FE: EcalRecHitProducer:hltEcalRecHit 02-Dec-2019 05:16:25 EST Run: 1 Event: 18 >> cmd: TP energy in the dead TT = 61.5 at (EcalTT subDet Barrel iz + ieta 17 iphi 32) >> cmd: %MSG >> cmd: Begin processing the 13th record. Run 1, Event 36, LumiSection 23325 at 02-Dec-2019 05:16:27.841 EST >> cmd: Begin processing the 14th record. Run 1, Event 35, LumiSection 23325 at 02-Dec-2019 05:16:29.560 EST >> cmd: %MSG-w InvalidHelix: SeedCreatorFromRegionConsecutiveHitsEDProducer:hltFullIter9TobTecSeedsTripl 02-Dec-2019 05:16:29 EST Run: 1 Event: 26 >> cmd: PixelClusterShapeSeedComparitor helix is not valid, result is bad >> cmd: %MSG >> cmd: Begin processing the 15th record. Run 1, Event 40, LumiSection 23325 at 02-Dec-2019 05:16:30.159 EST >> cmd: Begin processing the 16th record. Run 1, Event 42, LumiSection 23325 at 02-Dec-2019 05:16:31.732 EST >> cmd: Begin processing the 17th record. Run 1, Event 49, LumiSection 23325 at 02-Dec-2019 05:16:34.811 EST >> cmd: %MSG-w BasicTrajectoryState: GsfTrackProducer:hltEgammaGsfTracks 02-Dec-2019 05:16:37 EST Run: 1 Event: 40 >> cmd: curv error not pos-def >> cmd: [ 5.45352e+07 -549.178-1.67645e+06 -164.825 -67.935 >> cmd: -549.178 0.006124 16.8821 0.00173526 0.00387849 >> cmd: -1.67645e+06 16.8821 51535.3 5.06622 2.08848 >> cmd: -164.825 0.00173526 5.06622 -0.00187926 0.000608158 >> cmd: -67.935 0.00387849 2.08848 0.000608158 0.0172737 ] >> cmd: pos/mom/mf (5.43555,-4.35605,-4.72252) (9.01479,-7.25718,-11.0324) (-7.91555e-05,6.34353e-05,3.81117) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: GsfTrackProducer:hltEgammaGsfTracks 02-Dec-2019 05:16:37 EST Run: 1 Event: 40 >> cmd: local error not pos-def >> cmd: [ 5.45352e+07 1.69038e+06 -145902 165.516 79.4611 >> cmd: 1.69038e+06 52394.9 -4522.39 5.12972 2.46317 >> cmd: -145902 -4522.39 390.345 -0.442618 -0.20416 >> cmd: 165.516 5.12972 -0.442618 -0.00189498 0.00100906 >> cmd: 79.4611 2.46317 -0.20416 0.00100906 0.0328052 ] >> cmd: pos/mom/mf (5.43555,-4.35605,-4.72252) (9.01479,-7.25718,-11.0324) (-7.91555e-05,6.34353e-05,3.81117) >> cmd: %MSG >> cmd: %MSG-e PosteriorWeightsCalculator: GsfTrackProducer:hltEgammaGsfTracks 02-Dec-2019 05:16:37 EST Run: 1 Event: 40 >> cmd: PosteriorWeightsCalculator: sumWeight < DBL_MIN >> cmd: %MSG >> cmd: %MSG-e GsfMultiStateUpdator: GsfTrackProducer:hltEgammaGsfTracks 02-Dec-2019 05:16:37 EST Run: 1 Event: 40 >> cmd: no weights could be retreived. invalid updated state !. >> cmd: %MSG >> cmd: %MSG-e InvalidState: GsfTrackProducer:hltEgammaGsfTracks 02-Dec-2019 05:16:37 EST Run: 1 Event: 40 >> cmd: inside hit >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: GsfTrackProducer:hltEgammaGsfTracks 02-Dec-2019 05:16:37 EST Run: 1 Event: 40 >> cmd: curv error not pos-def >> cmd: [ 5.45352e+07 -549.178-1.67645e+06 -164.825 -67.935 >> cmd: -549.178 0.006124 16.8821 0.00173526 0.00387849 >> cmd: -1.67645e+06 16.8821 51535.3 5.06622 2.08848 >> cmd: -164.825 0.00173526 5.06622 -0.00187926 0.000608158 >> cmd: -67.935 0.00387849 2.08848 0.000608158 0.0172737 ] >> cmd: pos/mom/mf (5.43555,-4.35605,-4.72252) (9.01479,-7.25718,-11.0324) (-7.91555e-05,6.34353e-05,3.81117) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: GsfTrackProducer:hltEgammaGsfTracks 02-Dec-2019 05:16:37 EST Run: 1 Event: 40 >> cmd: local error not pos-def >> cmd: [ 5.45352e+07 1.69038e+06 -145902 165.516 79.4611 >> cmd: 1.69038e+06 52394.9 -4522.39 5.12972 2.46317 >> cmd: -145902 -4522.39 390.345 -0.442618 -0.20416 >> cmd: 165.516 5.12972 -0.442618 -0.00189498 0.00100906 >> cmd: 79.4611 2.46317 -0.20416 0.00100906 0.0328052 ] >> cmd: pos/mom/mf (5.43555,-4.35605,-4.72252) (9.01479,-7.25718,-11.0324) (-7.91555e-05,6.34353e-05,3.81117) >> cmd: %MSG >> cmd: %MSG-e PosteriorWeightsCalculator: GsfTrackProducer:hltEgammaGsfTracks 02-Dec-2019 05:16:37 EST Run: 1 Event: 40 >> cmd: PosteriorWeightsCalculator: sumWeight < DBL_MIN >> cmd: %MSG >> cmd: %MSG-e GsfMultiStateUpdator: GsfTrackProducer:hltEgammaGsfTracks 02-Dec-2019 05:16:37 EST Run: 1 Event: 40 >> cmd: no weights could be retreived. invalid updated state !. >> cmd: %MSG >> cmd: %MSG-e InvalidState: GsfTrackProducer:hltEgammaGsfTracks 02-Dec-2019 05:16:37 EST Run: 1 Event: 40 >> cmd: inside hit >> cmd: %MSG >> cmd: Begin processing the 18th record. Run 1, Event 46, LumiSection 23325 at 02-Dec-2019 05:16:38.625 EST >> cmd: %MSG-w InvalidHelix: SeedCreatorFromRegionConsecutiveHitsTripletOnlyEDProducer:hltFullIter8PixelLessSeeds 02-Dec-2019 05:16:42 EST Run: 1 Event: 18 >> cmd: PixelClusterShapeSeedComparitor helix is not valid, result is bad >> cmd: %MSG >> cmd: %MSG-w InvalidHelix: SeedCreatorFromRegionConsecutiveHitsEDProducer:hltFullIter9TobTecSeedsPair 02-Dec-2019 05:16:42 EST Run: 1 Event: 35 >> cmd: PixelClusterShapeSeedComparitor helix is not valid, result is bad >> cmd: %MSG >> cmd: Begin processing the 19th record. Run 1, Event 51, LumiSection 23325 at 02-Dec-2019 05:16:42.975 EST >> cmd: Begin processing the 20th record. Run 1, Event 53, LumiSection 23325 at 02-Dec-2019 05:16:46.337 EST >> cmd: Begin processing the 21st record. Run 1, Event 58, LumiSection 23325 at 02-Dec-2019 05:16:46.627 EST >> cmd: Begin processing the 22nd record. Run 1, Event 54, LumiSection 23325 at 02-Dec-2019 05:16:49.566 EST >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:50 EST Run: 1 Event: 58 >> cmd: local error not pos-def >> cmd: [ -1.18322e+06 -120254 7790.46 -0.00230202 0.000539614 >> cmd: -120254 -12221.7 791.764-0.000234024 5.48427e-05 >> cmd: 7790.46 791.764 -51.2932 1.5157e-05-3.96644e-06 >> cmd: -0.00230202-0.000234024 1.5157e-05 5.14584e-07-1.51319e-12 >> cmd: 0.000539614 5.48427e-05-3.96644e-06-1.51319e-12 3.2942e-06 ] >> cmd: pos/mom/mf (-3.41979,10.1518,-20.7107) (-8.71441,26.0925,-54.8218) (0.000168532,-0.000500296,3.81026) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:50 EST Run: 1 Event: 58 >> cmd: curv error not pos-def >> cmd: [ -1.18322e+06 -3.40115 120130 -0.00230079-0.000174991 >> cmd: -3.40115-9.75745e-06 0.345313-7.39554e-09 3.68107e-08 >> cmd: 120130 0.345313 -12196.6 0.00023366 1.77645e-05 >> cmd: -0.00230079-7.39554e-09 0.00023366 5.14038e-07-1.49885e-08 >> cmd: -0.000174991 3.68107e-08 1.77645e-05-1.49885e-08 6.63108e-07 ] >> cmd: pos/mom/mf (-3.41979,10.1518,-20.7107) (-8.71441,26.0925,-54.8218) (0.000168532,-0.000500296,3.81026) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:50 EST Run: 1 Event: 58 >> cmd: curv error not pos-def >> cmd: [ -1.18322e+06 -3.25816 260362 885523 -705.076 >> cmd: -3.25816-8.95265e-06 0.716941 2.4384 -0.00194128 >> cmd: 260362 0.716941 -57291.5 -194855 155.149 >> cmd: 885523 2.4384 -194855 -662725 527.679 >> cmd: -705.076 -0.00194128 155.149 527.679 -0.420148 ] >> cmd: pos/mom/mf (-4.89001,14.5681,-29.9866) (-8.66398,26.1093,-54.8218) (0.000336516,-0.00100254,3.80933) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:50 EST Run: 1 Event: 58 >> cmd: local error not pos-def >> cmd: [ -1.18322e+06 147829 -16822.9 948861 -108730 >> cmd: 147829 -18469.4 2101.82 -118549 13584.5 >> cmd: -16822.9 2101.82 -239.186 13490.8 -1545.91 >> cmd: 948861 -118549 13490.8 -760921 87194 >> cmd: -108730 13584.5 -1545.91 87194 -9991.58 ] >> cmd: pos/mom/mf (-4.89001,14.5681,-29.9866) (-8.66398,26.1093,-54.8218) (0.000336516,-0.00100254,3.80933) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:50 EST Run: 1 Event: 58 >> cmd: local error not pos-def >> cmd: [ -1.18322e+06 147829 -16822.9 948861 -108730 >> cmd: 147829 -18469.4 2101.82 -118549 13584.5 >> cmd: -16822.9 2101.82 -239.186 13490.8 -1545.91 >> cmd: 948861 -118549 13490.8 -760921 87194 >> cmd: -108730 13584.5 -1545.91 87194 -9991.58 ] >> cmd: pos/mom/mf (-4.89001,14.5681,-29.9866) (-8.66321,26.1069,-54.8168) (0.000336516,-0.00100254,3.80933) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:50 EST Run: 1 Event: 58 >> cmd: curv error not pos-def >> cmd: [ -1.18322e+06 -3.27019 260362 885523 -705.167 >> cmd: -3.27019-9.01584e-06 0.71959 2.44741 -0.00194871 >> cmd: 260362 0.71959 -57291.4 -194855 155.169 >> cmd: 885523 2.44741 -194855 -662725 527.747 >> cmd: -705.167 -0.00194871 155.169 527.747 -0.420257 ] >> cmd: pos/mom/mf (-4.89001,14.5681,-29.9866) (-8.66321,26.1069,-54.8168) (0.000336516,-0.00100254,3.80933) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:50 EST Run: 1 Event: 58 >> cmd: curv error not pos-def >> cmd: [ -1.18322e+06 -2.31319 510551 4.08815e+06 -7880.98 >> cmd: -2.31319-4.49992e-06 0.998122 7.99229 -0.0154066 >> cmd: 510551 0.998122 -220298 -1.764e+06 3400.58 >> cmd: 4.08815e+06 7.99229 -1.764e+06-1.41249e+07 27229.6 >> cmd: -7880.98 -0.0154066 3400.58 27229.6 -52.4921 ] >> cmd: pos/mom/mf (-7.49322,22.4585,-46.5446) (-8.57321,26.1366,-54.8168) (0.000770068,-0.00230803,3.80689) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:50 EST Run: 1 Event: 58 >> cmd: local error not pos-def >> cmd: [ -1.18322e+06 514114 -83578.8-4.10181e+06 649345 >> cmd: 514114 -223384 36315.3 1.78225e+06 -282143 >> cmd: -83578.8 36315.3 -5903.72 -289738 45867.5 >> cmd: -4.10181e+06 1.78225e+06 -289738-1.42195e+07 2.25105e+06 >> cmd: 649345 -282143 45867.5 2.25105e+06 -356356 ] >> cmd: pos/mom/mf (-7.49322,22.4585,-46.5446) (-8.57321,26.1366,-54.8168) (0.000770068,-0.00230803,3.80689) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:50 EST Run: 1 Event: 58 >> cmd: local error not pos-def >> cmd: [ -1.18322e+06 514114 -83578.8-4.10181e+06 649345 >> cmd: 514114 -223384 36315.3 1.78225e+06 -282143 >> cmd: -83578.8 36315.3 -5903.72 -289738 45867.5 >> cmd: -4.10181e+06 1.78225e+06 -289738-1.42195e+07 2.25105e+06 >> cmd: 649345 -282143 45867.5 2.25105e+06 -356356 ] >> cmd: pos/mom/mf (-7.49323,22.4585,-46.5446) (-8.57165,26.1319,-54.8069) (0.000770068,-0.00230803,3.80689) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:50 EST Run: 1 Event: 58 >> cmd: curv error not pos-def >> cmd: [ -1.18322e+06 -2.3143 510551 4.08815e+06 -7881 >> cmd: -2.3143-4.49696e-06 0.998602 7.99613 -0.0154141 >> cmd: 510551 0.998602 -220299 -1.764e+06 3400.59 >> cmd: 4.08815e+06 7.99613 -1.764e+06-1.41249e+07 27229.6 >> cmd: -7881 -0.0154141 3400.59 27229.6 -52.4924 ] >> cmd: pos/mom/mf (-7.49323,22.4585,-46.5446) (-8.57165,26.1319,-54.8069) (0.000770068,-0.00230803,3.80689) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:51 EST Run: 1 Event: 58 >> cmd: curv error not pos-def >> cmd: [ -1.18322e+06 10.213 1.12579e+06 2.08277e+07 -93893.7 >> cmd: 10.213-8.81248e-05 -9.71735 -179.776 0.810451 >> cmd: 1.12579e+06 -9.71735-1.07115e+06-1.98168e+07 89336.4 >> cmd: 2.08277e+07 -179.776-1.98168e+07-3.66621e+08 1.65277e+06 >> cmd: -93893.7 0.810451 89336.4 1.65277e+06 -7450.86 ] >> cmd: pos/mom/mf (-13.7878,41.9262,-87.3184) (-8.35032,26.2034,-54.8069) (0.00252289,-0.00767165,3.79668) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:51 EST Run: 1 Event: 58 >> cmd: local error not pos-def >> cmd: [ -1.18322e+06 564914 -3146.85 -2.0828e+07 10496.8 >> cmd: 564914 -269711 1502.42 9.94404e+06 -5011.57 >> cmd: -3146.85 1502.42 -8.36922 -55393.2 27.9169 >> cmd: -2.0828e+07 9.94404e+06 -55393.2 -3.6663e+08 184773 >> cmd: 10496.8 -5011.57 27.9169 184773 -93.1213 ] >> cmd: pos/mom/mf (-13.7878,41.9262,-87.3184) (-8.35032,26.2034,-54.8069) (0.00252289,-0.00767165,3.79668) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:51 EST Run: 1 Event: 58 >> cmd: BasicTrajectoryState: attempt to access errors when none available accessing local error.. >> cmd: freestate pointer: parameters >> cmd: x = -13.7878 41.9262 -87.3184 >> cmd: p = -8.34886 26.1989 -54.7974 >> cmd: no error defined. >> cmd: >> cmd: local error valid/values :0 >> cmd: [ -1.18322e+10 5.64914e+09-3.14685e+07 -2.0828e+11 1.04968e+08 >> cmd: 5.64914e+09-2.69711e+09 1.50242e+07 9.94404e+10-5.01157e+07 >> cmd: -3.14685e+07 1.50242e+07 -83692.2-5.53932e+08 279169 >> cmd: -2.0828e+11 9.94404e+10-5.53932e+08 -3.6663e+12 1.84773e+09 >> cmd: 1.04968e+08-5.01157e+07 279169 1.84773e+09 -931213 ] >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:51 EST Run: 1 Event: 58 >> cmd: BasicTrajectoryState: attempt to access errors when none available accessing local error.. >> cmd: freestate pointer: parameters >> cmd: x = -13.7878 41.9262 -87.3184 >> cmd: p = -8.34886 26.1989 -54.7974 >> cmd: no error defined. >> cmd: >> cmd: local error valid/values :0 >> cmd: [ -1.18322e+10 5.64914e+09-3.14685e+07 -2.0828e+11 1.04968e+08 >> cmd: 5.64914e+09-2.69711e+09 1.50242e+07 9.94404e+10-5.01157e+07 >> cmd: -3.14685e+07 1.50242e+07 -83692.2-5.53932e+08 279169 >> cmd: -2.0828e+11 9.94404e+10-5.53932e+08 -3.6663e+12 1.84773e+09 >> cmd: 1.04968e+08-5.01157e+07 279169 1.84773e+09 -931213 ] >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:16:51 EST Run: 1 Event: 58 >> cmd: BasicTrajectoryState: attempt to access errors when none available accessing local error.. >> cmd: freestate pointer: parameters >> cmd: x = -13.7878 41.9262 -87.3184 >> cmd: p = -8.34886 26.1989 -54.7974 >> cmd: no error defined. >> cmd: >> cmd: local error valid/values :0 >> cmd: [ -1.18322e+10 5.64914e+09-3.14685e+07 -2.0828e+11 1.04968e+08 >> cmd: 5.64914e+09-2.69711e+09 1.50242e+07 9.94404e+10-5.01157e+07 >> cmd: -3.14685e+07 1.50242e+07 -83692.2-5.53932e+08 279169 >> cmd: -2.0828e+11 9.94404e+10-5.53932e+08 -3.6663e+12 1.84773e+09 >> cmd: 1.04968e+08-5.01157e+07 279169 1.84773e+09 -931213 ] >> cmd: %MSG >> cmd: Begin processing the 23rd record. Run 1, Event 65, LumiSection 23325 at 02-Dec-2019 05:16:51.650 EST >> cmd: %MSG-w InvalidHelix: SeedCreatorFromRegionConsecutiveHitsEDProducer:hltFullIter9TobTecSeedsPair 02-Dec-2019 05:16:53 EST Run: 1 Event: 40 >> cmd: PixelClusterShapeSeedComparitor helix is not valid, result is bad >> cmd: %MSG >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: Begin processing the 24th record. Run 1, Event 64, LumiSection 23325 at 02-Dec-2019 05:16:55.222 EST >> cmd: Begin processing the 25th record. Run 1, Event 66, LumiSection 23325 at 02-Dec-2019 05:16:56.049 EST >> cmd: %MSG-e CaloHitResponse: DataMixingModule:mixData 02-Dec-2019 05:16:56 EST Run: 1 Event: 64 >> cmd: Mismatched calo signals >> cmd: %MSG >> cmd: Begin processing the 26th record. Run 1, Event 78, LumiSection 23325 at 02-Dec-2019 05:16:57.422 EST >> cmd: Begin processing the 27th record. Run 1, Event 74, LumiSection 23325 at 02-Dec-2019 05:16:58.528 EST >> cmd: Begin processing the 28th record. Run 1, Event 76, LumiSection 23325 at 02-Dec-2019 05:16:58.679 EST >> cmd: Begin processing the 29th record. Run 1, Event 68, LumiSection 23325 at 02-Dec-2019 05:16:59.359 EST >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:17:04 EST Run: 1 Event: 74 >> cmd: curv error not pos-def >> cmd: [ 5.19143e+06 -230.298 -261424 -59.9472 1.75545 >> cmd: -230.298 0.0109097 11.597 0.00258322 0.00603334 >> cmd: -261424 11.597 13164.5 3.01137 -0.0884848 >> cmd: -59.9472 0.00258322 3.01137 -0.0581827-0.000863048 >> cmd: 1.75545 0.00603334 -0.0884848-0.000863048 0.0538616 ] >> cmd: pos/mom/mf (-10.2534,-4.09357,-4.54234) (-6.12166,-2.55949,-3.11934) (0.000145201,5.79702e-05,3.81124) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:17:04 EST Run: 1 Event: 74 >> cmd: local error not pos-def >> cmd: [ 5.19143e+06 261883 -4764 59.9975 -3.09583 >> cmd: 261883 13210.8 -240.321 3.01918 -0.156166 >> cmd: -4764 -240.321 4.37279 -0.055008 0.0110968 >> cmd: 59.9975 3.01918 -0.055008 -0.0582804 0.000168801 >> cmd: -3.09583 -0.156166 0.0110968 0.000168801 0.065791 ] >> cmd: pos/mom/mf (-10.2534,-4.09357,-4.54234) (-6.12166,-2.55949,-3.11934) (0.000145201,5.79702e-05,3.81124) >> cmd: %MSG >> cmd: Begin processing the 30th record. Run 1, Event 83, LumiSection 23325 at 02-Dec-2019 05:17:05.667 EST >> cmd: Begin processing the 31st record. Run 1, Event 86, LumiSection 23325 at 02-Dec-2019 05:17:09.511 EST >> cmd: Begin processing the 32nd record. Run 1, Event 80, LumiSection 23325 at 02-Dec-2019 05:17:09.739 EST >> cmd: Begin processing the 33rd record. Run 1, Event 87, LumiSection 23325 at 02-Dec-2019 05:17:10.779 EST >> cmd: Begin processing the 34th record. Run 1, Event 89, LumiSection 23325 at 02-Dec-2019 05:17:12.942 EST >> cmd: Begin processing the 35th record. Run 1, Event 88, LumiSection 23325 at 02-Dec-2019 05:17:14.448 EST >> cmd: Begin processing the 36th record. Run 1, Event 104, LumiSection 23325 at 02-Dec-2019 05:17:15.968 EST >> cmd: Begin processing the 37th record. Run 1, Event 94, LumiSection 23325 at 02-Dec-2019 05:17:18.559 EST >> cmd: Begin processing the 38th record. Run 1, Event 102, LumiSection 23325 at 02-Dec-2019 05:17:20.920 EST >> cmd: Begin processing the 39th record. Run 1, Event 137, LumiSection 23325 at 02-Dec-2019 05:17:22.180 EST >> cmd: Begin processing the 40th record. Run 1, Event 135, LumiSection 23325 at 02-Dec-2019 05:17:23.440 EST >> cmd: Begin processing the 41st record. Run 1, Event 136, LumiSection 23325 at 02-Dec-2019 05:17:23.724 EST >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: Begin processing the 42nd record. Run 1, Event 110, LumiSection 23325 at 02-Dec-2019 05:17:27.920 EST >> cmd: Begin processing the 43rd record. Run 1, Event 106, LumiSection 23325 at 02-Dec-2019 05:17:30.623 EST >> cmd: Begin processing the 44th record. Run 1, Event 148, LumiSection 23325 at 02-Dec-2019 05:17:31.229 EST >> cmd: Begin processing the 45th record. Run 1, Event 138, LumiSection 23325 at 02-Dec-2019 05:17:33.584 EST >> cmd: %MSG-w Muon: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIHit 02-Dec-2019 05:17:35 EST Run: 1 Event: 106 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w RecoMuon: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIHit 02-Dec-2019 05:17:35 EST Run: 1 Event: 106 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w GlobalMuon: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIHit 02-Dec-2019 05:17:35 EST Run: 1 Event: 106 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w GlobalTrajectoryBuilderBase: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIHit 02-Dec-2019 05:17:35 EST Run: 1 Event: 106 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: Begin processing the 46th record. Run 1, Event 139, LumiSection 23325 at 02-Dec-2019 05:17:36.491 EST >> cmd: Begin processing the 47th record. Run 1, Event 149, LumiSection 23325 at 02-Dec-2019 05:17:39.006 EST >> cmd: Begin processing the 48th record. Run 1, Event 153, LumiSection 23325 at 02-Dec-2019 05:17:39.355 EST >> cmd: %MSG-w Muon: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIState 02-Dec-2019 05:17:40 EST Run: 1 Event: 139 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w RecoMuon: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIState 02-Dec-2019 05:17:40 EST Run: 1 Event: 139 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w GlobalMuon: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIState 02-Dec-2019 05:17:40 EST Run: 1 Event: 139 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w GlobalTrajectoryBuilderBase: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIState 02-Dec-2019 05:17:40 EST Run: 1 Event: 139 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w Muon: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIHit 02-Dec-2019 05:17:40 EST Run: 1 Event: 139 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w RecoMuon: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIHit 02-Dec-2019 05:17:40 EST Run: 1 Event: 139 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w GlobalMuon: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIHit 02-Dec-2019 05:17:40 EST Run: 1 Event: 139 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w GlobalTrajectoryBuilderBase: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIHit 02-Dec-2019 05:17:40 EST Run: 1 Event: 139 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: Begin processing the 49th record. Run 1, Event 150, LumiSection 23325 at 02-Dec-2019 05:17:41.057 EST >> cmd: %MSG-e CaloHitResponse: DataMixingModule:mixData 02-Dec-2019 05:17:42 EST Run: 1 Event: 150 >> cmd: Mismatched calo signals >> cmd: %MSG >> cmd: Begin processing the 50th record. Run 1, Event 159, LumiSection 23325 at 02-Dec-2019 05:17:43.728 EST >> cmd: Begin processing the 51st record. Run 1, Event 151, LumiSection 23325 at 02-Dec-2019 05:17:46.741 EST >> cmd: Begin processing the 52nd record. Run 1, Event 158, LumiSection 23325 at 02-Dec-2019 05:17:50.239 EST >> cmd: Begin processing the 53rd record. Run 1, Event 165, LumiSection 23325 at 02-Dec-2019 05:17:50.861 EST >> cmd: Begin processing the 54th record. Run 1, Event 173, LumiSection 23325 at 02-Dec-2019 05:17:52.575 EST >> cmd: Begin processing the 55th record. Run 1, Event 177, LumiSection 23325 at 02-Dec-2019 05:17:55.025 EST >> cmd: Begin processing the 56th record. Run 1, Event 169, LumiSection 23325 at 02-Dec-2019 05:17:56.180 EST >> cmd: Begin processing the 57th record. Run 1, Event 175, LumiSection 23325 at 02-Dec-2019 05:17:59.958 EST >> cmd: %MSG-w EnergyInDeadEB_FE: EcalRecHitProducer:hltEcalRecHit 02-Dec-2019 05:18:00 EST Run: 1 Event: 169 >> cmd: TP energy in the dead TT = 70.5 at (EcalTT subDet Barrel iz + ieta 13 iphi 37) >> cmd: %MSG >> cmd: Begin processing the 58th record. Run 1, Event 186, LumiSection 23325 at 02-Dec-2019 05:18:00.645 EST >> cmd: Begin processing the 59th record. Run 1, Event 178, LumiSection 23325 at 02-Dec-2019 05:18:03.582 EST >> cmd: Begin processing the 60th record. Run 1, Event 201, LumiSection 23325 at 02-Dec-2019 05:18:04.396 EST >> cmd: Begin processing the 61st record. Run 1, Event 199, LumiSection 23325 at 02-Dec-2019 05:18:06.137 EST >> cmd: Begin processing the 62nd record. Run 1, Event 204, LumiSection 23325 at 02-Dec-2019 05:18:11.532 EST >> cmd: Begin processing the 63rd record. Run 1, Event 187, LumiSection 23325 at 02-Dec-2019 05:18:13.431 EST >> cmd: Begin processing the 64th record. Run 1, Event 195, LumiSection 23325 at 02-Dec-2019 05:18:14.348 EST >> cmd: Begin processing the 65th record. Run 1, Event 203, LumiSection 23325 at 02-Dec-2019 05:18:14.611 EST >> cmd: %MSG-w InvalidHelix: SeedCreatorFromRegionConsecutiveHitsEDProducer:hltFullIter9TobTecSeedsPair 02-Dec-2019 05:18:15 EST Run: 1 Event: 199 >> cmd: PixelClusterShapeSeedComparitor helix is not valid, result is bad >> cmd: %MSG >> cmd: Begin processing the 66th record. Run 1, Event 226, LumiSection 23325 at 02-Dec-2019 05:18:17.791 EST >> cmd: %MSG-w InvalidHelix: SeedCreatorFromRegionConsecutiveHitsEDProducer:hltFullIter9TobTecSeedsPair 02-Dec-2019 05:18:18 EST Run: 1 Event: 201 >> cmd: PixelClusterShapeSeedComparitor helix is not valid, result is bad >> cmd: %MSG >> cmd: Begin processing the 67th record. Run 1, Event 232, LumiSection 23325 at 02-Dec-2019 05:18:19.755 EST >> cmd: Begin processing the 68th record. Run 1, Event 207, LumiSection 23325 at 02-Dec-2019 05:18:22.320 EST >> cmd: %MSG-w Muon: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIHit 02-Dec-2019 05:18:22 EST Run: 1 Event: 226 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w RecoMuon: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIHit 02-Dec-2019 05:18:22 EST Run: 1 Event: 226 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w GlobalMuon: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIHit 02-Dec-2019 05:18:22 EST Run: 1 Event: 226 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w GlobalTrajectoryBuilderBase: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIHit 02-Dec-2019 05:18:22 EST Run: 1 Event: 226 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2PFlowCtfWithMaterialTracksForPhotons 02-Dec-2019 05:18:23 EST Run: 1 Event: 204 >> cmd: curv error not pos-def >> cmd: [ 1.53816e+07 44.4105 -372987 9.26755 -0.310009 >> cmd: 44.4105 0.0270897 -1.07689 0.000130066 0.11443 >> cmd: -372987 -1.07689 9044.53 -0.225591 0.00758064 >> cmd: 9.26755 0.000130066 -0.225591 -0.00355479 0.000439613 >> cmd: -0.310009 0.11443 0.00758064 0.000439613 0.4857 ] >> cmd: pos/mom/mf (-3.50247,-5.98642,-1.74498) (-7.46134,-13.0725,3.63976) (2.77894e-05,4.74977e-05,3.81123) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2PFlowCtfWithMaterialTracksForPhotons 02-Dec-2019 05:18:23 EST Run: 1 Event: 204 >> cmd: local error not pos-def >> cmd: [ 1.53816e+07 373231 2281.61 -9.27063 0.261099 >> cmd: 373231 9056.33 55.3625 -0.225813 0.006483 >> cmd: 2281.61 55.3625 0.368664 -0.00127256 0.12469 >> cmd: -9.27063 -0.225813 -0.00127256 -0.00355716 0.000424284 >> cmd: 0.261099 0.006483 0.12469 0.000424284 0.514093 ] >> cmd: pos/mom/mf (-3.50247,-5.98642,-1.74498) (-7.46134,-13.0725,3.63976) (2.77894e-05,4.74977e-05,3.81123) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:18:25 EST Run: 1 Event: 232 >> cmd: curv error not pos-def >> cmd: [ 7.25326e+06 16.1845 -344329 3.90556 -0.344856 >> cmd: 16.1845 0.00274075 -0.768316 7.42901e-06 0.0224707 >> cmd: -344329 -0.768316 16346.1 -0.186948 0.0163669 >> cmd: 3.90556 7.42901e-06 -0.186948 -0.0128095 -9.0571e-06 >> cmd: -0.344856 0.0224707 0.0163669 -9.0571e-06 0.186721 ] >> cmd: pos/mom/mf (2.78028,-10.6912,-0.192527) (2.04819,-7.60526,0.184838) (-1.23893e-05,4.76414e-05,3.81131) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:18:25 EST Run: 1 Event: 232 >> cmd: local error not pos-def >> cmd: [ 7.25326e+06 345248 402.071 -3.91077 0.340212 >> cmd: 345248 16433.4 19.1382 -0.187698 0.0161939 >> cmd: 402.071 19.1382 0.0250029-0.000220064 0.0225387 >> cmd: -3.91077 -0.187698-0.000220064 -0.0128437-2.55483e-05 >> cmd: 0.340212 0.0161939 0.0225387-2.55483e-05 0.186823 ] >> cmd: pos/mom/mf (2.78028,-10.6912,-0.192527) (2.04819,-7.60526,0.184838) (-1.23893e-05,4.76414e-05,3.81131) >> cmd: %MSG >> cmd: Begin processing the 69th record. Run 1, Event 212, LumiSection 23325 at 02-Dec-2019 05:18:26.173 EST >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: %MSG-w InvalidHelix: SeedCreatorFromRegionConsecutiveHitsEDProducer:hltFullIter9TobTecSeedsPair 02-Dec-2019 05:18:31 EST Run: 1 Event: 232 >> cmd: PixelClusterShapeSeedComparitor helix is not valid, result is bad >> cmd: %MSG >> cmd: Begin processing the 70th record. Run 1, Event 242, LumiSection 23325 at 02-Dec-2019 05:18:32.235 EST >> cmd: Begin processing the 71st record. Run 1, Event 261, LumiSection 23325 at 02-Dec-2019 05:18:32.599 EST >> cmd: Begin processing the 72nd record. Run 1, Event 243, LumiSection 23325 at 02-Dec-2019 05:18:32.939 EST >> cmd: Begin processing the 73rd record. Run 1, Event 256, LumiSection 23325 at 02-Dec-2019 05:18:36.093 EST >> cmd: Begin processing the 74th record. Run 1, Event 259, LumiSection 23325 at 02-Dec-2019 05:18:37.171 EST >> cmd: Begin processing the 75th record. Run 1, Event 239, LumiSection 23325 at 02-Dec-2019 05:18:42.580 EST >> cmd: Begin processing the 76th record. Run 1, Event 265, LumiSection 23325 at 02-Dec-2019 05:18:43.321 EST >> cmd: Begin processing the 77th record. Run 1, Event 270, LumiSection 23325 at 02-Dec-2019 05:18:46.014 EST >> cmd: Begin processing the 78th record. Run 1, Event 275, LumiSection 23325 at 02-Dec-2019 05:18:50.197 EST >> cmd: Begin processing the 79th record. Run 1, Event 286, LumiSection 23325 at 02-Dec-2019 05:18:50.385 EST >> cmd: Begin processing the 80th record. Run 1, Event 279, LumiSection 23325 at 02-Dec-2019 05:18:50.677 EST >> cmd: %MSG-w InvalidHelix: SeedCreatorFromRegionConsecutiveHitsEDProducer:hltFullIter9TobTecSeedsPair 02-Dec-2019 05:18:53 EST Run: 1 Event: 270 >> cmd: PixelClusterShapeSeedComparitor helix is not valid, result is bad >> cmd: %MSG >> cmd: Begin processing the 81st record. Run 1, Event 282, LumiSection 23325 at 02-Dec-2019 05:18:54.293 EST >> cmd: Begin processing the 82nd record. Run 1, Event 291, LumiSection 23325 at 02-Dec-2019 05:18:54.820 EST >> cmd: %MSG-w Muon: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIState 02-Dec-2019 05:18:56 EST Run: 1 Event: 275 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w RecoMuon: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIState 02-Dec-2019 05:18:56 EST Run: 1 Event: 275 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w GlobalMuon: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIState 02-Dec-2019 05:18:56 EST Run: 1 Event: 275 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w GlobalTrajectoryBuilderBase: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIState 02-Dec-2019 05:18:56 EST Run: 1 Event: 275 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:18:57 EST Run: 1 Event: 286 >> cmd: local error not pos-def >> cmd: [ -1.22681e+06 -118422 14755.1 -0.00358158 -0.00557789 >> cmd: -118422 -11431.2 1424.29-0.000345773-0.000538428 >> cmd: 14755.1 1424.29 -177.463 4.30765e-05 6.66428e-05 >> cmd: -0.00358158-0.000345773 4.30765e-05 3.61066e-07-2.63596e-11 >> cmd: -0.00557789-0.000538428 6.66428e-05-2.63596e-11 3.39327e-06 ] >> cmd: pos/mom/mf (6.96352,-8.16374,21.8267) (17.1229,-20.2289,51.8257) (0.000306616,-0.000359463,3.81048) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:18:57 EST Run: 1 Event: 286 >> cmd: curv error not pos-def >> cmd: [ -1.22681e+06 91.5958 117973 -0.00357465 0.00273677 >> cmd: 91.5958 -0.00683867 -8.80808 2.65721e-07 -1.6246e-07 >> cmd: 117973 -8.80808 -11344.6 0.000343794-0.000263177 >> cmd: -0.00357465 2.65721e-07 0.000343794 3.59687e-07-1.97953e-08 >> cmd: 0.00273677 -1.6246e-07-0.000263177-1.97953e-08 7.04549e-07 ] >> cmd: pos/mom/mf (6.96352,-8.16374,21.8267) (17.1229,-20.2289,51.8257) (0.000306616,-0.000359463,3.81048) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:18:57 EST Run: 1 Event: 286 >> cmd: curv error not pos-def >> cmd: [ -1.22681e+06 90.4983 614310 5.90547e+06 17340.7 >> cmd: 90.4983 -0.00667577 -45.316 -435.631 -1.27918 >> cmd: 614310 -45.316 -307609 -2.9571e+06 -8683.19 >> cmd: 5.90547e+06 -435.631 -2.9571e+06-2.84271e+07 -83473 >> cmd: 17340.7 -1.27918 -8683.19 -83473 -245.109 ] >> cmd: pos/mom/mf (17.3413,-20.5107,53.3666) (16.982,-20.3473,51.8257) (0.0018953,-0.0022417,3.80637) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:18:57 EST Run: 1 Event: 286 >> cmd: local error not pos-def >> cmd: [ -1.22681e+06 -619502 108366-5.92945e+06 1.00331e+06 >> cmd: -619502 -312831 54721.6 -2.9942e+06 506644 >> cmd: 108366 54721.6 -9572.12 523757 -88624.2 >> cmd: -5.92945e+06 -2.9942e+06 523757-2.86584e+07 4.84925e+06 >> cmd: 1.00331e+06 506644 -88624.2 4.84925e+06 -820534 ] >> cmd: pos/mom/mf (17.3413,-20.5107,53.3666) (16.982,-20.3473,51.8257) (0.0018953,-0.0022417,3.80637) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:18:57 EST Run: 1 Event: 286 >> cmd: local error not pos-def >> cmd: [ -1.22681e+06 -619502 108366-5.92945e+06 1.00331e+06 >> cmd: -619502 -312831 54721.6 -2.9942e+06 506644 >> cmd: 108366 54721.6 -9572.12 523757 -88624.2 >> cmd: -5.92945e+06 -2.9942e+06 523757-2.86584e+07 4.84925e+06 >> cmd: 1.00331e+06 506644 -88624.2 4.84925e+06 -820534 ] >> cmd: pos/mom/mf (17.3413,-20.5107,53.3666) (16.9788,-20.3435,51.816) (0.0018953,-0.0022417,3.80637) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:18:57 EST Run: 1 Event: 286 >> cmd: curv error not pos-def >> cmd: [ -1.22681e+06 90.4914 614310 5.90547e+06 17340.6 >> cmd: 90.4914 -0.00667475 -45.3126 -435.598 -1.27907 >> cmd: 614310 -45.3126 -307609 -2.9571e+06 -8683.11 >> cmd: 5.90547e+06 -435.598 -2.9571e+06-2.84271e+07 -83472.3 >> cmd: 17340.6 -1.27907 -8683.11 -83472.3 -245.105 ] >> cmd: pos/mom/mf (17.3413,-20.5107,53.3666) (16.9788,-20.3435,51.816) (0.0018953,-0.0022417,3.80637) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:18:57 EST Run: 1 Event: 286 >> cmd: curv error not pos-def >> cmd: [ -1.22681e+06 77.2393 1.14735e+06 2.11988e+07 105287 >> cmd: 77.2393 -0.0048629 -72.2369 -1334.67 -6.62882 >> cmd: 1.14735e+06 -72.2369-1.07304e+06-1.98258e+07 -98467.9 >> cmd: 2.11988e+07 -1334.67-1.98258e+07-3.66307e+08-1.81932e+06 >> cmd: 105287 -6.62882 -98467.9-1.81932e+06 -9035.92 ] >> cmd: pos/mom/mf (28.4168,-33.8821,87.319) (16.8268,-20.4694,51.816) (0.00500183,-0.00596381,3.79797) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:18:57 EST Run: 1 Event: 286 >> cmd: local error not pos-def >> cmd: [ -1.22681e+06 -585697 35074.8 2.1154e+07-1.38176e+06 >> cmd: -585697 -279621 16745.3 1.00993e+07 -659676 >> cmd: 35074.8 16745.3 -1002.8 -604801 39505.1 >> cmd: 2.1154e+07 1.00993e+07 -604801-3.64762e+08 2.38259e+07 >> cmd: -1.38176e+06 -659676 39505.1 2.38259e+07-1.55629e+06 ] >> cmd: pos/mom/mf (28.4168,-33.8821,87.319) (16.8268,-20.4694,51.816) (0.00500183,-0.00596381,3.79797) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:18:57 EST Run: 1 Event: 286 >> cmd: BasicTrajectoryState: attempt to access errors when none available accessing local error.. >> cmd: freestate pointer: parameters >> cmd: x = 28.4168 -33.8821 87.319 >> cmd: p = 16.8237 -20.4656 51.8065 >> cmd: no error defined. >> cmd: >> cmd: local error valid/values :0 >> cmd: [ -1.22681e+10-5.85697e+09 3.50748e+08 2.1154e+11-1.38176e+10 >> cmd: -5.85697e+09-2.79621e+09 1.67453e+08 1.00993e+11-6.59676e+09 >> cmd: 3.50748e+08 1.67453e+08 -1.0028e+07-6.04801e+09 3.95051e+08 >> cmd: 2.1154e+11 1.00993e+11-6.04801e+09-3.64762e+12 2.38259e+11 >> cmd: -1.38176e+10-6.59676e+09 3.95051e+08 2.38259e+11-1.55629e+10 ] >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:18:57 EST Run: 1 Event: 286 >> cmd: BasicTrajectoryState: attempt to access errors when none available accessing local error.. >> cmd: freestate pointer: parameters >> cmd: x = 28.4168 -33.8821 87.319 >> cmd: p = 16.8237 -20.4656 51.8065 >> cmd: no error defined. >> cmd: >> cmd: local error valid/values :0 >> cmd: [ -1.22681e+10-5.85697e+09 3.50748e+08 2.1154e+11-1.38176e+10 >> cmd: -5.85697e+09-2.79621e+09 1.67453e+08 1.00993e+11-6.59676e+09 >> cmd: 3.50748e+08 1.67453e+08 -1.0028e+07-6.04801e+09 3.95051e+08 >> cmd: 2.1154e+11 1.00993e+11-6.04801e+09-3.64762e+12 2.38259e+11 >> cmd: -1.38176e+10-6.59676e+09 3.95051e+08 2.38259e+11-1.55629e+10 ] >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:18:57 EST Run: 1 Event: 286 >> cmd: local error not pos-def >> cmd: [ 0.00100725 0.000132484 3.99655e-06 0.000441206-0.000789185 >> cmd: 0.000132484 0.000133481 4.61463e-05 0.000184632 -0.00292771 >> cmd: 3.99655e-06 4.61463e-05 0.000854431 -0.00313871 -0.0449395 >> cmd: 0.000441206 0.000184632 -0.00313871 -0.0264318 0.207461 >> cmd: -0.000789185 -0.00292771 -0.0449395 0.207461 2.87732 ] >> cmd: pos/mom/mf (28.5034,-34.0401,87.319) (15.1098,-18.4509,46.3844) (0.00501693,-0.00599145,3.79798) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:18:57 EST Run: 1 Event: 286 >> cmd: curv error not pos-def >> cmd: [ 0.00100725 9.20658e-06-0.000256873 0.000486047 0.000678018 >> cmd: 9.20658e-06 0.000536309-1.01189e-05-0.000408742 0.0317499 >> cmd: -0.000256873-1.01189e-05 0.000494057-0.000742817-0.000784613 >> cmd: 0.000486047-0.000408742-0.000742817 -0.0406695 -0.0343797 >> cmd: 0.000678018 0.0317499-0.000784613 -0.0343797 2.28697 ] >> cmd: pos/mom/mf (28.5034,-34.0401,87.319) (15.1098,-18.4509,46.3844) (0.00501693,-0.00599145,3.79798) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:18:57 EST Run: 1 Event: 286 >> cmd: local error not pos-def >> cmd: [ -0.000157269 -7.9491e-05 1.3893e-05-0.000760766 0.000128547 >> cmd: -7.9491e-05-4.01257e-05 7.00989e-06-0.000384266 6.48748e-05 >> cmd: 1.3893e-05 7.00989e-06 2.67459e-07 6.71346e-05 1.00668e-05 >> cmd: -0.000760766-0.000384266 6.71346e-05 -0.00367479 0.000620402 >> cmd: 0.000128547 6.48748e-05 1.00668e-05 0.000620402 0.000249613 ] >> cmd: pos/mom/mf (17.3342,-20.5177,53.3683) (15.1458,-18.1852,46.279) (0.00189459,-0.00224253,3.80637) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:18:57 EST Run: 1 Event: 286 >> cmd: curv error not pos-def >> cmd: [ -0.000157269 4.69758e-08 7.88066e-05 0.000757619 3.00172e-06 >> cmd: 4.69758e-08 6.35889e-08-2.32674e-08-2.31275e-07 2.01096e-06 >> cmd: 7.88066e-05-2.32674e-08-3.94377e-05-0.000379382-1.49639e-06 >> cmd: 0.000757619-2.31275e-07-0.000379382 -0.00364445-1.46787e-05 >> cmd: 3.00172e-06 2.01096e-06-1.49639e-06-1.46787e-05 7.34062e-05 ] >> cmd: pos/mom/mf (17.3342,-20.5177,53.3683) (15.1458,-18.1852,46.279) (0.00189459,-0.00224253,3.80637) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:18:57 EST Run: 1 Event: 286 >> cmd: local error not pos-def >> cmd: [ -0.000158561 -1.5338e-05 1.92207e-06 1.31018e-07-5.95152e-09 >> cmd: -1.5338e-05-1.47063e-06 1.8371e-07-3.49037e-08-5.02125e-10 >> cmd: 1.92207e-06 1.8371e-07 1.27614e-06-1.53782e-09-4.43899e-07 >> cmd: 1.31018e-07-3.49037e-08-1.53782e-09 3.63594e-07-1.01545e-11 >> cmd: -5.95152e-09-5.02125e-10-4.43899e-07-1.01545e-11 3.39525e-06 ] >> cmd: pos/mom/mf (6.96352,-8.16375,21.8267) (15.2905,-18.0714,46.2904) (0.000306615,-0.000359464,3.81048) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:18:57 EST Run: 1 Event: 286 >> cmd: curv error not pos-def >> cmd: [ -0.000158561 1.5369e-08 1.52801e-05 1.30769e-07-4.47683e-09 >> cmd: 1.5369e-08 5.56183e-08-1.32633e-09 -1.1846e-09 4.18913e-08 >> cmd: 1.52801e-05-1.32633e-09-1.45955e-06 3.47081e-08-1.82976e-09 >> cmd: 1.30769e-07 -1.1846e-09 3.47081e-08 3.62215e-07-1.98777e-08 >> cmd: -4.47683e-09 4.18913e-08-1.82976e-09-1.98777e-08 7.04962e-07 ] >> cmd: pos/mom/mf (6.96352,-8.16375,21.8267) (15.2905,-18.0714,46.2904) (0.000306615,-0.000359464,3.81048) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:18:57 EST Run: 1 Event: 286 >> cmd: local error not pos-def >> cmd: [ -0.000158897 1.53133e-05-2.86784e-06 1.03078e-07 5.54822e-08 >> cmd: 1.53133e-05-1.45303e-06 2.73521e-07 -5.6581e-08-1.24644e-08 >> cmd: -2.86784e-06 2.73521e-07 1.2994e-06 1.69204e-09-9.48035e-06 >> cmd: 1.03078e-07 -5.6581e-08 1.69204e-09 3.55743e-07-1.00381e-11 >> cmd: 5.54822e-08-1.24644e-08-9.48035e-06-1.00381e-11 7.23307e-05 ] >> cmd: pos/mom/mf (2.00371,-2.32384,6.84406) (15.3549,-18.0119,46.2835) (2.27144e-05,-2.63435e-05,3.81116) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:18:57 EST Run: 1 Event: 286 >> cmd: curv error not pos-def >> cmd: [ -0.000158897 2.49812e-09-1.51753e-05-1.02608e-07-3.40165e-08 >> cmd: 2.49812e-09 5.75452e-08 1.3922e-10-1.82723e-09-8.91339e-07 >> cmd: -1.51753e-05 1.3922e-10-1.42697e-06-5.58191e-08-3.95677e-09 >> cmd: -1.02608e-07-1.82723e-09-5.58191e-08 3.52507e-07 3.01839e-08 >> cmd: -3.40165e-08-8.91339e-07-3.95677e-09 3.01839e-08 1.49995e-05 ] >> cmd: pos/mom/mf (2.00371,-2.32384,6.84406) (15.3549,-18.0119,46.2835) (2.27144e-05,-2.63435e-05,3.81116) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2ElectronsCtfWithMaterialTracks 02-Dec-2019 05:18:57 EST Run: 1 Event: 286 >> cmd: BasicTrajectoryState: attempt to access errors when none available accessing local error.. >> cmd: freestate pointer: parameters >> cmd: x = 28.4168 -33.8821 87.319 >> cmd: p = 16.8237 -20.4656 51.8065 >> cmd: no error defined. >> cmd: >> cmd: local error valid/values :0 >> cmd: [ -1.22681e+10-5.85697e+09 3.50748e+08 2.1154e+11-1.38176e+10 >> cmd: -5.85697e+09-2.79621e+09 1.67453e+08 1.00993e+11-6.59676e+09 >> cmd: 3.50748e+08 1.67453e+08 -1.0028e+07-6.04801e+09 3.95051e+08 >> cmd: 2.1154e+11 1.00993e+11-6.04801e+09-3.64762e+12 2.38259e+11 >> cmd: -1.38176e+10-6.59676e+09 3.95051e+08 2.38259e+11-1.55629e+10 ] >> cmd: %MSG >> cmd: Begin processing the 83rd record. Run 1, Event 273, LumiSection 23325 at 02-Dec-2019 05:18:57.884 EST >> cmd: Begin processing the 84th record. Run 1, Event 293, LumiSection 23325 at 02-Dec-2019 05:19:00.376 EST >> cmd: Begin processing the 85th record. Run 1, Event 308, LumiSection 23325 at 02-Dec-2019 05:19:01.774 EST >> cmd: Begin processing the 86th record. Run 1, Event 305, LumiSection 23325 at 02-Dec-2019 05:19:06.029 EST >> cmd: Begin processing the 87th record. Run 1, Event 292, LumiSection 23325 at 02-Dec-2019 05:19:07.770 EST >> cmd: Begin processing the 88th record. Run 1, Event 317, LumiSection 23325 at 02-Dec-2019 05:19:08.108 EST >> cmd: Begin processing the 89th record. Run 1, Event 311, LumiSection 23325 at 02-Dec-2019 05:19:09.324 EST >> cmd: Begin processing the 90th record. Run 1, Event 309, LumiSection 23325 at 02-Dec-2019 05:19:12.425 EST >> cmd: Begin processing the 91st record. Run 1, Event 315, LumiSection 23325 at 02-Dec-2019 05:19:14.471 EST >> cmd: Begin processing the 92nd record. Run 1, Event 333, LumiSection 23325 at 02-Dec-2019 05:19:15.998 EST >> cmd: Begin processing the 93rd record. Run 1, Event 328, LumiSection 23325 at 02-Dec-2019 05:19:17.725 EST >> cmd: Begin processing the 94th record. Run 1, Event 318, LumiSection 23325 at 02-Dec-2019 05:19:20.487 EST >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: Begin processing the 95th record. Run 1, Event 329, LumiSection 23325 at 02-Dec-2019 05:19:26.146 EST >> cmd: Begin processing the 96th record. Run 1, Event 338, LumiSection 23325 at 02-Dec-2019 05:19:26.647 EST >> cmd: Begin processing the 97th record. Run 1, Event 334, LumiSection 23325 at 02-Dec-2019 05:19:27.495 EST >> cmd: Begin processing the 98th record. Run 1, Event 336, LumiSection 23325 at 02-Dec-2019 05:19:30.199 EST >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: %MSG-e CaloHitResponse: DataMixingModule:mixData 02-Dec-2019 05:19:31 EST Run: 1 Event: 336 >> cmd: Mismatched calo signals >> cmd: %MSG >> cmd: Begin processing the 99th record. Run 1, Event 353, LumiSection 23325 at 02-Dec-2019 05:19:31.921 EST >> cmd: Begin processing the 100th record. Run 1, Event 354, LumiSection 23325 at 02-Dec-2019 05:19:33.531 EST >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2PFlowCtfWithMaterialTracksForPhotons 02-Dec-2019 05:19:34 EST Run: 1 Event: 336 >> cmd: curv error not pos-def >> cmd: [ 3.87077e+06 74.6194 -251525 -143.766 0.728495 >> cmd: 74.6194 0.00161049 -4.84876 -0.00231468 0.00196923 >> cmd: -251525 -4.84876 16344.3 9.33632 -0.0467039 >> cmd: -143.766 -0.00231468 9.33632 -0.0417315 0.00522593 >> cmd: 0.728495 0.00196923 -0.0467039 0.00522593 0.0222301 ] >> cmd: pos/mom/mf (-9.15826,-6.181,-7.26648) (-21.857,-14.8805,-25.1549) (0.000184821,0.000124738,3.81115) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltIter2PFlowCtfWithMaterialTracksForPhotons 02-Dec-2019 05:19:34 EST Run: 1 Event: 336 >> cmd: local error not pos-def >> cmd: [ 3.87077e+06 251995 10125.5 143.899 4.85777 >> cmd: 251995 16405.4 659.192 9.36238 0.316904 >> cmd: 10125.5 659.192 26.4878 0.377061 0.0179157 >> cmd: 143.899 9.36238 0.377061 -0.041808 0.00551727 >> cmd: 4.85777 0.316904 0.0179157 0.00551727 0.0428708 ] >> cmd: pos/mom/mf (-9.15826,-6.181,-7.26648) (-21.857,-14.8805,-25.1549) (0.000184821,0.000124738,3.81115) >> cmd: %MSG >> cmd: Begin processing the 101st record. Run 1, Event 356, LumiSection 23325 at 02-Dec-2019 05:19:35.108 EST >> cmd: %MSG-w InvalidHelix: SeedCreatorFromRegionConsecutiveHitsEDProducer:hltFullIter9TobTecSeedsTripl 02-Dec-2019 05:19:36 EST Run: 1 Event: 311 >> cmd: PixelClusterShapeSeedComparitor helix is not valid, result is bad >> cmd: %MSG >> cmd: %MSG-w InvalidHelix: SeedCreatorFromRegionConsecutiveHitsEDProducer:hltFullIter9TobTecSeedsTripl 02-Dec-2019 05:19:36 EST Run: 1 Event: 311 >> cmd: PixelClusterShapeSeedComparitor helix is not valid, result is bad >> cmd: %MSG >> cmd: %MSG-w InvalidHelix: SeedCreatorFromRegionConsecutiveHitsEDProducer:hltFullIter9TobTecSeedsPair 02-Dec-2019 05:19:36 EST Run: 1 Event: 311 >> cmd: PixelClusterShapeSeedComparitor helix is not valid, result is bad >> cmd: %MSG >> cmd: Begin processing the 102nd record. Run 1, Event 359, LumiSection 23325 at 02-Dec-2019 05:19:40.524 EST >> cmd: Begin processing the 103rd record. Run 1, Event 343, LumiSection 23325 at 02-Dec-2019 05:19:41.068 EST >> cmd: Begin processing the 104th record. Run 1, Event 376, LumiSection 23325 at 02-Dec-2019 05:19:43.222 EST >> cmd: Begin processing the 105th record. Run 1, Event 379, LumiSection 23325 at 02-Dec-2019 05:19:43.851 EST >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: Begin processing the 106th record. Run 1, Event 380, LumiSection 23325 at 02-Dec-2019 05:19:46.563 EST >> cmd: %MSG-w Muon: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIState 02-Dec-2019 05:19:47 EST Run: 1 Event: 359 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w RecoMuon: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIState 02-Dec-2019 05:19:47 EST Run: 1 Event: 359 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w GlobalMuon: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIState 02-Dec-2019 05:19:47 EST Run: 1 Event: 359 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w GlobalTrajectoryBuilderBase: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIState 02-Dec-2019 05:19:47 EST Run: 1 Event: 359 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w Muon: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIHit 02-Dec-2019 05:19:47 EST Run: 1 Event: 359 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w RecoMuon: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIHit 02-Dec-2019 05:19:47 EST Run: 1 Event: 359 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w GlobalMuon: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIHit 02-Dec-2019 05:19:47 EST Run: 1 Event: 359 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w GlobalTrajectoryBuilderBase: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIHit 02-Dec-2019 05:19:47 EST Run: 1 Event: 359 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w Muon: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIHit 02-Dec-2019 05:19:47 EST Run: 1 Event: 359 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w RecoMuon: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIHit 02-Dec-2019 05:19:47 EST Run: 1 Event: 359 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w GlobalMuon: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIHit 02-Dec-2019 05:19:47 EST Run: 1 Event: 359 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w GlobalTrajectoryBuilderBase: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIHit 02-Dec-2019 05:19:47 EST Run: 1 Event: 359 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltL3NoFiltersTkTracksFromL2IOHitNoVtx 02-Dec-2019 05:19:47 EST Run: 1 Event: 359 >> cmd: curv error not pos-def >> cmd: [ 3.65377e+07 -1649.42-1.60952e+06 -316.044 162.983 >> cmd: -1649.42 0.0763273 72.6586 0.0139784 0.00703619 >> cmd: -1.60952e+06 72.6586 70900.8 13.9179 -7.17998 >> cmd: -316.044 0.0139784 13.9179 -0.0120727 -0.00373763 >> cmd: 162.983 0.00703619 -7.17998 -0.00373763 0.111693 ] >> cmd: pos/mom/mf (5.27591,-3.98514,-2.7892) (2.11985,-1.57367,-5.12101) (0,0,3.81135) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltL3NoFiltersTkTracksFromL2IOHitNoVtx 02-Dec-2019 05:19:47 EST Run: 1 Event: 359 >> cmd: local error not pos-def >> cmd: [ 3.65377e+07 1.6239e+06 -303227 -317.439 -297.965 >> cmd: 1.6239e+06 72173.4 -13476.8 -14.1042 -13.2456 >> cmd: -303227 -13476.8 2516.53 2.63228 2.32328 >> cmd: -317.439 -14.1042 2.63228 -0.01218 0.0104017 >> cmd: -297.965 -13.2456 2.32328 0.0104017 0.528613 ] >> cmd: pos/mom/mf (5.27591,-3.98514,-2.7892) (2.11985,-1.57367,-5.12101) (0,0,3.81135) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltL3NoFiltersTkTracksFromL2IOHitNoVtx 02-Dec-2019 05:19:47 EST Run: 1 Event: 359 >> cmd: curv error not pos-def >> cmd: [ 3.65377e+07 -1649.42-1.60952e+06 -316.044 162.983 >> cmd: -1649.42 0.0763273 72.6586 0.0139784 0.00703619 >> cmd: -1.60952e+06 72.6586 70900.8 13.9179 -7.17998 >> cmd: -316.044 0.0139784 13.9179 -0.0120727 -0.00373763 >> cmd: 162.983 0.00703619 -7.17998 -0.00373763 0.111693 ] >> cmd: pos/mom/mf (5.27591,-3.98514,-2.7892) (2.11985,-1.57367,-5.12101) (0,0,3.81135) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:hltL3NoFiltersTkTracksFromL2IOHitNoVtx 02-Dec-2019 05:19:47 EST Run: 1 Event: 359 >> cmd: local error not pos-def >> cmd: [ 3.65377e+07 1.6239e+06 -303227 -317.439 -297.965 >> cmd: 1.6239e+06 72173.4 -13476.8 -14.1042 -13.2456 >> cmd: -303227 -13476.8 2516.53 2.63228 2.32328 >> cmd: -317.439 -14.1042 2.63228 -0.01218 0.0104017 >> cmd: -297.965 -13.2456 2.32328 0.0104017 0.528613 ] >> cmd: pos/mom/mf (5.27591,-3.98514,-2.7892) (2.11985,-1.57367,-5.12101) (0,0,3.81135) >> cmd: %MSG >> cmd: Begin processing the 107th record. Run 1, Event 373, LumiSection 23325 at 02-Dec-2019 05:19:52.079 EST >> cmd: Begin processing the 108th record. Run 1, Event 385, LumiSection 23325 at 02-Dec-2019 05:19:57.092 EST >> cmd: %MSG-w InvalidHelix: SeedCreatorFromRegionConsecutiveHitsEDProducer:hltFullIter9TobTecSeedsTripl 02-Dec-2019 05:19:57 EST Run: 1 Event: 376 >> cmd: PixelClusterShapeSeedComparitor helix is not valid, result is bad >> cmd: %MSG >> cmd: Begin processing the 109th record. Run 1, Event 381, LumiSection 23325 at 02-Dec-2019 05:19:58.903 EST >> cmd: Begin processing the 110th record. Run 1, Event 382, LumiSection 23325 at 02-Dec-2019 05:20:00.466 EST >> cmd: %MSG-w Muon: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIHit 02-Dec-2019 05:20:00 EST Run: 1 Event: 343 >> cmd: Propagation to the PCA using TSCPBuilderNoMaterial failed! This can cause a severe bug. >> cmd: %MSG >> cmd: %MSG-w RecoMuon: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIHit 02-Dec-2019 05:20:00 EST Run: 1 Event: 343 >> cmd: Propagation to the PCA using TSCPBuilderNoMaterial failed! This can cause a severe bug. >> cmd: %MSG >> cmd: %MSG-w MuonUpdatorAtVertex: L3MuonProducer:hltL3NoFiltersNoVtxMuonsOIHit 02-Dec-2019 05:20:00 EST Run: 1 Event: 343 >> cmd: Propagation to the PCA using TSCPBuilderNoMaterial failed! This can cause a severe bug. >> cmd: %MSG >> cmd: Begin processing the 111th record. Run 1, Event 383, LumiSection 23325 at 02-Dec-2019 05:20:01.602 EST >> cmd: [2019-12-02 05:20:02.022101 -0500][Error ][File ] [0x40454200@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/gs_step_ttHJet_HanV4ttXJetStartPtChecks_run0/HIG-RunIIFall17wmLHEGS-00040ND_211314.root] Fatal file state error. Message kXR_read (handle: 0x00000000, offset: 109144076, size: 5938) returned with [ERROR] Server responded with an error: [3005] Unable to read /store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/gs_step_ttHJet_HanV4ttXJetStartPtChecks_run0/HIG-RunIIFall17wmLHEGS-00040ND_211314.root; unknown error 255 >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 02-Dec-2019 05:20:02 EST pre-events >> cmd: XrdRequestManager::handle(name='root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/gs_step_ttHJet_HanV4ttXJetStartPtChecks_run0/HIG-RunIIFall17wmLHEGS-00040ND_211314.root) failure when reading from primeradiant05.crc.nd.edu:1096 (site T3_US_NotreDame); failed with error '[ERROR] Server responded with an error: [3005] Unable to read /store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/gs_step_ttHJet_HanV4ttXJetStartPtChecks_run0/HIG-RunIIFall17wmLHEGS-00040ND_211314.root; unknown error 255 >> cmd: ' (errno=3005, code=400). >> cmd: %MSG >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 02-Dec-2019 05:20:02 EST pre-events >> cmd: Request failure when reading from primeradiant05.crc.nd.edu:1096 (site T3_US_NotreDame) >> cmd: %MSG >> cmd: %MSG-w XrdAdaptor: (NoModuleName) 02-Dec-2019 05:20:02 EST pre-events >> cmd: Data is now served from instead of previous T3_US_NotreDame >> cmd: %MSG >> cmd: [2019-12-02 05:20:02.298846 -0500][Error ][AsyncSock ] [primeradiant05.crc.nd.edu:1096 #0.0] Socket error encountered: [ERROR] Socket error: Resource temporarily unavailable >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 02-Dec-2019 05:23:12 EST pre-events >> cmd: Caught a CMSSW exception when running connection recovery. >> cmd: %MSG >> cmd: ----- Begin Fatal Exception 02-Dec-2019 05:23:12 EST----------------------- >> cmd: An exception of category 'FileReadError' occurred while >> cmd: [0] Rethrowing an exception that happened on a different thread. >> cmd: [1] Reading branch edmRandomEngineStates_randomEngineStateProducer__SIM. >> cmd: [2] XrdAdaptor::ClientRequest::HandleResponse() failure while running connection recovery >> cmd: [3] In XrdAdaptor::RequestManager::requestFailure() >> cmd: Exception Message: >> cmd: XrdAdaptor::RequestManager::requestFailure Open(name='root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/gs_step_ttHJet_HanV4ttXJetStartPtChecks_run0/HIG-RunIIFall17wmLHEGS-00040ND_211314.root', flags=0x10, permissions=0660, old source=primeradiant05.crc.nd.edu:1096 (site T3_US_NotreDame)) => timeout when waiting for file open >> cmd: Additional Info: >> cmd: [a] Original error: '[ERROR] Server responded with an error: [3005] Unable to read /store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/gs_step_ttHJet_HanV4ttXJetStartPtChecks_run0/HIG-RunIIFall17wmLHEGS-00040ND_211314.root; unknown error 255 >> cmd: ' (errno=3005, code=400, source=primeradiant05.crc.nd.edu:1096 (site T3_US_NotreDame)). >> cmd: [b] Disabled source: primeradiant05.crc.nd.edu:1096 >> cmd: ----- End Fatal Exception ------------------------------------------------- >> cmd: Begin processing the 112th record. Run 1, Event 390, LumiSection 23325 at 02-Dec-2019 05:23:12.039 EST >> cmd: %MSG-e L1T: L1TRawToDigi:hltGtStage2Digis 02-Dec-2019 05:23:12 EST Run: 1 Event: 390 >> cmd: Cannot unpack: no FEDRawDataCollection found >> cmd: %MSG >> cmd: ----- Begin Fatal Exception 02-Dec-2019 05:23:12 EST----------------------- >> cmd: An exception of category 'FileReadError' occurred while >> cmd: [0] Rethrowing an exception that happened on a different thread. >> cmd: [1] Reading branch edmRandomEngineStates_randomEngineStateProducer__SIM. >> cmd: [2] XrdAdaptor::ClientRequest::HandleResponse() failure while running connection recovery >> cmd: [3] In XrdAdaptor::RequestManager::requestFailure() >> cmd: Exception Message: >> cmd: XrdAdaptor::RequestManager::requestFailure Open(name='root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/gs_step_ttHJet_HanV4ttXJetStartPtChecks_run0/HIG-RunIIFall17wmLHEGS-00040ND_211314.root', flags=0x10, permissions=0660, old source=primeradiant05.crc.nd.edu:1096 (site T3_US_NotreDame)) => timeout when waiting for file open >> cmd: Additional Info: >> cmd: [a] Original error: '[ERROR] Server responded with an error: [3005] Unable to read /store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/gs_step_ttHJet_HanV4ttXJetStartPtChecks_run0/HIG-RunIIFall17wmLHEGS-00040ND_211314.root; unknown error 255 >> cmd: ' (errno=3005, code=400, source=primeradiant05.crc.nd.edu:1096 (site T3_US_NotreDame)). >> cmd: [b] Disabled source: primeradiant05.crc.nd.edu:1096 >> cmd: ----- End Fatal Exception ------------------------------------------------- >> cmd: ----- Begin Fatal Exception 02-Dec-2019 05:23:12 EST----------------------- >> cmd: An exception of category 'FileReadError' occurred while >> cmd: [0] Rethrowing an exception that happened on a different thread. >> cmd: [1] Reading branch edmRandomEngineStates_randomEngineStateProducer__SIM. >> cmd: [2] XrdAdaptor::ClientRequest::HandleResponse() failure while running connection recovery >> cmd: [3] In XrdAdaptor::RequestManager::requestFailure() >> cmd: Exception Message: >> cmd: XrdAdaptor::RequestManager::requestFailure Open(name='root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/gs_step_ttHJet_HanV4ttXJetStartPtChecks_run0/HIG-RunIIFall17wmLHEGS-00040ND_211314.root', flags=0x10, permissions=0660, old source=primeradiant05.crc.nd.edu:1096 (site T3_US_NotreDame)) => timeout when waiting for file open >> cmd: Additional Info: >> cmd: [a] Original error: '[ERROR] Server responded with an error: [3005] Unable to read /store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/gs_step_ttHJet_HanV4ttXJetStartPtChecks_run0/HIG-RunIIFall17wmLHEGS-00040ND_211314.root; unknown error 255 >> cmd: ' (errno=3005, code=400, source=primeradiant05.crc.nd.edu:1096 (site T3_US_NotreDame)). >> cmd: [b] Disabled source: primeradiant05.crc.nd.edu:1096 >> cmd: ----- End Fatal Exception ------------------------------------------------- >> cmd: [2019-12-02 05:23:13.038521 -0500][Error ][XRootD ] [deepthought.crc.nd.edu:1094] Impossible to send message kXR_open (file: /store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/gs_step_ttHJet_HanV4ttXJetStartPtChecks_run0/HIG-RunIIFall17wmLHEGS-00040ND_211314.root?tried=primeradiant05.crc.nd.edu, mode: 0460, flags: kXR_open_read kXR_async kXR_retstat ). Trying to recover. >> cmd: [2019-12-02 05:23:13.038649 -0500][Error ][XRootD ] [deepthought.crc.nd.edu:1094] Unable to get the response to request kXR_open (file: /store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/gs_step_ttHJet_HanV4ttXJetStartPtChecks_run0/HIG-RunIIFall17wmLHEGS-00040ND_211314.root?tried=primeradiant05.crc.nd.edu, mode: 0460, flags: kXR_open_read kXR_async kXR_retstat ) >> cmd: %MSG-e CaloHitResponse: DataMixingModule:mixData 02-Dec-2019 05:23:13 EST Run: 1 Event: 383 >> cmd: Mismatched calo signals >> cmd: %MSG >> cmd: ----- Begin Fatal Exception 02-Dec-2019 05:23:14 EST----------------------- >> cmd: An exception of category 'FileReadError' occurred while >> cmd: [0] Rethrowing an exception that happened on a different thread. >> cmd: [1] Reading branch edmRandomEngineStates_randomEngineStateProducer__SIM. >> cmd: [2] XrdAdaptor::ClientRequest::HandleResponse() failure while running connection recovery >> cmd: [3] In XrdAdaptor::RequestManager::requestFailure() >> cmd: Exception Message: >> cmd: XrdAdaptor::RequestManager::requestFailure Open(name='root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/gs_step_ttHJet_HanV4ttXJetStartPtChecks_run0/HIG-RunIIFall17wmLHEGS-00040ND_211314.root', flags=0x10, permissions=0660, old source=primeradiant05.crc.nd.edu:1096 (site T3_US_NotreDame)) => timeout when waiting for file open >> cmd: Additional Info: >> cmd: [a] Original error: '[ERROR] Server responded with an error: [3005] Unable to read /store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/gs_step_ttHJet_HanV4ttXJetStartPtChecks_run0/HIG-RunIIFall17wmLHEGS-00040ND_211314.root; unknown error 255 >> cmd: ' (errno=3005, code=400, source=primeradiant05.crc.nd.edu:1096 (site T3_US_NotreDame)). >> cmd: [b] Disabled source: primeradiant05.crc.nd.edu:1096 >> cmd: ----- End Fatal Exception ------------------------------------------------- >> cmd: ----- Begin Fatal Exception 02-Dec-2019 05:23:18 EST----------------------- >> cmd: An exception of category 'FileReadError' occurred while >> cmd: [0] Rethrowing an exception that happened on a different thread. >> cmd: [1] Reading branch edmRandomEngineStates_randomEngineStateProducer__SIM. >> cmd: [2] XrdAdaptor::ClientRequest::HandleResponse() failure while running connection recovery >> cmd: [3] In XrdAdaptor::RequestManager::requestFailure() >> cmd: Exception Message: >> cmd: XrdAdaptor::RequestManager::requestFailure Open(name='root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/gs_step_ttHJet_HanV4ttXJetStartPtChecks_run0/HIG-RunIIFall17wmLHEGS-00040ND_211314.root', flags=0x10, permissions=0660, old source=primeradiant05.crc.nd.edu:1096 (site T3_US_NotreDame)) => timeout when waiting for file open >> cmd: Additional Info: >> cmd: [a] Original error: '[ERROR] Server responded with an error: [3005] Unable to read /store/user/kmohrman/FullProduction/Round6/Batch7/postLHE_step/v2/gs_step_ttHJet_HanV4ttXJetStartPtChecks_run0/HIG-RunIIFall17wmLHEGS-00040ND_211314.root; unknown error 255 >> cmd: ' (errno=3005, code=400, source=primeradiant05.crc.nd.edu:1096 (site T3_US_NotreDame)). >> cmd: [b] Disabled source: primeradiant05.crc.nd.edu:1096 >> cmd: ----- End Fatal Exception ------------------------------------------------- >> cmd: >> cmd: >> cmd: A fatal system signal has occurred: segmentation violation >> cmd: The following is the call stack containing the origin of the signal. >> cmd: >> cmd: >> cmd: Current Modules: >> cmd: >> cmd: Module: none (crashed) >> cmd: Module: none >> cmd: Module: none >> cmd: Module: none >> cmd: Module: EndPathStatusInserter:HLTAnalyzerEndpath >> cmd: Module: none >> cmd: >> cmd: A fatal system signal has occurred: segmentation violation >>> executable returned with exit code -11. @ Mon Dec 2 05:23:31 2019 >> trace: Traceback (most recent call last): >> trace: File "task.py", line 268, in wrapper >> trace: result = fct(data, *args, **kwargs) >> trace: File "task.py", line 897, in parse_fwk_report >> trace: report.parse(report_filename) >> trace: File "/disk/vc3-root/tmp/worker-230547-10203/t.229966/python/WMCore/FwkJobReport/Report.py", line 160, in parse >> trace: raise FwkJobReportException(msg) >> trace: FwkJobReportException: FwkJobReportException >> trace: Message: Error reading XML job report file, possibly corrupt XML File: >> trace: Details: no element found: line 364, column 0 >> trace: ModuleName : WMCore.FwkJobReport.Report >> trace: MethodName : parse >> trace: ClassInstance : None >> trace: FileName : /disk/vc3-root/tmp/worker-230547-10203/t.229966/python/WMCore/FwkJobReport/Report.py >> trace: ClassName : None >> trace: LineNumber : 160 >> trace: ErrorNr : 0 >> trace: >> trace: Traceback: >> trace: File "/disk/vc3-root/tmp/worker-230547-10203/t.229966/python/WMCore/FwkJobReport/Report.py", line 147, in parse >> trace: xmlToJobReport(self, xmlfile) >> trace: >> trace: File "/disk/vc3-root/tmp/worker-230547-10203/t.229966/python/WMCore/FwkJobReport/XMLParser.py", line 495, in xmlToJobReport >> trace: node = xmlFileToNode(xmlFile) >> trace: >> trace: File "/disk/vc3-root/tmp/worker-230547-10203/t.229966/python/WMCore/Algorithms/ParseXMLFile.py", line 67, in xmlFileToNode >> trace: build(node)) >> trace: >> trace: File "/disk/vc3-root/tmp/worker-230547-10203/t.229966/python/WMCore/Algorithms/ParseXMLFile.py", line 88, in expat_parse >> trace: parser.ParseFile(f) >> trace: >> trace: >>>>> call to 'parse_fwk_report' failed, exiting with exit code -11 @ Mon Dec 2 05:23:32 2019 Mon Dec 2 05:10:56 2019: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Mon Dec 2 05:10:56 2019: ApMon[WARNING]: Not sending parameters since no destination is defined. Mon Dec 2 05:10:56 2019: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. Mon Dec 2 05:23:31 2019: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Mon Dec 2 05:23:32 2019: ApMon[WARNING]: Not sending parameters since no destination is defined. Mon Dec 2 05:23:32 2019: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. >> Execution time -1575281434 >> Exiting with code -11 >> Reporting ExeExitCode -11 >> Reporting StageOutSE >> Reporting StageOutExitCode 0 Mon Dec 2 05:23:32 2019: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Mon Dec 2 05:23:32 2019: ApMon[WARNING]: Not sending parameters since no destination is defined. Mon Dec 2 05:23:32 2019: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. ==== working directory after execution @ Mon Dec 2 05:23:33 EST 2019 ==== == dir: total 340068 == dir: drwxr-xr-x 17 kmohrman campus 201 Dec 2 05:10 CMSSW_9_4_0_patch1 == dir: -rw-r--r-- 1 kmohrman campus 291131188 Dec 2 05:20 HIG-RunIIFall17DRPremix-00823ND_step1.root == dir: -rw-r--r-- 2 kmohrman campus 28090622 Dec 2 03:25 HIG-RunIIFall17DRPremix-00823_1_cfg.py == dir: -rw-r--r-- 1 kmohrman campus 28092108 Dec 2 05:10 HIG-RunIIFall17DRPremix-00823_1_cfg_mod.py == dir: drwxr-xr-x 2 kmohrman campus 71 Dec 2 05:09 bin == dir: -rwxr-xr-x 3 kmohrman campus 627272 Dec 2 03:25 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 Dec 2 05:09 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 Dec 2 05:23 cctools-temp-t.229966.CxOLfN == dir: -rw------- 1 kmohrman campus 51 Dec 2 05:10 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 Dec 2 05:10 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 Dec 2 05:09 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 Dec 2 05:09 librmonitor_helper.so.NdPOsR == dir: -rw-r--r-- 2 kmohrman campus 2177 Dec 2 05:09 parameters.json == dir: -rw------- 2 kmohrman campus 9194 Dec 2 05:09 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 Dec 2 05:09 python == dir: -rw-r--r-- 1 kmohrman campus 742 Dec 2 05:23 report.json == dir: -rw-r--r-- 3 kmohrman campus 570 Dec 2 03:25 report.json.in == dir: -rw-r--r-- 1 kmohrman campus 23000 Dec 2 05:23 report.xml == dir: -rw-r--r-- 1 kmohrman campus 1815 Dec 2 05:23 report.xml.gz == dir: -rw-r--r-- 3 kmohrman campus 492 Dec 2 03:25 sandbox-CMSSW_9_4_0_patch1-slc7_amd64_gcc630.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 37 Dec 2 05:09 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 Dec 2 05:10 t_wrapper_ready == dir: -rw-r--r-- 1 kmohrman campus 11 Dec 2 05:10 t_wrapper_start == dir: -rwxr-xr-x 3 kmohrman campus 47217 Dec 2 03:25 task.py == dir: -rwxr-xr-x 3 kmohrman campus 6296 Dec 2 03:25 wrapper.sh === wrapper done @ Mon Dec 2 05:23:33 EST 2019 === final return status = 245 @ Mon Dec 2 05:23:33 EST 2019