==== wrapper started @ Thu Mar 4 19:22:06 EST 2021 ==== == startup: hostname: d8civy001.crc.nd.edu == startup: kernel: Linux d8civy001.crc.nd.edu 3.10.0-1160.el7.x86_64 #1 SMP Tue Aug 18 14:50:17 EDT 2020 x86_64 x86_64 x86_64 GNU/Linux ==== tracing google @ Thu Mar 4 19:22:11 EST 2021 ==== wrapper.sh: line 20: traceroute: command not found ==== environment at startup @ Thu Mar 4 19:22:16 EST 2021 ==== == env: VC3_VERSION_SED=4.2 == env: CCTOOLS_RESOURCE_PROCESS_START=1614903736176685 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: VC3_ROOT_GZIP=/usr/ == env: SHELL=/bin/sh == env: TERM=xterm-256color == env: MAKEFLAGS=-j4 == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-11452/t.7927/cctools-temp-t.7927.NQKyeT == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-11452/t.7927/librmonitor_helper.so.FlOLgv == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: USER=kmohrman == env: TEMP=/disk/vc3-root/tmp/worker-230547-11452/t.7927/cctools-temp-t.7927.NQKyeT == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: LD_LIBRARY_PATH=/.singularity.d/libs == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_ROOT_MAKE=/usr/ == env: VC3_DISTFILES=/disk/vc3-distfiles == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-11452/cache/tmp == env: VC3_VERSION_TAR=1.26 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-CQbKPR == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: VC3_VERSION_GZIP=1.5 == env: VC3_ENV_TAG_GLOBAL=11200 == env: PATH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-CQbKPR == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PWD=/disk/vc3-root/tmp/worker-230547-11452/t.7927 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_FULL_SED=4.2.2 == env: VC3_VERSION_WHICH=2.20 == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-11452 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_ROOT_SED=/usr/ == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: CXX=g++ == env: SHLVL=3 == env: HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_MAKE=3.82 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: DISK=6000 == env: MEMORY=7800 == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: TMP=/disk/vc3-root/tmp/worker-230547-11452/t.7927/cctools-temp-t.7927.NQKyeT == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_VERSION_PKG_CONFIG=0.27 == env: VC3_ROOT_TAR=/usr/ == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-CQbKPR.wrapper == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: CC=gcc == env: CORES=6 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CCTOOLS_RESOURCE_MONITOR_INFO=1025 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_ALL_postLHE_crc.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=18468 == env: _=/usr/bin/env ==== cpu info @ Thu Mar 4 19:22:21 EST 2021 ==== == cpu: processor : 0 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3183.984 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 0 == cpu: cpu cores : 8 == cpu: apicid : 0 == cpu: initial apicid : 0 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.65 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 1 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3140.502 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 1 == cpu: cpu cores : 8 == cpu: apicid : 2 == cpu: initial apicid : 2 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.65 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 2 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3122.412 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 2 == cpu: cpu cores : 8 == cpu: apicid : 4 == cpu: initial apicid : 4 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.65 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 3 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3237.622 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 3 == cpu: cpu cores : 8 == cpu: apicid : 6 == cpu: initial apicid : 6 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.65 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 4 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3044.494 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 4 == cpu: cpu cores : 8 == cpu: apicid : 8 == cpu: initial apicid : 8 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.65 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 5 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3159.069 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 5 == cpu: cpu cores : 8 == cpu: apicid : 10 == cpu: initial apicid : 10 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.65 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 6 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3048.779 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 6 == cpu: cpu cores : 8 == cpu: apicid : 12 == cpu: initial apicid : 12 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.65 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 7 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3234.289 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 7 == cpu: cpu cores : 8 == cpu: apicid : 14 == cpu: initial apicid : 14 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.65 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 8 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3228.417 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 0 == cpu: cpu cores : 8 == cpu: apicid : 32 == cpu: initial apicid : 32 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.13 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 9 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3274.121 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 1 == cpu: cpu cores : 8 == cpu: apicid : 34 == cpu: initial apicid : 34 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.13 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 10 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3199.853 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 2 == cpu: cpu cores : 8 == cpu: apicid : 36 == cpu: initial apicid : 36 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.13 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 11 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3170.495 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 3 == cpu: cpu cores : 8 == cpu: apicid : 38 == cpu: initial apicid : 38 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.13 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 12 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3082.104 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 4 == cpu: cpu cores : 8 == cpu: apicid : 40 == cpu: initial apicid : 40 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.13 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 13 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3065.917 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 5 == cpu: cpu cores : 8 == cpu: apicid : 42 == cpu: initial apicid : 42 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.13 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 14 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 6 == cpu: cpu cores : 8 == cpu: apicid : 44 == cpu: initial apicid : 44 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.13 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 15 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3027.197 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 7 == cpu: cpu cores : 8 == cpu: apicid : 46 == cpu: initial apicid : 46 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.13 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: === using CVMFS proxy: http://eddie.crc.nd.edu:3128 @ Thu Mar 4 19:22:46 EST 2021 === using Frontier proxy: http://eddie.crc.nd.edu:3128 @ Thu Mar 4 19:22:46 EST 2021 === parrot helper: /disk/vc3-root/tmp/worker-230547-11452/t.7927/lib/libparrot_helper.so @ Thu Mar 4 19:22:51 EST 2021 ==== content of /disk/vc3-root/tmp/worker-230547-11452/cache/tmp @ Thu Mar 4 19:22:51 EST 2021 ==== == cache: total 0 === OSG certificate location: /cvmfs/oasis.opensciencegrid.org/mis/certificates @ Thu Mar 4 19:22:56 EST 2021 === testing parrot usage @ Thu Mar 4 19:22:56 EST 2021 === parrot OK @ Thu Mar 4 19:23:01 EST 2021 === starting parrot to access CMSSW... @ Thu Mar 4 19:23:01 EST 2021 ==== wrapper started @ Thu Mar 4 19:23:01 EST 2021 ==== == startup: hostname: d8civy001.crc.nd.edu == startup: kernel: Linux d8civy001.crc.nd.edu 3.10.0-1160.el7.x86_64 #1 SMP Tue Aug 18 14:50:17 EDT 2020 x86_64 x86_64 x86_64 GNU/Linux ==== tracing google @ Thu Mar 4 19:23:01 EST 2021 ==== wrapper.sh: line 20: traceroute: command not found ==== environment at startup @ Thu Mar 4 19:23:01 EST 2021 ==== == env: VC3_VERSION_SED=4.2 == env: CCTOOLS_RESOURCE_PROCESS_START=1614903781685687 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/usr/ == env: LOBSTER_GFAL_COPY= == env: MAKEFLAGS=-j4 == env: PARROT_HELPER=/disk/vc3-root/tmp/worker-230547-11452/t.7927/lib/libparrot_helper.so == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-11452/t.7927/cctools-temp-t.7927.NQKyeT == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-11452/t.7927/librmonitor_helper.so.FlOLgv == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: LD_LIBRARY_PATH=/.singularity.d/libs:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-11452/t.7927/cctools-temp-t.7927.NQKyeT == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/usr/ == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-CQbKPR == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-11452/cache/tmp == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: PARROT_CVMFS_REPO= == env: VC3_VERSION_GZIP=1.5 == env: PATH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ENV_TAG_GLOBAL=11200 == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-CQbKPR == env: PWD=/disk/vc3-root/tmp/worker-230547-11452/t.7927 == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_WHICH=2.20 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: LOBSTER_LCG_CP= == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-11452 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/usr/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: CXX=g++ == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: DISK=6000 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-11452/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-11452/cache/tmp/cvmfs == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=7800 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TMP=/disk/vc3-root/tmp/worker-230547-11452/t.7927/cctools-temp-t.7927.NQKyeT == env: PYTHONPATH=python: == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_ROOT_TAR=/usr/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-CQbKPR.wrapper == env: CC=gcc == env: CCTOOLS_RESOURCE_MONITOR_INFO=1025 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=6 == env: PARROT_DEBUG_FLAGS= == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_ALL_postLHE_crc.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=18468 == env: _=/usr/bin/env ==== cpu info @ Thu Mar 4 19:23:01 EST 2021 ==== == cpu: processor : 0 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3000.219 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 0 == cpu: cpu cores : 8 == cpu: apicid : 0 == cpu: initial apicid : 0 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.65 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 1 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 1 == cpu: cpu cores : 8 == cpu: apicid : 2 == cpu: initial apicid : 2 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.65 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 2 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 2 == cpu: cpu cores : 8 == cpu: apicid : 4 == cpu: initial apicid : 4 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.65 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 3 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 3 == cpu: cpu cores : 8 == cpu: apicid : 6 == cpu: initial apicid : 6 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.65 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 4 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 4 == cpu: cpu cores : 8 == cpu: apicid : 8 == cpu: initial apicid : 8 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.65 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 5 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 5 == cpu: cpu cores : 8 == cpu: apicid : 10 == cpu: initial apicid : 10 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.65 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 6 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3000.061 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 6 == cpu: cpu cores : 8 == cpu: apicid : 12 == cpu: initial apicid : 12 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.65 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 7 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 7 == cpu: cpu cores : 8 == cpu: apicid : 14 == cpu: initial apicid : 14 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.65 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 8 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3005.773 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 0 == cpu: cpu cores : 8 == cpu: apicid : 32 == cpu: initial apicid : 32 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.13 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 9 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3001.965 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 1 == cpu: cpu cores : 8 == cpu: apicid : 34 == cpu: initial apicid : 34 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.13 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 10 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3000.061 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 2 == cpu: cpu cores : 8 == cpu: apicid : 36 == cpu: initial apicid : 36 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.13 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 11 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 3 == cpu: cpu cores : 8 == cpu: apicid : 38 == cpu: initial apicid : 38 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.13 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 12 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 4 == cpu: cpu cores : 8 == cpu: apicid : 40 == cpu: initial apicid : 40 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.13 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 13 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3006.408 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 5 == cpu: cpu cores : 8 == cpu: apicid : 42 == cpu: initial apicid : 42 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.13 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 14 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 6 == cpu: cpu cores : 8 == cpu: apicid : 44 == cpu: initial apicid : 44 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.13 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 15 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3005.773 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 7 == cpu: cpu cores : 8 == cpu: apicid : 46 == cpu: initial apicid : 46 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.13 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: === using parrot @ Thu Mar 4 19:23:02 EST 2021 === sourcing CMS setup @ Thu Mar 4 19:23:02 EST 2021 LibCvmfs version 2.4, revision 25 === sourcing OSG setup @ Thu Mar 4 19:23:06 EST 2021 ==== environment after sourcing startup scripts @ Thu Mar 4 19:23:06 EST 2021 ==== == env: VC3_VERSION_SED=4.2 == env: MANPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/man:/cvmfs/cms.cern.ch/share/man: == env: CCTOOLS_RESOURCE_PROCESS_START=1614903786638283 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: GFAL_PLUGIN_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/gfal2-plugins/ == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/usr/ == env: LOBSTER_GFAL_COPY=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin/gfal-copy == env: VOMS_USERCONF=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/vomses == env: MAKEFLAGS=-j4 == env: GLOBUS_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-11452/t.7927/cctools-temp-t.7927.NQKyeT == env: PERL5LIB=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5 == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: CVSROOT=:gserver:cmssw.cvs.cern.ch:/local/reps/CMSSW == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-11452/t.7927/librmonitor_helper.so.FlOLgv == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: X509_CERT_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/certificates == env: SCRAM_ARCH=slc7_amd64_gcc820 == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: LD_LIBRARY_PATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/dcap:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/lcgdm:/.singularity.d/libs:lib:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-11452/t.7927/cctools-temp-t.7927.NQKyeT == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/usr/ == env: OSG_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-CQbKPR == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-11452/cache/tmp == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: SITECONFIG_PATH=/cvmfs/cms.cern.ch/SITECONF/local == env: PARROT_CVMFS_REPO= == env: VC3_VERSION_GZIP=1.5 == env: PATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/sbin:/cvmfs/cms.cern.ch/common:/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ENV_TAG_GLOBAL=11200 == env: CMS_PATH=/cvmfs/cms.cern.ch == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-CQbKPR == env: PWD=/disk/vc3-root/tmp/worker-230547-11452/t.7927 == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_WHICH=2.20 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: X509_VOMS_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/vomsdir == env: LOBSTER_LCG_CP= == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-11452 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/usr/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: CXX=g++ == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: DISK=6000 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-11452/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-11452/cache/tmp/cvmfs == env: GFAL_CONFIG_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/gfal2.d/ == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=7800 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TMP=/disk/vc3-root/tmp/worker-230547-11452/t.7927/cctools-temp-t.7927.NQKyeT == env: PYTHONPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib/python2.7/site-packages:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/python2.7/site-packages:python:python: == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_ROOT_TAR=/usr/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-CQbKPR.wrapper == env: CC=gcc == env: CCTOOLS_RESOURCE_MONITOR_INFO=1025 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=6 == env: PARROT_DEBUG_FLAGS= == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_ALL_postLHE_crc.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=18468 == env: _=/usr/bin/env ==== proxy information @ Thu Mar 4 19:23:06 EST 2021 ==== == proxy: subject : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman/CN=1808231461 == proxy: issuer : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman == proxy: identity : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman == proxy: type : RFC compliant proxy == proxy: strength : 1024 bits == proxy: path : proxy == proxy: timeleft : 158:22:57 ==== working directory at startup @ Thu Mar 4 19:23:07 EST 2021 ==== == dir: total 4692 == dir: -rw-r--r-- 3 kmohrman campus 3932158 Mar 4 19:22 UL17_DIGI_cfg.py == dir: drwxr-xr-x 2 kmohrman campus 71 Mar 4 19:22 bin == dir: -rwxr-xr-x 3 kmohrman campus 627272 Mar 4 19:22 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 Mar 4 19:22 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 Mar 4 19:22 cctools-temp-t.7927.NQKyeT == dir: -rw------- 1 kmohrman campus 51 Mar 4 19:23 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 Mar 4 19:23 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 Mar 4 19:22 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 Mar 4 19:22 librmonitor_helper.so.FlOLgv == dir: -rw-r--r-- 2 kmohrman campus 2301 Mar 4 19:22 parameters.json == dir: -rw------- 2 kmohrman campus 9921 Mar 4 19:22 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 Mar 4 19:22 python == dir: -rw-r--r-- 3 kmohrman campus 570 Mar 4 19:22 report.json.in == dir: -rw-r--r-- 3 kmohrman campus 593 Mar 4 19:22 sandbox-CMSSW_10_6_17_patch1-slc7_amd64_gcc700.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 37 Mar 4 19:22 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 Mar 4 19:23 t_wrapper_start == dir: -rwxr-xr-x 3 kmohrman campus 47217 Mar 4 19:22 task.py == dir: -rwxr-xr-x 3 kmohrman campus 5986 Mar 4 19:22 wrapper.sh === creating new release CMSSW_10_6_17_patch1 for scram arch slc7_amd64_gcc700 @ Thu Mar 4 19:23:07 EST 2021 WARNING: In non-interactive mode release checks e.g. deprecated releases, production architectures are disabled. === unpacking sandbox-CMSSW_10_6_17_patch1-slc7_amd64_gcc700.tar.bz2 @ Thu Mar 4 19:23:13 EST 2021 ==== machine load @ Thu Mar 4 19:23:15 EST 2021 ==== top: unknown option 'M' Usage: top -hv | -bcHiOSs -d secs -n max -u|U user -p pid(s) -o field -w [cols] ==== environment before execution @ Thu Mar 4 19:23:16 EST 2021 ==== == env: G4LEVELGAMMADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4PhotonEvaporation/5.2/data/PhotonEvaporation5.2 == env: UTM_XSD_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj == env: SRT_G4LEVELGAMMADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4PhotonEvaporation/5.2/data/PhotonEvaporation5.2 == env: VC3_VERSION_SED=4.2 == env: CMSSW_RELEASE_BASE=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1 == env: SCRAMRT_SET=CMSSW:CMSSW_10_6_17_patch1:slc7_amd64_gcc700:V2_2_9_pre12:SRT_ == env: MANPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/man:/cvmfs/cms.cern.ch/share/man: == env: CCTOOLS_RESOURCE_PROCESS_START=1614903796182922 == env: CMSSW_FWLITE_INCLUDE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include == env: SRT_GCC_RUNTIME_ASAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: ROOT_INCLUDE_PATH=/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/include/slc7_amd64_gcc700/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/include/LCG:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mctester/1.25.0a-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dd4hep/v01-10x-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtDesigner:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauolapp/1.1.5-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/charybdis/1.003-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include/SHERPA-MC:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtOpenGL:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtGui:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwig/6.521-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt3Support:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lwtnn/2.4-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4/10.4.3-pafccj2/include/Geant4:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/classlib/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cgal/4.2-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tkonlinesw/4.2.0-1_gcc7-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/starlight/r193-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtCore:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtXml:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mcdb/1.0.3-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libungif/4.1.4-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libtiff/4.0.3-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/highfive/2.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libpng/1.6.16-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pcre/8.37-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/include/xrootd/private:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/vdt/0.4.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/toprex/4.23-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tbb/2019_U3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauola/27.121.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sigcpp/2.6.2-pafccj/include/sigc++-2.0:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sqlite/3.22.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/protobuf/3.5.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pacparser/1.3.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/oracle/12.1.0.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/py2-numpy/1.16.2-nmpfii2/c-api/core/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/meschach/1.2.pCMS1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libuuid/2.22.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libunwind/1.2.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libhepml/0.2.1-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ktjet/1.06-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jimmy/4.2-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jemalloc/5.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hls/2019.08/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj10:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hector/1.3.4_patch1-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libjpeg-turbo/2.0.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/giflib/4.2.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gsl/2.2.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gdbm/1.10-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/freetype/2.5.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftw3/3.3.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftjet/1.5.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/expat/2.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dpm/1.8.0.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vecgeom/v00.05.00-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xerces-c/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xz/5.2.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dcap/2.47.8-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libxml2/2.9.1-pafccj/include/libxml2:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/curl/7.59.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cppunit/1.40.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openssl/1.0.2d-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia6/426-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/photos/215.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/zlib-x86_64/1.2.11-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/bz2lib/1.0.6-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/include/python2.7:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tinyxml2/6.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ittnotify/16.06.18-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj/include:/usr/local/include:/usr/include == env: INTEL_LICENSE_FILE=28518@lxlicen01.cern.ch,28518@lxlicen02.cern.ch,28518@lxlicen03.cern.ch == env: SRT_TEXMFHOME_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/share/Rivet/texmf == env: SRT_GEANT4_PARFULLCMS_CONFIG_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-parfullcms/2014.01.27-pafccj2/share/ParFullCMS == env: GFAL_PLUGIN_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/gfal2-plugins/ == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/usr/ == env: LOBSTER_GFAL_COPY=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin/gfal-copy == env: PDFPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/share == env: CMSSW_FULL_RELEASE_BASE=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17 == env: SRT_TNS_ADMIN_SCRAMRTDEL=/etc == env: VOMS_USERCONF=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/vomses == env: MAKEFLAGS=-j4 == env: ROOT_GCC_TOOLCHAIN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: GLOBUS_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-11452/t.7927/cctools-temp-t.7927.NQKyeT == env: G4FORCENUMBEROFTHREADS=max == env: OPENBLAS_NUM_THREADS=1 == env: SRT_PDFPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/share == env: PERL5LIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5 == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: CMSSW_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms == env: LHAPDF_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/share/LHAPDF == env: CVSROOT=:gserver:cmssw.cvs.cern.ch:/local/reps/CMSSW == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-11452/t.7927/librmonitor_helper.so.FlOLgv == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: CMSSW_GIT_HASH=CMSSW_10_6_17_patch1 == env: SRT_G4ABLADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ABLA/3.0/data/G4ABLA3.0 == env: QTDIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2 == env: SRT_SCONS_LIB_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/scons/3.0.1-pafccj/lib == env: OLDPWD=/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1 == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: G4NEUTRONXSDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NEUTRONXS/1.4/data/G4NEUTRONXS1.4 == env: QTINC=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include == env: X509_CERT_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/certificates == env: SCRAM_ARCH=slc7_amd64_gcc700 == env: GIT_SSL_CAINFO=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/ssl/certs/ca-bundle.crt == env: SRT_CMS_OPENLOOPS_PREFIX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openloops/2.1.0-pafccj2 == env: SRT_GIT_EXEC_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/libexec/git-core == env: SRT_THEPEGPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj/share/ThePEG == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: ROOT_TTREECACHE_SIZE=0 == env: EVTGENDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/evtgen/1.6.0-pafccj5/share == env: SRT_INTEL_LICENSE_FILE_SCRAMRTDEL=28518@lxlicen01.cern.ch,28518@lxlicen02.cern.ch,28518@lxlicen03.cern.ch == env: SRT_ROOT_INCLUDE_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/include/slc7_amd64_gcc700/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/include/LCG:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mctester/1.25.0a-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dd4hep/v01-10x-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtDesigner:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauolapp/1.1.5-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/charybdis/1.003-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include/SHERPA-MC:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtOpenGL:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtGui:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwig/6.521-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt3Support:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lwtnn/2.4-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4/10.4.3-pafccj2/include/Geant4:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/classlib/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cgal/4.2-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tkonlinesw/4.2.0-1_gcc7-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/starlight/r193-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtCore:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtXml:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mcdb/1.0.3-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libungif/4.1.4-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libtiff/4.0.3-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/highfive/2.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libpng/1.6.16-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pcre/8.37-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/include/xrootd/private:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/vdt/0.4.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/toprex/4.23-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tbb/2019_U3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauola/27.121.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sigcpp/2.6.2-pafccj/include/sigc++-2.0:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sqlite/3.22.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/protobuf/3.5.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pacparser/1.3.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/oracle/12.1.0.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/py2-numpy/1.16.2-nmpfii2/c-api/core/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/meschach/1.2.pCMS1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libuuid/2.22.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libunwind/1.2.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libhepml/0.2.1-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ktjet/1.06-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jimmy/4.2-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jemalloc/5.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hls/2019.08/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj10:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hector/1.3.4_patch1-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libjpeg-turbo/2.0.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/giflib/4.2.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gsl/2.2.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gdbm/1.10-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/freetype/2.5.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftw3/3.3.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftjet/1.5.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/expat/2.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dpm/1.8.0.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vecgeom/v00.05.00-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xerces-c/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xz/5.2.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dcap/2.47.8-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libxml2/2.9.1-pafccj/include/libxml2:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/curl/7.59.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cppunit/1.40.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openssl/1.0.2d-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia6/426-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/photos/215.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/zlib-x86_64/1.2.11-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/bz2lib/1.0.6-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/include/python2.7:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tinyxml2/6.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ittnotify/16.06.18-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj/include:/usr/local/include:/usr/include == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: G4LEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4EMLOW/7.3/data/G4EMLOW7.3 == env: SRT_VINCIADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vincia/2.2.04-pafccj5/share/Vincia/xmldoc == env: SRT_ROOT_TTREECACHE_PREFILL_SCRAMRTDEL=0 == env: OPAL_PREFIX=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openmpi/2.1.5-pafccj == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: ROOT_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj10:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: SHERPA_INCLUDE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include/SHERPA-MC == env: SRT_LHAPDF_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/share/LHAPDF == env: SRT_PYTHON27PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1/python:/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch-tool-conf/CMSSW_10_6_17/lib/python2.7/site-packages == env: LD_LIBRARY_PATH=/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1/biglib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/biglib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/biglib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cuda/10.1.105-pafccj2/drivers:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/dcap:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/lcgdm:/.singularity.d/libs:lib:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-11452/t.7927/cctools-temp-t.7927.NQKyeT == env: SRT_CMSSW_RELEASE_BASE_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1 == env: SRT_RIVET_ANALYSIS_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/lib == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: SRT_PERL5LIB_SCRAMRT=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/perl5 == env: SRT_CMSSW_VERSION_SCRAMRTDEL=CMSSW_10_6_17_patch1 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/usr/ == env: GCC_RUNTIME_LSAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: SCRAM_CXX11_ABI=1 == env: VALGRIND_LIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/lib/valgrind == env: SRT_CMSSW_GIT_HASH_SCRAMRTDEL=CMSSW_10_6_17_patch1 == env: SRT_ROOTSYS_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/ == env: OSG_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-CQbKPR == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-11452/cache/tmp == env: G4NEUTRONHPDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NDL/4.5/data/G4NDL4.5 == env: GEANT4_PARFULLCMS_CONFIG_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-parfullcms/2014.01.27-pafccj2/share/ParFullCMS == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: CSC_TRACK_FINDER_DATA_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/CSCTrackFinderEmulation/1.2-pafccj/data/ == env: SRT_QTINC_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: G4ENSDFSTATEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ENSDFSTATE/2.2/data/G4ENSDFSTATE2.2 == env: G4RADIOACTIVEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4RadioactiveDecay/5.2/data/RadioactiveDecay5.2 == env: ROOFITSYS=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/ == env: SRT_ROOFITSYS_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/ == env: SRT_G4RADIOACTIVEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4RadioactiveDecay/5.2/data/RadioactiveDecay5.2 == env: SRT_G4ENSDFSTATEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ENSDFSTATE/2.2/data/G4ENSDFSTATE2.2 == env: SRT_CLHEP_PARAM_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2 == env: G4ABLADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ABLA/3.0/data/G4ABLA3.0 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: SRT_SHERPA_INCLUDE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include/SHERPA-MC == env: SRT_G4FORCENUMBEROFTHREADS_SCRAMRTDEL=max == env: SRT_WORKER_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/blackhat/0.9.9-pafccj/share/blackhat/datafiles/ == env: SITECONFIG_PATH=/cvmfs/cms.cern.ch/SITECONF/local == env: PARROT_CVMFS_REPO= == env: VC3_VERSION_GZIP=1.5 == env: GCC_RUNTIME_TSAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libtsan.so == env: TNS_ADMIN=/etc == env: SRT_HEPPDT_PARAM_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj == env: PATH=/cvmfs/cms.cern.ch/share/overrides/bin:/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1/bin/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/sbin:/cvmfs/cms.cern.ch/common:/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ENV_TAG_GLOBAL=11200 == env: THEPEGPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj/share/ThePEG == env: SRT_CMSSW_SEARCH_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1/poison:/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1/src:/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/data:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/poison:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/data == env: SRT_GIT_SSL_CAINFO_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/ssl/certs/ca-bundle.crt == env: SRT_GCC_RUNTIME_LSAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: CMS_PATH=/cvmfs/cms.cern.ch == env: VC3_ROOT=/disk/vc3-root == env: SRT_UTM_XSD_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj == env: SRT_PATH_SCRAMRT=/cvmfs/cms.cern.ch/share/overrides/bin:/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1/bin/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/bin == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-CQbKPR == env: RIVET_ANALYSIS_PATH=/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/lib == env: SRT_LOCALRT_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1 == env: SRT_CMSSW_BASE_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1 == env: PWD=/disk/vc3-root/tmp/worker-230547-11452/t.7927 == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: PYTHON_VALGRIND_SUPP=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/share/valgrind/valgrind-python.supp == env: SRT_OPAL_PREFIX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openmpi/2.1.5-pafccj == env: VC3_VERSION_WHICH=2.20 == env: GCC_RUNTIME_UBSAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libubsan.so == env: LANG=C == env: SRT_QTDIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: SRT_G4NEUTRONHPDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NDL/4.5/data/G4NDL4.5 == env: X509_VOMS_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/vomsdir == env: LOBSTER_LCG_CP= == env: SRT_SHERPA_SHARE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/share/SHERPA-MC == env: SRT_GCC_RUNTIME_TSAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libtsan.so == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-11452 == env: CASCADE_PDFPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/share == env: SRT_ROOT_GCC_TOOLCHAIN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: SRT_CASCADE_PDFPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/share == env: WORKER_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/blackhat/0.9.9-pafccj/share/blackhat/datafiles/ == env: GIT_TEMPLATE_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/git-core/templates == env: G4SAIDXSDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4SAIDDATA/1.1/data/G4SAIDDATA1.1 == env: MLAS_DYNAMIC_CPU_ARCH=0 == env: SRT_CMSSW_FULL_RELEASE_BASE_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: PYTHON27PATH=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1/python:/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch-tool-conf/CMSSW_10_6_17/lib/python2.7/site-packages == env: SRT_CMSSW_FWLITE_INCLUDE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/usr/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: ROOTSYS=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/ == env: SRT_PYTHIA8DATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/share/Pythia8/xmldoc == env: SRT_HERWIGPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj/share/Herwig == env: CXX=g++ == env: SRT_QTLIB_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/lib == env: SRT_PYTHON3PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1/python:/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch-tool-conf/CMSSW_10_6_17/lib/python3.6/site-packages == env: SHERPA_LIBRARY_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/lib/SHERPA-MC == env: SRT_PYTHON_VALGRIND_SUPP_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/share/valgrind/valgrind-python.supp == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: CMSSW_SEARCH_PATH=/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1/poison:/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1/src:/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/data:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/poison:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/data == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: GENEVA_DATA_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geneva/1.0-RC3-pafccj8/share/Geneva == env: DISK=6000 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-11452/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-11452/cache/tmp/cvmfs == env: GOSAMCONTRIB_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: ROOT_TTREECACHE_PREFILL=0 == env: GENREFLEX=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/bin/genreflex == env: VINCIADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vincia/2.2.04-pafccj5/share/Vincia/xmldoc == env: SRT_G4LEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4EMLOW/7.3/data/G4EMLOW7.3 == env: SRT_GENREFLEX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/bin/genreflex == env: SRT_GOSAMCONTRIB_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: SRT_ROOT_TTREECACHE_SIZE_SCRAMRTDEL=0 == env: SRT_EVTGENDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/evtgen/1.6.0-pafccj5/share == env: SRT_GENEVA_DATA_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geneva/1.0-RC3-pafccj8/share/Geneva == env: GFAL_CONFIG_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/gfal2.d/ == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=7800 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: SRT_CMSSW_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms == env: HEPPDT_PARAM_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj == env: SRT_LD_LIBRARY_PATH_SCRAMRT=/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1/biglib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/biglib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/biglib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cuda/10.1.105-pafccj2/drivers == env: TMP=/disk/vc3-root/tmp/worker-230547-11452/t.7927/cctools-temp-t.7927.NQKyeT == env: PYTHONPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib/python2.7/site-packages:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/python2.7/site-packages:python:python: == env: PYTHON3PATH=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1/python:/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch-tool-conf/CMSSW_10_6_17/lib/python3.6/site-packages == env: QTLIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/lib == env: SCONS_LIB_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/scons/3.0.1-pafccj/lib == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: COMPILER_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: FRONTIER_CLIENT=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/ == env: SRT_G4NEUTRONXSDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NEUTRONXS/1.4/data/G4NEUTRONXS1.4 == env: SRT_SHERPA_LIBRARY_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/lib/SHERPA-MC == env: VC3_ROOT_TAR=/usr/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CLHEP_PARAM_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2 == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-CQbKPR.wrapper == env: PYTHIA8DATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/share/Pythia8/xmldoc == env: HERWIGPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj/share/Herwig == env: SRT_FRONTIER_CLIENT_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/ == env: SRT_COMPILER_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: SRT_CSC_TRACK_FINDER_DATA_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/CSCTrackFinderEmulation/1.2-pafccj/data/ == env: GCC_RUNTIME_ASAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: SRT_ROOT_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj10:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: CC=gcc == env: TEXMFHOME=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/share/Rivet/texmf == env: SRT_MLAS_DYNAMIC_CPU_ARCH_SCRAMRTDEL=0 == env: SRT_OPENBLAS_NUM_THREADS_SCRAMRTDEL=1 == env: SRT_GIT_TEMPLATE_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/git-core/templates == env: SRT_G4SAIDXSDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4SAIDDATA/1.1/data/G4SAIDDATA1.1 == env: CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: SRT_GCC_RUNTIME_UBSAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libubsan.so == env: SRT_LANG_SCRAMRTDEL=C == env: CCTOOLS_RESOURCE_MONITOR_INFO=1025 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=6 == env: PARROT_DEBUG_FLAGS= == env: SHERPA_SHARE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/share/SHERPA-MC == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: CMS_OPENLOOPS_PREFIX=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openloops/2.1.0-pafccj2 == env: GIT_EXEC_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/libexec/git-core == env: LOCALRT=/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1 == env: CMSSW_BASE=/disk/vc3-root/tmp/worker-230547-11452/t.7927/CMSSW_10_6_17_patch1 == env: SRT_SCRAM_CXX11_ABI_SCRAMRTDEL=1 == env: SRT_VALGRIND_LIB_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/lib/valgrind == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_ALL_postLHE_crc.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=18468 == env: _=/usr/bin/env === wrapper ready @ Thu Mar 4 19:23:18 EST 2021 ==== working directory before execution @ Thu Mar 4 19:23:18 EST 2021 ==== == dir: total 4700 == dir: drwxr-xr-x 18 kmohrman campus 215 Mar 4 19:23 CMSSW_10_6_17_patch1 == dir: -rw-r--r-- 3 kmohrman campus 3932158 Mar 4 19:22 UL17_DIGI_cfg.py == dir: drwxr-xr-x 2 kmohrman campus 71 Mar 4 19:22 bin == dir: -rwxr-xr-x 3 kmohrman campus 627272 Mar 4 19:22 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 Mar 4 19:22 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 Mar 4 19:22 cctools-temp-t.7927.NQKyeT == dir: -rw------- 1 kmohrman campus 51 Mar 4 19:23 cvmfschecksum.cms-ib.cern.ch == dir: -rw------- 1 kmohrman campus 51 Mar 4 19:23 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 Mar 4 19:23 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 Mar 4 19:22 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 Mar 4 19:22 librmonitor_helper.so.FlOLgv == dir: -rw-r--r-- 2 kmohrman campus 2301 Mar 4 19:22 parameters.json == dir: -rw------- 2 kmohrman campus 9921 Mar 4 19:22 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 Mar 4 19:22 python == dir: -rw-r--r-- 3 kmohrman campus 570 Mar 4 19:22 report.json.in == dir: -rw-r--r-- 3 kmohrman campus 593 Mar 4 19:22 sandbox-CMSSW_10_6_17_patch1-slc7_amd64_gcc700.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 37 Mar 4 19:22 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 Mar 4 19:23 t_wrapper_ready == dir: -rw-r--r-- 1 kmohrman campus 11 Mar 4 19:23 t_wrapper_start == dir: -rwxr-xr-x 3 kmohrman campus 47217 Mar 4 19:22 task.py == dir: -rwxr-xr-x 3 kmohrman campus 5986 Mar 4 19:22 wrapper.sh >>> data is {u'files': {u'info': {}, u'output_info': {}, u'skipped': []}, u'cpu_time': 0, u'exe_exit_code': 0, u'events_written': 0, u'output_size': 0, u'task_exit_code': 0, u'output_storage_element': u'', u'cache': {u'start_size': 0, u'type': 2, u'end_size': 0}, u'stageout_exit_code': 0, u'output_bare_size': 0, u'transfers': defaultdict(, {}), u'task_timing': {u'wrapper_ready': 0, u'wrapper_start': 0, u'prologue_end': 0, u'epilogue_end': 0, u'stage_out_end': 0, u'stage_in_end': 0, u'processing_end': 0}, u'events_per_run': 0} @ Thu Mar 4 19:23:29 2021 >>> Trying hdfs client access method @ Thu Mar 4 19:23:29 2021 >>> executing 'timeout 300 hdfs dfs -fs hdfs://eddie.crc.nd.edu:19000 -get /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/sim_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/SIM-00000_4170.root SIM-00000_4170.root' @ Thu Mar 4 19:23:29 2021 >> using /disk/vc3-root/tmp/worker-230547-11452/t.7927/cctools-temp-t.7927.NQKyeT/tmp5JaB72 to store command output >> cmd: timeout: failed to run command 'hdfs': No such file or directory >>>>> Unable to copy input with hdfs client @ Thu Mar 4 19:23:29 2021 >>> Trying xrootd access method @ Thu Mar 4 19:23:29 2021 >>> executing 'env XRD_LOGLEVEL=Debug timeout 300 xrdfs deepthought.crc.nd.edu stat /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/sim_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/SIM-00000_4170.root' @ Thu Mar 4 19:23:29 2021 >> using /disk/vc3-root/tmp/worker-230547-11452/t.7927/cctools-temp-t.7927.NQKyeT/tmpylrJjK to store command output >> cmd: [2021-03-04 19:23:30.393362 -0500][Warning][Utility ] Unable to process global config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-04 19:23:30.394416 -0500][Debug ][Utility ] Unable to process user config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-04 19:23:30.394584 -0500][Debug ][PlugInMgr ] Initializing plug-in manager... >> cmd: [2021-03-04 19:23:30.394636 -0500][Debug ][PlugInMgr ] No default plug-in, loading plug-in configs... >> cmd: [2021-03-04 19:23:30.394682 -0500][Debug ][PlugInMgr ] Processing plug-in definitions in /etc/xrootd/client.plugins.d... >> cmd: [2021-03-04 19:23:30.394785 -0500][Debug ][PlugInMgr ] Unable to process directory /etc/xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-04 19:23:30.395120 -0500][Debug ][PlugInMgr ] Processing plug-in definitions in /tmp/runos_singularity_home-102140030779863162787922949639420189459/.xrootd/client.plugins.d... >> cmd: [2021-03-04 19:23:30.395217 -0500][Debug ][PlugInMgr ] Unable to process directory /tmp/runos_singularity_home-102140030779863162787922949639420189459/.xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-04 19:23:30.395403 -0500][Debug ][App ] Executing: stat /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/sim_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/SIM-00000_4170.root >> cmd: [2021-03-04 19:23:30.395516 -0500][Debug ][Poller ] Available pollers: built-in >> cmd: [2021-03-04 19:23:30.395562 -0500][Debug ][Poller ] Attempting to create a poller according to preference: built-in >> cmd: [2021-03-04 19:23:30.395605 -0500][Debug ][Poller ] Creating poller: built-in >> cmd: [2021-03-04 19:23:30.395654 -0500][Debug ][Poller ] Creating and starting the built-in poller... >> cmd: [2021-03-04 19:23:30.396033 -0500][Debug ][Poller ] Using 1 poller threads >> cmd: [2021-03-04 19:23:30.396090 -0500][Debug ][TaskMgr ] Starting the task manager... >> cmd: [2021-03-04 19:23:30.396232 -0500][Debug ][TaskMgr ] Task manager started >> cmd: [2021-03-04 19:23:30.396284 -0500][Debug ][JobMgr ] Starting the job manager... >> cmd: [2021-03-04 19:23:30.396652 -0500][Debug ][JobMgr ] Job manager started, 3 workers >> cmd: [2021-03-04 19:23:30.396708 -0500][Debug ][TaskMgr ] Registering task: "FileTimer task" to be run at: [2021-03-04 19:23:30 -0500] >> cmd: [2021-03-04 19:23:30.396787 -0500][Debug ][PostMaster ] Creating new channel to: deepthought.crc.nd.edu:1094 1 stream(s) >> cmd: [2021-03-04 19:23:30.396854 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-03-04 19:23:30.398328 -0500][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" to be run at: [2021-03-04 19:23:45 -0500] >> cmd: [2021-03-04 19:23:30.399792 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-03-04 19:23:30.399989 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-03-04 19:23:30.400106 -0500][Debug ][Poller ] Adding socket 0x23ea9f0 to the poller >> cmd: [2021-03-04 19:23:30.400450 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2021-03-04 19:23:30.400596 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-03-04 19:23:30.401162 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Got the server hand shake response (type: manager [], protocol version 400) >> cmd: [2021-03-04 19:23:30.401402 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] kXR_protocol successful (type: manager [], protocol version 400) >> cmd: [2021-03-04 19:23:30.405015 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=d8civy001.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-03-04 19:23:30.405466 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Logged in, session: 7fd60f00a60d000093050000a1da0f00 >> cmd: [2021-03-04 19:23:30.405561 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream 0 connected. >> cmd: [2021-03-04 19:23:30.405618 -0500][Debug ][Utility ] Monitor library name not set. No monitoring >> cmd: [2021-03-04 19:23:30.406435 -0500][Debug ][XRootD ] [deepthought.crc.nd.edu:1094] Handling error while processing kXR_stat (path: /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/sim_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/SIM-00000_4170.root, flags: none): [ERROR] Error response: No such file or directory. >> cmd: [2021-03-04 19:23:30.406606 -0500][Error ][App ] Unable stat /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/sim_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/SIM-00000_4170.root: [ERROR] Server responded with an error: [3011] No servers are available to read the file. >> cmd: [ERROR] Server responded with an error: [3011] No servers are available to read the file. >> cmd: >> cmd: [2021-03-04 19:23:30.425374 -0500][Debug ][JobMgr ] Stopping the job manager... >> cmd: [2021-03-04 19:23:30.426115 -0500][Debug ][JobMgr ] Job manager stopped >> cmd: [2021-03-04 19:23:30.426180 -0500][Debug ][TaskMgr ] Stopping the task manager... >> cmd: [2021-03-04 19:23:30.426435 -0500][Debug ][TaskMgr ] Task manager stopped >> cmd: [2021-03-04 19:23:30.426496 -0500][Debug ][Poller ] Stopping the poller... >> cmd: [2021-03-04 19:23:30.426898 -0500][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" >> cmd: [2021-03-04 19:23:30.426959 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-03-04 19:23:30.427015 -0500][Debug ][Poller ] <[::ffff:10.32.78.121]:38376><--><[::ffff:129.74.85.55]:1094> Removing socket from the poller >> cmd: [2021-03-04 19:23:30.427116 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Destroying stream >> cmd: [2021-03-04 19:23:30.427173 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >>> xrootd access to input file unavailable @ Thu Mar 4 19:23:30 2021 >>> Trying srm access method @ Thu Mar 4 19:23:30 2021 >>> executing '/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin/gfal-copy gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/sim_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/SIM-00000_4170.root SIM-00000_4170.root' @ Thu Mar 4 19:23:30 2021 >> using /disk/vc3-root/tmp/worker-230547-11452/t.7927/cctools-temp-t.7927.NQKyeT/tmp84uKmz to store command output >> cmd: Copying 153093217 bytes gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/sim_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/SIM-00000_4170.root => file:///disk/vc3-root/tmp/worker-230547-11452/t.7927/SIM-00000_4170.root >>> Successfully copied input with SRM @ Thu Mar 4 19:23:35 2021 >>> modified input files @ Thu Mar 4 19:23:35 2021 >> input: file:SIM-00000_4170.root >>> updated parameters are @ Thu Mar 4 19:23:35 2021 >> json: { >> json: "accelerate stage-in": 3, >> json: "arguments": [], >> json: "cores": 6, >> json: "default ce": "T3_US_NotreDame", >> json: "default host": "earth.crc.nd.edu", >> json: "default se": "T3_US_NotreDame", >> json: "disable streaming": false, >> json: "epilogue": null, >> json: "executable": "cmsRun", >> json: "file map": { >> json: "file:SIM-00000_4170.root": "sim_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/SIM-00000_4170.root" >> json: }, >> json: "gridpack": false, >> json: "input": [ >> json: "hdfs://eddie.crc.nd.edu:19000/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4", >> json: "file:///hadoop/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/" >> json: ], >> json: "mask": { >> json: "events": -1, >> json: "files": [ >> json: "file:SIM-00000_4170.root" >> json: ], >> json: "lumis": { >> json: "1": [ >> json: [ >> json: 595, >> json: 595 >> json: ] >> json: ] >> json: } >> json: }, >> json: "monitoring": { >> json: "monitorid": null, >> json: "syncid": null, >> json: "taskid": "lobster_kmohrman_EFT_ALL_postLHE_crc_20210304_1732_bcad2768f22f6a1f" >> json: }, >> json: "output": [ >> json: "hdfs://eddie.crc.nd.edu:19000/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4", >> json: "file:///hadoop/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/" >> json: ], >> json: "output files": [ >> json: [ >> json: "DIGI-00000.root", >> json: "digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root" >> json: ] >> json: ], >> json: "prologue": null, >> json: "pset": "UL17_DIGI_cfg.py", >> json: "want summary": true >> json: } >>> using sync CE T3_US_NotreDame @ Thu Mar 4 19:23:35 2021 >>> config file fragment @ Thu Mar 4 19:23:37 2021 >> pset: >> pset: import FWCore.ParameterSet.Config as cms >> pset: process.Timing = cms.Service("Timing", >> pset: useJobReport = cms.untracked.bool(True), >> pset: summaryOnly = cms.untracked.bool(True)) >> pset: >> pset: process.maxEvents = cms.untracked.PSet(input = cms.untracked.int32(-1)) >> pset: >> pset: import os >> pset: _, major, minor, _ = os.environ["CMSSW_VERSION"].split('_', 3) >> pset: if int(major) >= 7 and int(minor) >= 4: >> pset: xrdstats = cms.Service("XrdAdaptor::XrdStatisticsService", cms.untracked.PSet(reportToFJR = cms.untracked.bool(True))) >> pset: process.add_(xrdstats) >> pset: >> pset: for prod in process.producers.values(): >> pset: if prod.hasParameter('nEvents') and prod.type_() == 'ExternalLHEProducer': >> pset: prod.nEvents = cms.untracked.uint32(-1) >> pset: >> pset: process.source.fileNames = cms.untracked.vstring(['file:SIM-00000_4170.root']) >> pset: process.source.lumisToProcess = cms.untracked.VLuminosityBlockRange(['1:595']) >> pset: if hasattr(process, 'options'): >> pset: process.options.wantSummary = cms.untracked.bool(True) >> pset: else: >> pset: process.options = cms.untracked.PSet(wantSummary = cms.untracked.bool(True)) >> pset: >> pset: if hasattr(process, 'options'): >> pset: process.options.numberOfThreads = cms.untracked.uint32(6) >> pset: process.options.numberOfStreams = cms.untracked.uint32(0) >> pset: else: >> pset: process.options = cms.untracked.PSet( >> pset: numberOfThreads = cms.untracked.uint32(6), >> pset: numberOfStreams = cms.untracked.uint32(0) >> pset: ) >>> executing 'cmsRun -j report.xml UL17_DIGI_cfg_mod.py' @ Thu Mar 4 19:23:37 2021 >> using /disk/vc3-root/tmp/worker-230547-11452/t.7927/cctools-temp-t.7927.NQKyeT/tmpWS7l9L to store command output >> cmd: %MSG-i ThreadStreamSetup: (NoModuleName) 04-Mar-2021 19:23:52 EST pre-events >> cmd: setting # threads 6 >> cmd: setting # streams 6 >> cmd: %MSG >> cmd: 04-Mar-2021 19:24:01 EST Initiating request to open file file:SIM-00000_4170.root >> cmd: 04-Mar-2021 19:24:03 EST Successfully opened file file:SIM-00000_4170.root >> cmd: 04-Mar-2021 19:24:06 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210014/27240BBA-3BAD-414F-B9E2-CB6E8F98111C.root >> cmd: [2021-03-04 19:27:11.896783 -0500][Error ][XRootD ] [primeradiant03.crc.nd.edu:1094] Unable to get the response to request kXR_read (handle: 0x00000000, offset: 23924204598, size: 393) >> cmd: [2021-03-04 19:27:22.666907 -0500][Error ][File ] [0x1ba3eb80@root://ndcms.crc.nd.edu:1094//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210014/27240BBA-3BAD-414F-B9E2-CB6E8F98111C.root] Fatal file state error. Message kXR_read (handle: 0x00000000, offset: 23924204598, size: 393) returned with [ERROR] Operation expired >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 04-Mar-2021 19:27:22 EST pre-events >> cmd: XrdRequestManager::handle(name='root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210014/27240BBA-3BAD-414F-B9E2-CB6E8F98111C.root) failure when reading from primeradiant03.crc.nd.edu:1094 (site T3_US_NotreDame); failed with error '[ERROR] Operation expired' (errno=0, code=206). >> cmd: %MSG >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 04-Mar-2021 19:27:22 EST pre-events >> cmd: Request failure when reading from primeradiant03.crc.nd.edu:1094 (site T3_US_NotreDame) >> cmd: %MSG >> cmd: %MSG-w XrdAdaptor: (NoModuleName) 04-Mar-2021 19:27:22 EST pre-events >> cmd: Data is now served from instead of previous T3_US_NotreDame >> cmd: %MSG >> cmd: 04-Mar-2021 19:27:24 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210014/27240BBA-3BAD-414F-B9E2-CB6E8F98111C.root >> cmd: [2021-03-04 19:27:39.670229 -0500][Error ][AsyncSock ] [primeradiant03.crc.nd.edu:1094 #0.0] Wont retry kXR_endsess request because wouldreach connection timeout. >> cmd: [2021-03-04 19:27:39.670367 -0500][Error ][AsyncSock ] [primeradiant03.crc.nd.edu:1094 #0.0] Socket error while handshaking: [ERROR] Socket timeout >> cmd: [2021-03-04 19:27:39.670515 -0500][Error ][PostMaster ] [primeradiant03.crc.nd.edu:1094 #0] elapsed = 28, pConnectionWindow = 31 seconds. >> cmd: 04-Mar-2021 19:27:45 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/10001/A5F15AD4-8A28-174E-B785-F940BD9FC361.root >> cmd: 04-Mar-2021 19:27:47 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/10001/A5F15AD4-8A28-174E-B785-F940BD9FC361.root >> cmd: 04-Mar-2021 19:27:49 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/230001/B81C9885-6949-F44A-BC42-2B6F4F9FF99C.root >> cmd: 04-Mar-2021 19:29:59 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/230001/B81C9885-6949-F44A-BC42-2B6F4F9FF99C.root >> cmd: 04-Mar-2021 19:30:13 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210010/2A35F7DB-77A8-FB4D-9962-BEE16F5274AC.root >> cmd: 04-Mar-2021 19:30:17 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210010/2A35F7DB-77A8-FB4D-9962-BEE16F5274AC.root >> cmd: 04-Mar-2021 19:30:25 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210010/98EB6FA1-E932-AA40-8406-229D11FED29A.root >> cmd: 04-Mar-2021 19:30:28 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210010/98EB6FA1-E932-AA40-8406-229D11FED29A.root >> cmd: 04-Mar-2021 19:30:43 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210008/2FEB5041-5418-0F43-AFED-B0B5F6F6F801.root >> cmd: 04-Mar-2021 19:30:45 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210008/2FEB5041-5418-0F43-AFED-B0B5F6F6F801.root >> cmd: Begin processing the 1st record. Run 1, Event 5, LumiSection 595 on stream 1 at 04-Mar-2021 19:30:59.332 EST >> cmd: Begin processing the 2nd record. Run 1, Event 7, LumiSection 595 on stream 3 at 04-Mar-2021 19:30:59.333 EST >> cmd: Begin processing the 3rd record. Run 1, Event 9, LumiSection 595 on stream 0 at 04-Mar-2021 19:30:59.335 EST >> cmd: Begin processing the 4th record. Run 1, Event 21, LumiSection 595 on stream 5 at 04-Mar-2021 19:30:59.336 EST >> cmd: Begin processing the 5th record. Run 1, Event 11, LumiSection 595 on stream 2 at 04-Mar-2021 19:30:59.337 EST >> cmd: Begin processing the 6th record. Run 1, Event 23, LumiSection 595 on stream 4 at 04-Mar-2021 19:30:59.338 EST >> cmd: 04-Mar-2021 19:32:37 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/10001/A5F15AD4-8A28-174E-B785-F940BD9FC361.root >> cmd: 04-Mar-2021 19:32:37 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210004/5F2DBEA0-E117-9442-AC18-CFC7BFDBB2DF.root >> cmd: 04-Mar-2021 19:32:59 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210004/5F2DBEA0-E117-9442-AC18-CFC7BFDBB2DF.root >> cmd: 04-Mar-2021 19:32:59 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210010/2A35F7DB-77A8-FB4D-9962-BEE16F5274AC.root >> cmd: 04-Mar-2021 19:32:59 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/230001/B81C9885-6949-F44A-BC42-2B6F4F9FF99C.root >> cmd: 04-Mar-2021 19:32:59 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210014/27240BBA-3BAD-414F-B9E2-CB6E8F98111C.root >> cmd: 04-Mar-2021 19:32:59 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210008/2FEB5041-5418-0F43-AFED-B0B5F6F6F801.root >> cmd: 04-Mar-2021 19:32:59 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210014/CEE3FDDB-BBCC-5A4C-85AC-81EBD535EF5F.root >> cmd: 04-Mar-2021 19:32:59 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210010/98EB6FA1-E932-AA40-8406-229D11FED29A.root >> cmd: 04-Mar-2021 19:32:59 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210002/87D21BAF-26FD-574A-A251-8F2052CF9B3A.root >> cmd: 04-Mar-2021 19:32:59 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/240000/CAB59CC0-2ED0-6C42-985A-DC82E0EA5E77.root >> cmd: 04-Mar-2021 19:32:59 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210019/7662AD5B-EDF0-4A4B-AD04-E62A26250547.root >> cmd: 04-Mar-2021 19:32:59 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210013/03B4DE44-BAC5-4A48-9207-67EB15236528.root >> cmd: 04-Mar-2021 19:33:01 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210014/CEE3FDDB-BBCC-5A4C-85AC-81EBD535EF5F.root >> cmd: 04-Mar-2021 19:34:42 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210019/7662AD5B-EDF0-4A4B-AD04-E62A26250547.root >> cmd: 04-Mar-2021 19:34:44 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/240000/CAB59CC0-2ED0-6C42-985A-DC82E0EA5E77.root >> cmd: 04-Mar-2021 19:34:52 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210013/03B4DE44-BAC5-4A48-9207-67EB15236528.root >> cmd: 04-Mar-2021 19:34:54 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210002/87D21BAF-26FD-574A-A251-8F2052CF9B3A.root >> cmd: Begin processing the 7th record. Run 1, Event 17, LumiSection 595 on stream 5 at 04-Mar-2021 19:35:04.055 EST >> cmd: Begin processing the 8th record. Run 1, Event 30, LumiSection 595 on stream 5 at 04-Mar-2021 19:35:07.013 EST >> cmd: Begin processing the 9th record. Run 1, Event 32, LumiSection 595 on stream 5 at 04-Mar-2021 19:35:09.564 EST >> cmd: Begin processing the 10th record. Run 1, Event 33, LumiSection 595 on stream 5 at 04-Mar-2021 19:35:11.669 EST >> cmd: Begin processing the 11th record. Run 1, Event 28, LumiSection 595 on stream 5 at 04-Mar-2021 19:35:13.921 EST >> cmd: Begin processing the 12th record. Run 1, Event 34, LumiSection 595 on stream 5 at 04-Mar-2021 19:35:16.788 EST >> cmd: Begin processing the 13th record. Run 1, Event 37, LumiSection 595 on stream 5 at 04-Mar-2021 19:35:19.757 EST >> cmd: Begin processing the 14th record. Run 1, Event 50, LumiSection 595 on stream 5 at 04-Mar-2021 19:35:22.335 EST >> cmd: Begin processing the 15th record. Run 1, Event 35, LumiSection 595 on stream 2 at 04-Mar-2021 19:35:39.169 EST >> cmd: Begin processing the 16th record. Run 1, Event 43, LumiSection 595 on stream 1 at 04-Mar-2021 19:35:39.304 EST >> cmd: Begin processing the 17th record. Run 1, Event 53, LumiSection 595 on stream 1 at 04-Mar-2021 19:35:42.146 EST >> cmd: Begin processing the 18th record. Run 1, Event 59, LumiSection 595 on stream 2 at 04-Mar-2021 19:35:42.657 EST >> cmd: Begin processing the 19th record. Run 1, Event 54, LumiSection 595 on stream 1 at 04-Mar-2021 19:35:44.561 EST >> cmd: Begin processing the 20th record. Run 1, Event 61, LumiSection 595 on stream 2 at 04-Mar-2021 19:35:44.662 EST >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: Begin processing the 21st record. Run 1, Event 70, LumiSection 595 on stream 1 at 04-Mar-2021 19:35:48.405 EST >> cmd: Begin processing the 22nd record. Run 1, Event 60, LumiSection 595 on stream 2 at 04-Mar-2021 19:35:48.695 EST >> cmd: Begin processing the 23rd record. Run 1, Event 68, LumiSection 595 on stream 1 at 04-Mar-2021 19:35:50.986 EST >> cmd: Begin processing the 24th record. Run 1, Event 66, LumiSection 595 on stream 2 at 04-Mar-2021 19:35:52.139 EST >> cmd: Begin processing the 25th record. Run 1, Event 81, LumiSection 595 on stream 1 at 04-Mar-2021 19:35:54.606 EST >> cmd: Begin processing the 26th record. Run 1, Event 78, LumiSection 595 on stream 2 at 04-Mar-2021 19:35:55.113 EST >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: Begin processing the 27th record. Run 1, Event 91, LumiSection 595 on stream 1 at 04-Mar-2021 19:35:57.226 EST >> cmd: Begin processing the 28th record. Run 1, Event 93, LumiSection 595 on stream 2 at 04-Mar-2021 19:35:57.664 EST >> cmd: Begin processing the 29th record. Run 1, Event 97, LumiSection 595 on stream 1 at 04-Mar-2021 19:35:59.890 EST >> cmd: Begin processing the 30th record. Run 1, Event 92, LumiSection 595 on stream 2 at 04-Mar-2021 19:36:00.548 EST >> cmd: Begin processing the 31st record. Run 1, Event 79, LumiSection 595 on stream 1 at 04-Mar-2021 19:36:02.906 EST >> cmd: Begin processing the 32nd record. Run 1, Event 94, LumiSection 595 on stream 2 at 04-Mar-2021 19:36:03.953 EST >> cmd: Begin processing the 33rd record. Run 1, Event 100, LumiSection 595 on stream 1 at 04-Mar-2021 19:36:06.034 EST >> cmd: Begin processing the 34th record. Run 1, Event 106, LumiSection 595 on stream 2 at 04-Mar-2021 19:36:07.211 EST >> cmd: Begin processing the 35th record. Run 1, Event 107, LumiSection 595 on stream 1 at 04-Mar-2021 19:36:09.093 EST >> cmd: Begin processing the 36th record. Run 1, Event 112, LumiSection 595 on stream 2 at 04-Mar-2021 19:36:09.160 EST >> cmd: Begin processing the 37th record. Run 1, Event 111, LumiSection 595 on stream 2 at 04-Mar-2021 19:36:11.536 EST >> cmd: Begin processing the 38th record. Run 1, Event 115, LumiSection 595 on stream 1 at 04-Mar-2021 19:36:12.856 EST >> cmd: Begin processing the 39th record. Run 1, Event 105, LumiSection 595 on stream 2 at 04-Mar-2021 19:36:14.022 EST >> cmd: Begin processing the 40th record. Run 1, Event 118, LumiSection 595 on stream 1 at 04-Mar-2021 19:36:15.696 EST >> cmd: Begin processing the 41st record. Run 1, Event 121, LumiSection 595 on stream 2 at 04-Mar-2021 19:36:17.555 EST >> cmd: Begin processing the 42nd record. Run 1, Event 124, LumiSection 595 on stream 1 at 04-Mar-2021 19:36:19.295 EST >> cmd: Begin processing the 43rd record. Run 1, Event 128, LumiSection 595 on stream 2 at 04-Mar-2021 19:36:20.508 EST >> cmd: %MSG-w XrdAdaptor: (NoModuleName) 04-Mar-2021 19:36:21 EST pre-events >> cmd: Data is now served from T3_US_NotreDame, crc.nd.edu instead of previous T3_US_NotreDame >> cmd: %MSG >> cmd: Begin processing the 44th record. Run 1, Event 123, LumiSection 595 on stream 1 at 04-Mar-2021 19:36:21.670 EST >> cmd: Begin processing the 45th record. Run 1, Event 125, LumiSection 595 on stream 2 at 04-Mar-2021 19:36:22.934 EST >> cmd: Begin processing the 46th record. Run 1, Event 127, LumiSection 595 on stream 1 at 04-Mar-2021 19:36:25.171 EST >> cmd: Begin processing the 47th record. Run 1, Event 137, LumiSection 595 on stream 2 at 04-Mar-2021 19:36:27.306 EST >> cmd: %MSG-w XrdAdaptor: PreMixingModule:mixData 04-Mar-2021 19:36:27 EST Run: 1 Event: 137 >> cmd: Data is now served from T3_US_NotreDame instead of previous T3_US_NotreDame, crc.nd.edu >> cmd: %MSG >> cmd: Begin processing the 48th record. Run 1, Event 147, LumiSection 595 on stream 1 at 04-Mar-2021 19:36:32.605 EST >> cmd: Begin processing the 49th record. Run 1, Event 149, LumiSection 595 on stream 1 at 04-Mar-2021 19:36:36.012 EST >> cmd: Begin processing the 50th record. Run 1, Event 151, LumiSection 595 on stream 2 at 04-Mar-2021 19:36:38.984 EST >> cmd: Begin processing the 51st record. Run 1, Event 153, LumiSection 595 on stream 1 at 04-Mar-2021 19:36:40.240 EST >> cmd: Begin processing the 52nd record. Run 1, Event 160, LumiSection 595 on stream 2 at 04-Mar-2021 19:36:41.491 EST >> cmd: Begin processing the 53rd record. Run 1, Event 152, LumiSection 595 on stream 1 at 04-Mar-2021 19:36:42.569 EST >> cmd: Begin processing the 54th record. Run 1, Event 164, LumiSection 595 on stream 2 at 04-Mar-2021 19:36:43.923 EST >> cmd: Begin processing the 55th record. Run 1, Event 162, LumiSection 595 on stream 1 at 04-Mar-2021 19:36:46.068 EST >> cmd: Begin processing the 56th record. Run 1, Event 166, LumiSection 595 on stream 2 at 04-Mar-2021 19:36:46.578 EST >> cmd: Begin processing the 57th record. Run 1, Event 163, LumiSection 595 on stream 1 at 04-Mar-2021 19:36:49.274 EST >> cmd: Begin processing the 58th record. Run 1, Event 173, LumiSection 595 on stream 2 at 04-Mar-2021 19:36:49.706 EST >> cmd: Begin processing the 59th record. Run 1, Event 174, LumiSection 595 on stream 1 at 04-Mar-2021 19:36:51.958 EST >> cmd: Begin processing the 60th record. Run 1, Event 179, LumiSection 595 on stream 2 at 04-Mar-2021 19:36:53.138 EST >> cmd: Begin processing the 61st record. Run 1, Event 175, LumiSection 595 on stream 1 at 04-Mar-2021 19:36:54.127 EST >> cmd: Begin processing the 62nd record. Run 1, Event 194, LumiSection 595 on stream 2 at 04-Mar-2021 19:36:55.763 EST >> cmd: Begin processing the 63rd record. Run 1, Event 192, LumiSection 595 on stream 1 at 04-Mar-2021 19:36:56.760 EST >> cmd: Begin processing the 64th record. Run 1, Event 190, LumiSection 595 on stream 2 at 04-Mar-2021 19:36:58.179 EST >> cmd: Begin processing the 65th record. Run 1, Event 209, LumiSection 595 on stream 1 at 04-Mar-2021 19:37:00.575 EST >> cmd: Begin processing the 66th record. Run 1, Event 217, LumiSection 595 on stream 2 at 04-Mar-2021 19:37:01.318 EST >> cmd: Begin processing the 67th record. Run 1, Event 215, LumiSection 595 on stream 1 at 04-Mar-2021 19:37:03.209 EST >> cmd: Begin processing the 68th record. Run 1, Event 184, LumiSection 595 on stream 2 at 04-Mar-2021 19:37:04.504 EST >> cmd: Begin processing the 69th record. Run 1, Event 196, LumiSection 595 on stream 2 at 04-Mar-2021 19:37:07.770 EST >> cmd: Begin processing the 70th record. Run 1, Event 221, LumiSection 595 on stream 1 at 04-Mar-2021 19:37:08.121 EST >> cmd: Begin processing the 71st record. Run 1, Event 229, LumiSection 595 on stream 1 at 04-Mar-2021 19:37:10.702 EST >> cmd: Begin processing the 72nd record. Run 1, Event 218, LumiSection 595 on stream 2 at 04-Mar-2021 19:37:11.819 EST >> cmd: Begin processing the 73rd record. Run 1, Event 223, LumiSection 595 on stream 1 at 04-Mar-2021 19:37:13.010 EST >> cmd: Begin processing the 74th record. Run 1, Event 241, LumiSection 595 on stream 2 at 04-Mar-2021 19:37:15.150 EST >> cmd: Begin processing the 75th record. Run 1, Event 230, LumiSection 595 on stream 1 at 04-Mar-2021 19:37:15.585 EST >> cmd: Begin processing the 76th record. Run 1, Event 231, LumiSection 595 on stream 2 at 04-Mar-2021 19:37:18.169 EST >> cmd: Begin processing the 77th record. Run 1, Event 239, LumiSection 595 on stream 1 at 04-Mar-2021 19:37:18.769 EST >> cmd: Begin processing the 78th record. Run 1, Event 225, LumiSection 595 on stream 2 at 04-Mar-2021 19:37:21.603 EST >> cmd: Begin processing the 79th record. Run 1, Event 236, LumiSection 595 on stream 1 at 04-Mar-2021 19:37:21.917 EST >> cmd: Begin processing the 80th record. Run 1, Event 258, LumiSection 595 on stream 2 at 04-Mar-2021 19:37:24.135 EST >> cmd: Begin processing the 81st record. Run 1, Event 259, LumiSection 595 on stream 1 at 04-Mar-2021 19:37:25.200 EST >> cmd: Begin processing the 82nd record. Run 1, Event 242, LumiSection 595 on stream 2 at 04-Mar-2021 19:37:27.754 EST >> cmd: Begin processing the 83rd record. Run 1, Event 246, LumiSection 595 on stream 1 at 04-Mar-2021 19:37:28.848 EST >> cmd: Begin processing the 84th record. Run 1, Event 269, LumiSection 595 on stream 2 at 04-Mar-2021 19:37:30.467 EST >> cmd: Begin processing the 85th record. Run 1, Event 273, LumiSection 595 on stream 1 at 04-Mar-2021 19:37:32.261 EST >> cmd: Begin processing the 86th record. Run 1, Event 272, LumiSection 595 on stream 2 at 04-Mar-2021 19:37:33.825 EST >> cmd: Begin processing the 87th record. Run 1, Event 260, LumiSection 595 on stream 1 at 04-Mar-2021 19:37:35.484 EST >> cmd: Begin processing the 88th record. Run 1, Event 271, LumiSection 595 on stream 2 at 04-Mar-2021 19:37:35.961 EST >> cmd: Begin processing the 89th record. Run 1, Event 264, LumiSection 595 on stream 1 at 04-Mar-2021 19:37:38.597 EST >> cmd: Begin processing the 90th record. Run 1, Event 292, LumiSection 595 on stream 2 at 04-Mar-2021 19:37:39.796 EST >> cmd: Begin processing the 91st record. Run 1, Event 281, LumiSection 595 on stream 1 at 04-Mar-2021 19:37:41.852 EST >> cmd: Begin processing the 92nd record. Run 1, Event 301, LumiSection 595 on stream 2 at 04-Mar-2021 19:37:43.275 EST >> cmd: Begin processing the 93rd record. Run 1, Event 288, LumiSection 595 on stream 1 at 04-Mar-2021 19:37:44.741 EST >> cmd: Begin processing the 94th record. Run 1, Event 295, LumiSection 595 on stream 2 at 04-Mar-2021 19:37:45.571 EST >> cmd: Begin processing the 95th record. Run 1, Event 298, LumiSection 595 on stream 1 at 04-Mar-2021 19:37:46.982 EST >> cmd: Begin processing the 96th record. Run 1, Event 305, LumiSection 595 on stream 1 at 04-Mar-2021 19:37:49.995 EST >> cmd: Begin processing the 97th record. Run 1, Event 310, LumiSection 595 on stream 1 at 04-Mar-2021 19:37:52.196 EST >> cmd: Begin processing the 98th record. Run 1, Event 306, LumiSection 595 on stream 2 at 04-Mar-2021 19:37:53.763 EST >> cmd: Begin processing the 99th record. Run 1, Event 312, LumiSection 595 on stream 2 at 04-Mar-2021 19:37:56.002 EST >> cmd: Begin processing the 100th record. Run 1, Event 314, LumiSection 595 on stream 5 at 04-Mar-2021 19:37:56.303 EST >> cmd: Begin processing the 101st record. Run 1, Event 318, LumiSection 595 on stream 3 at 04-Mar-2021 19:37:56.894 EST >> cmd: Begin processing the 102nd record. Run 1, Event 321, LumiSection 595 on stream 1 at 04-Mar-2021 19:37:57.458 EST >> cmd: Begin processing the 103rd record. Run 1, Event 329, LumiSection 595 on stream 4 at 04-Mar-2021 19:37:57.913 EST >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: Begin processing the 104th record. Run 1, Event 333, LumiSection 595 on stream 2 at 04-Mar-2021 19:37:58.787 EST >> cmd: Begin processing the 105th record. Run 1, Event 336, LumiSection 595 on stream 5 at 04-Mar-2021 19:37:59.717 EST >> cmd: Begin processing the 106th record. Run 1, Event 339, LumiSection 595 on stream 3 at 04-Mar-2021 19:38:00.079 EST >> cmd: Begin processing the 107th record. Run 1, Event 337, LumiSection 595 on stream 4 at 04-Mar-2021 19:38:00.338 EST >> cmd: Begin processing the 108th record. Run 1, Event 341, LumiSection 595 on stream 1 at 04-Mar-2021 19:38:00.866 EST >> cmd: Begin processing the 109th record. Run 1, Event 348, LumiSection 595 on stream 2 at 04-Mar-2021 19:38:02.166 EST >> cmd: Begin processing the 110th record. Run 1, Event 356, LumiSection 595 on stream 5 at 04-Mar-2021 19:38:02.665 EST >> cmd: Begin processing the 111th record. Run 1, Event 343, LumiSection 595 on stream 3 at 04-Mar-2021 19:38:02.974 EST >> cmd: Begin processing the 112th record. Run 1, Event 354, LumiSection 595 on stream 4 at 04-Mar-2021 19:38:04.204 EST >> cmd: Begin processing the 113th record. Run 1, Event 353, LumiSection 595 on stream 1 at 04-Mar-2021 19:38:04.205 EST >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: Begin processing the 114th record. Run 1, Event 358, LumiSection 595 on stream 2 at 04-Mar-2021 19:38:04.394 EST >> cmd: Begin processing the 115th record. Run 1, Event 374, LumiSection 595 on stream 5 at 04-Mar-2021 19:38:04.861 EST >> cmd: Begin processing the 116th record. Run 1, Event 371, LumiSection 595 on stream 1 at 04-Mar-2021 19:38:06.519 EST >> cmd: Begin processing the 117th record. Run 1, Event 361, LumiSection 595 on stream 3 at 04-Mar-2021 19:38:06.766 EST >> cmd: Begin processing the 118th record. Run 1, Event 373, LumiSection 595 on stream 2 at 04-Mar-2021 19:38:07.030 EST >> cmd: Begin processing the 119th record. Run 1, Event 379, LumiSection 595 on stream 5 at 04-Mar-2021 19:38:07.307 EST >> cmd: Begin processing the 120th record. Run 1, Event 397, LumiSection 595 on stream 4 at 04-Mar-2021 19:38:08.292 EST >> cmd: Begin processing the 121st record. Run 1, Event 395, LumiSection 595 on stream 1 at 04-Mar-2021 19:38:09.247 EST >> cmd: Begin processing the 122nd record. Run 1, Event 396, LumiSection 595 on stream 3 at 04-Mar-2021 19:38:09.791 EST >> cmd: Begin processing the 123rd record. Run 1, Event 393, LumiSection 595 on stream 2 at 04-Mar-2021 19:38:10.347 EST >> cmd: Begin processing the 124th record. Run 1, Event 392, LumiSection 595 on stream 5 at 04-Mar-2021 19:38:10.692 EST >> cmd: Begin processing the 125th record. Run 1, Event 402, LumiSection 595 on stream 4 at 04-Mar-2021 19:38:10.897 EST >> cmd: Begin processing the 126th record. Run 1, Event 429, LumiSection 595 on stream 1 at 04-Mar-2021 19:38:11.148 EST >> cmd: Begin processing the 127th record. Run 1, Event 415, LumiSection 595 on stream 3 at 04-Mar-2021 19:38:12.618 EST >> cmd: Begin processing the 128th record. Run 1, Event 424, LumiSection 595 on stream 2 at 04-Mar-2021 19:38:13.107 EST >> cmd: Begin processing the 129th record. Run 1, Event 430, LumiSection 595 on stream 5 at 04-Mar-2021 19:38:13.911 EST >> cmd: Begin processing the 130th record. Run 1, Event 432, LumiSection 595 on stream 1 at 04-Mar-2021 19:38:13.993 EST >> cmd: Begin processing the 131st record. Run 1, Event 455, LumiSection 595 on stream 4 at 04-Mar-2021 19:38:14.760 EST >> cmd: Begin processing the 132nd record. Run 1, Event 425, LumiSection 595 on stream 3 at 04-Mar-2021 19:38:15.803 EST >> cmd: Begin processing the 133rd record. Run 1, Event 436, LumiSection 595 on stream 2 at 04-Mar-2021 19:38:16.123 EST >> cmd: Begin processing the 134th record. Run 1, Event 456, LumiSection 595 on stream 5 at 04-Mar-2021 19:38:17.196 EST >> cmd: Begin processing the 135th record. Run 1, Event 457, LumiSection 595 on stream 1 at 04-Mar-2021 19:38:17.197 EST >> cmd: Begin processing the 136th record. Run 1, Event 479, LumiSection 595 on stream 4 at 04-Mar-2021 19:38:17.298 EST >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: Begin processing the 137th record. Run 1, Event 478, LumiSection 595 on stream 3 at 04-Mar-2021 19:38:19.557 EST >> cmd: Begin processing the 138th record. Run 1, Event 471, LumiSection 595 on stream 4 at 04-Mar-2021 19:38:19.818 EST >> cmd: Begin processing the 139th record. Run 1, Event 472, LumiSection 595 on stream 2 at 04-Mar-2021 19:38:20.214 EST >> cmd: Begin processing the 140th record. Run 1, Event 482, LumiSection 595 on stream 1 at 04-Mar-2021 19:38:20.601 EST >> cmd: Begin processing the 141st record. Run 1, Event 481, LumiSection 595 on stream 5 at 04-Mar-2021 19:38:21.911 EST >> cmd: Begin processing the 142nd record. Run 1, Event 483, LumiSection 595 on stream 3 at 04-Mar-2021 19:38:22.219 EST >> cmd: Begin processing the 143rd record. Run 1, Event 484, LumiSection 595 on stream 4 at 04-Mar-2021 19:38:22.996 EST >> cmd: Begin processing the 144th record. Run 1, Event 491, LumiSection 595 on stream 1 at 04-Mar-2021 19:38:24.705 EST >> cmd: Begin processing the 145th record. Run 1, Event 487, LumiSection 595 on stream 2 at 04-Mar-2021 19:38:24.980 EST >> cmd: 04-Mar-2021 19:41:02 EST Closed file file:SIM-00000_4170.root >> cmd: 04-Mar-2021 19:41:02 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210002/87D21BAF-26FD-574A-A251-8F2052CF9B3A.root >> cmd: 04-Mar-2021 19:41:02 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210004/5F2DBEA0-E117-9442-AC18-CFC7BFDBB2DF.root >> cmd: 04-Mar-2021 19:41:02 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/240000/CAB59CC0-2ED0-6C42-985A-DC82E0EA5E77.root >> cmd: 04-Mar-2021 19:41:02 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210014/CEE3FDDB-BBCC-5A4C-85AC-81EBD535EF5F.root >> cmd: 04-Mar-2021 19:41:02 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210019/7662AD5B-EDF0-4A4B-AD04-E62A26250547.root >> cmd: 04-Mar-2021 19:41:02 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210013/03B4DE44-BAC5-4A48-9207-67EB15236528.root >> cmd: >> cmd: TrigReport ---------- Event Summary ------------ >> cmd: TrigReport Events total = 145 passed = 145 failed = 0 >> cmd: >> cmd: TrigReport ---------- Path Summary ------------ >> cmd: TrigReport Trig Bit# Executed Passed Failed Error Name >> cmd: >> cmd: TrigReport -------End-Path Summary ------------ >> cmd: TrigReport Trig Bit# Executed Passed Failed Error Name >> cmd: TrigReport 0 1 145 145 0 0 PREMIXRAWoutput_step >> cmd: >> cmd: TrigReport ------ Modules in End-Path: PREMIXRAWoutput_step ------------ >> cmd: TrigReport Trig Bit# Visited Passed Failed Error Name >> cmd: TrigReport 0 0 145 145 0 0 PREMIXRAWoutput >> cmd: >> cmd: TrigReport ---------- Module Summary ------------ >> cmd: TrigReport Visited Executed Passed Failed Error Name >> cmd: TrigReport 580 145 145 0 0 DMEcalDigis >> cmd: TrigReport 145 145 145 0 0 DMEcalPreshowerDigis >> cmd: TrigReport 145 145 145 0 0 DMEcalTriggerPrimitiveDigis >> cmd: TrigReport 725 145 145 0 0 DMHcalDigis >> cmd: TrigReport 0 0 0 0 0 DMHcalTTPDigis >> cmd: TrigReport 145 145 145 0 0 DMHcalTriggerPrimitiveDigis >> cmd: TrigReport 145 145 145 0 0 L1simulation_step >> cmd: TrigReport 0 0 0 0 0 MEtoEDMConverter >> cmd: TrigReport 145 145 145 0 0 PREMIXRAWoutput >> cmd: TrigReport 145 145 145 0 0 PREMIXRAWoutput_step >> cmd: TrigReport 145 145 145 0 0 SiStripDigiToRaw >> cmd: TrigReport 145 145 145 0 0 TriggerResults >> cmd: TrigReport 290 145 145 0 0 addPileupInfo >> cmd: TrigReport 145 145 145 0 0 ak4GenJets >> cmd: TrigReport 145 145 145 0 0 ak4GenJetsNoNu >> cmd: TrigReport 145 145 145 0 0 ak8GenJets >> cmd: TrigReport 145 145 145 0 0 ak8GenJetsNoNu >> cmd: TrigReport 145 145 145 0 0 bmtfStage2Raw >> cmd: TrigReport 145 145 145 0 0 caloLayer1RawFed1354 >> cmd: TrigReport 145 145 145 0 0 caloLayer1RawFed1356 >> cmd: TrigReport 145 145 145 0 0 caloLayer1RawFed1358 >> cmd: TrigReport 145 145 145 0 0 caloStage2Raw >> cmd: TrigReport 145 145 145 0 0 cscpacker >> cmd: TrigReport 145 145 145 0 0 datamixing_step >> cmd: TrigReport 145 145 145 0 0 digi2raw_step >> cmd: TrigReport 145 145 145 0 0 digitisation_step >> cmd: TrigReport 145 145 145 0 0 dtpacker >> cmd: TrigReport 145 145 145 0 0 ecalPacker >> cmd: TrigReport 145 145 145 0 0 endjob_step >> cmd: TrigReport 145 145 145 0 0 esDigiToRaw >> cmd: TrigReport 145 145 145 0 0 gemPacker >> cmd: TrigReport 145 145 145 0 0 genCandidatesForMET >> cmd: TrigReport 145 145 145 0 0 genMetCalo >> cmd: TrigReport 145 145 145 0 0 genMetTrue >> cmd: TrigReport 580 145 145 0 0 genParticles >> cmd: TrigReport 145 145 145 0 0 genParticlesForJets >> cmd: TrigReport 145 145 145 0 0 genParticlesForJetsNoNu >> cmd: TrigReport 145 145 145 0 0 genParticlesForMETAllVisible >> cmd: TrigReport 145 145 145 0 0 generatorSmeared >> cmd: TrigReport 145 145 145 0 0 gmtStage2Raw >> cmd: TrigReport 145 145 145 0 0 gtStage2Raw >> cmd: TrigReport 145 145 145 0 0 hcalRawDataVME >> cmd: TrigReport 145 145 145 0 0 hcalRawDatauHTR >> cmd: TrigReport 1595 145 145 0 0 mix >> cmd: TrigReport 3480 145 145 0 0 mixData >> cmd: TrigReport 0 0 0 0 0 omtfStage2Raw >> cmd: TrigReport 145 145 145 0 0 randomEngineStateProducer >> cmd: TrigReport 145 145 145 0 0 rawDataCollector >> cmd: TrigReport 145 145 145 0 0 rpcpacker >> cmd: TrigReport 145 145 145 0 0 siPixelRawData >> cmd: TrigReport 145 145 145 0 0 simBmtfDigis >> cmd: TrigReport 580 145 145 0 0 simCaloStage2Digis >> cmd: TrigReport 290 145 145 0 0 simCaloStage2Layer1Digis >> cmd: TrigReport 435 145 145 0 0 simCscTriggerPrimitiveDigis >> cmd: TrigReport 290 145 145 0 0 simDtTriggerPrimitiveDigis >> cmd: TrigReport 145 145 145 0 0 simEmtfDigis >> cmd: TrigReport 145 145 145 0 0 simGmtCaloSumDigis >> cmd: TrigReport 870 145 145 0 0 simGmtStage2Digis >> cmd: TrigReport 145 145 145 0 0 simGtExtFakeStage2Digis >> cmd: TrigReport 145 145 145 0 0 simGtStage2Digis >> cmd: TrigReport 0 0 0 0 0 simHcalTriggerPrimitiveDigis >> cmd: TrigReport 725 145 145 0 0 simMuonCSCDigis >> cmd: TrigReport 290 145 145 0 0 simMuonDTDigis >> cmd: TrigReport 290 145 145 0 0 simMuonGEMDigis >> cmd: TrigReport 0 0 0 0 0 simMuonGEMPadDigiClusters >> cmd: TrigReport 145 145 145 0 0 simMuonGEMPadDigis >> cmd: TrigReport 290 145 145 0 0 simMuonRPCDigis >> cmd: TrigReport 145 145 145 0 0 simOmtfDigis >> cmd: TrigReport 290 145 145 0 0 simTwinMuxDigis >> cmd: >> cmd: TimeReport ---------- Event Summary ---[sec]---- >> cmd: TimeReport event loop CPU/event = 0.865825 >> cmd: TimeReport event loop Real/event = 4.192866 >> cmd: TimeReport sum Streams Real/event = 19.811331 >> cmd: TimeReport efficiency CPU/Real/thread = 0.034417 >> cmd: >> cmd: TimeReport ---------- Path Summary ---[Real sec]---- >> cmd: TimeReport per event per exec Name >> cmd: TimeReport 0.000000 0.000000 digitisation_step >> cmd: TimeReport 0.000000 0.000000 datamixing_step >> cmd: TimeReport 0.000000 0.000000 L1simulation_step >> cmd: TimeReport 0.000000 0.000000 digi2raw_step >> cmd: TimeReport per event per exec Name >> cmd: >> cmd: TimeReport -------End-Path Summary ---[Real sec]---- >> cmd: TimeReport per event per exec Name >> cmd: TimeReport 0.000000 0.000000 endjob_step >> cmd: TimeReport 19.808966 19.808966 PREMIXRAWoutput_step >> cmd: TimeReport per event per exec Name >> cmd: >> cmd: TimeReport ---------- Modules in Path: digitisation_step ---[Real sec]---- >> cmd: TimeReport per event per visit Name >> cmd: >> cmd: TimeReport ---------- Modules in Path: datamixing_step ---[Real sec]---- >> cmd: TimeReport per event per visit Name >> cmd: >> cmd: TimeReport ---------- Modules in Path: L1simulation_step ---[Real sec]---- >> cmd: TimeReport per event per visit Name >> cmd: >> cmd: TimeReport ---------- Modules in Path: digi2raw_step ---[Real sec]---- >> cmd: TimeReport per event per visit Name >> cmd: TimeReport per event per visit Name >> cmd: >> cmd: TimeReport ------ Modules in End-Path: endjob_step ---[Real sec]---- >> cmd: TimeReport per event per visit Name >> cmd: >> cmd: TimeReport ------ Modules in End-Path: PREMIXRAWoutput_step ---[Real sec]---- >> cmd: TimeReport per event per visit Name >> cmd: TimeReport 0.540987 0.540987 PREMIXRAWoutput >> cmd: TimeReport per event per visit Name >> cmd: >> cmd: TimeReport ---------- Module Summary ---[Real sec]---- >> cmd: TimeReport per event per exec per visit Name >> cmd: TimeReport 0.012494 0.012494 0.012494 DMEcalDigis >> cmd: TimeReport 0.003151 0.003151 0.003151 DMEcalPreshowerDigis >> cmd: TimeReport 0.043993 0.043993 0.043993 DMEcalTriggerPrimitiveDigis >> cmd: TimeReport 0.000820 0.000820 0.000820 DMHcalDigis >> cmd: TimeReport 0.000000 0.000000 0.000000 DMHcalTTPDigis >> cmd: TimeReport 0.012166 0.012166 0.012166 DMHcalTriggerPrimitiveDigis >> cmd: TimeReport 0.000002 0.000002 0.000002 L1simulation_step >> cmd: TimeReport 0.000000 0.000000 0.000000 MEtoEDMConverter >> cmd: TimeReport 0.540987 0.540987 0.540987 PREMIXRAWoutput >> cmd: TimeReport 0.000018 0.000018 0.000018 PREMIXRAWoutput_step >> cmd: TimeReport 0.035326 0.035326 0.035326 SiStripDigiToRaw >> cmd: TimeReport 0.000003 0.000003 0.000003 TriggerResults >> cmd: TimeReport 0.000045 0.000045 0.000045 addPileupInfo >> cmd: TimeReport 0.000887 0.000887 0.000887 ak4GenJets >> cmd: TimeReport 0.000779 0.000779 0.000779 ak4GenJetsNoNu >> cmd: TimeReport 0.000948 0.000948 0.000948 ak8GenJets >> cmd: TimeReport 0.000921 0.000921 0.000921 ak8GenJetsNoNu >> cmd: TimeReport 0.001687 0.001687 0.001687 bmtfStage2Raw >> cmd: TimeReport 0.000723 0.000723 0.000723 caloLayer1RawFed1354 >> cmd: TimeReport 0.000637 0.000637 0.000637 caloLayer1RawFed1356 >> cmd: TimeReport 0.000643 0.000643 0.000643 caloLayer1RawFed1358 >> cmd: TimeReport 0.000183 0.000183 0.000183 caloStage2Raw >> cmd: TimeReport 0.045622 0.045622 0.045622 cscpacker >> cmd: TimeReport 0.000002 0.000002 0.000002 datamixing_step >> cmd: TimeReport 0.000001 0.000001 0.000001 digi2raw_step >> cmd: TimeReport 0.000008 0.000008 0.000008 digitisation_step >> cmd: TimeReport 0.000525 0.000525 0.000525 dtpacker >> cmd: TimeReport 0.013510 0.013510 0.013510 ecalPacker >> cmd: TimeReport 0.000002 0.000002 0.000002 endjob_step >> cmd: TimeReport 0.003176 0.003176 0.003176 esDigiToRaw >> cmd: TimeReport 0.000368 0.000368 0.000368 gemPacker >> cmd: TimeReport 0.000331 0.000331 0.000331 genCandidatesForMET >> cmd: TimeReport 0.000123 0.000123 0.000123 genMetCalo >> cmd: TimeReport 0.000109 0.000109 0.000109 genMetTrue >> cmd: TimeReport 0.027077 0.027077 0.027077 genParticles >> cmd: TimeReport 0.000439 0.000439 0.000439 genParticlesForJets >> cmd: TimeReport 0.000347 0.000347 0.000347 genParticlesForJetsNoNu >> cmd: TimeReport 0.000322 0.000322 0.000322 genParticlesForMETAllVisible >> cmd: TimeReport 0.000005 0.000005 0.000005 generatorSmeared >> cmd: TimeReport 0.000163 0.000163 0.000163 gmtStage2Raw >> cmd: TimeReport 0.000280 0.000280 0.000280 gtStage2Raw >> cmd: TimeReport 0.000475 0.000475 0.000475 hcalRawDataVME >> cmd: TimeReport 0.004485 0.004485 0.004485 hcalRawDatauHTR >> cmd: TimeReport 2.866173 2.866173 2.866173 mix >> cmd: TimeReport 15.543919 15.543919 15.543919 mixData >> cmd: TimeReport 0.000000 0.000000 0.000000 omtfStage2Raw >> cmd: TimeReport 0.000016 0.000016 0.000016 randomEngineStateProducer >> cmd: TimeReport 0.002172 0.002172 0.002172 rawDataCollector >> cmd: TimeReport 0.005619 0.005619 0.005619 rpcpacker >> cmd: TimeReport 0.030845 0.030845 0.030845 siPixelRawData >> cmd: TimeReport 0.065488 0.065488 0.065488 simBmtfDigis >> cmd: TimeReport 0.006305 0.006305 0.006305 simCaloStage2Digis >> cmd: TimeReport 0.001994 0.001994 0.001994 simCaloStage2Layer1Digis >> cmd: TimeReport 0.014255 0.014255 0.014255 simCscTriggerPrimitiveDigis >> cmd: TimeReport 0.006918 0.006918 0.006918 simDtTriggerPrimitiveDigis >> cmd: TimeReport 0.011369 0.011369 0.011369 simEmtfDigis >> cmd: TimeReport 0.002885 0.002885 0.002885 simGmtCaloSumDigis >> cmd: TimeReport 0.000627 0.000627 0.000627 simGmtStage2Digis >> cmd: TimeReport 0.000718 0.000718 0.000718 simGtExtFakeStage2Digis >> cmd: TimeReport 0.006294 0.006294 0.006294 simGtStage2Digis >> cmd: TimeReport 0.000000 0.000000 0.000000 simHcalTriggerPrimitiveDigis >> cmd: TimeReport 0.166533 0.166533 0.166533 simMuonCSCDigis >> cmd: TimeReport 0.000519 0.000519 0.000519 simMuonDTDigis >> cmd: TimeReport 0.000128 0.000128 0.000128 simMuonGEMDigis >> cmd: TimeReport 0.000000 0.000000 0.000000 simMuonGEMPadDigiClusters >> cmd: TimeReport 0.000017 0.000017 0.000017 simMuonGEMPadDigis >> cmd: TimeReport 0.095024 0.095024 0.095024 simMuonRPCDigis >> cmd: TimeReport 0.005692 0.005692 0.005692 simOmtfDigis >> cmd: TimeReport 0.000902 0.000902 0.000902 simTwinMuxDigis >> cmd: TimeReport per event per exec per visit Name >> cmd: >> cmd: T---Report end! >> cmd: >> cmd: TimeReport> Time report complete in 1044.48 seconds >> cmd: Time Summary: >> cmd: - Min event: 1.85186 >> cmd: - Max event: 602.67 >> cmd: - Avg event: 19.809 >> cmd: - Total loop: 607.559 >> cmd: - Total init: 436.439 >> cmd: - Total job: 1044.48 >> cmd: - EventSetup Lock: 134.041 >> cmd: - EventSetup Get: 34.0378 >> cmd: Event Throughput: 0.23866 ev/s >> cmd: CPU Summary: >> cmd: - Total loop: 929.821 >> cmd: - Total init: 14.0688 >> cmd: - Total extra: 0 >> cmd: - Total job: 944.443 >> cmd: Processing Summary: >> cmd: - Number of Events: 145 >> cmd: - Number of Global Begin Lumi Calls: 1 >> cmd: - Number of Global Begin Run Calls: 1 >> cmd: >> cmd: >> cmd: ============================================= >> cmd: >> cmd: MessageLogger Summary >> cmd: >> cmd: type category sev module subroutine count total >> cmd: ---- -------------------- -- ---------------- ---------------- ----- ----- >> cmd: 1 XrdAdaptor -w (NoModuleName) 2 2 >> cmd: 2 XrdAdaptor -w PreMixingModule: 1 1 >> cmd: 3 XrdAdaptorInternal -w (NoModuleName) 2 2 >> cmd: 4 TimeReport -e AfterModEndJob 1 1 >> cmd: 5 fileAction -s PreMixingModule: 18 18 >> cmd: 6 fileAction -s PreMixingModule: 12 12 >> cmd: 7 fileAction -s PreMixingModule: 6 6 >> cmd: 8 fileAction -s file_close 1 1 >> cmd: 9 fileAction -s file_open 2 2 >> cmd: >> cmd: type category Examples: run/evt run/evt run/evt >> cmd: ---- -------------------- ---------------- ---------------- ---------------- >> cmd: 1 XrdAdaptor pre-events pre-events >> cmd: 2 XrdAdaptor 1/137 >> cmd: 3 XrdAdaptorInternal pre-events pre-events >> cmd: 4 TimeReport PostGlobalEndRun >> cmd: 5 fileAction 1/5 1/5 1/9 >> cmd: 6 fileAction pre-events pre-events pre-events >> cmd: 7 fileAction PostGlobalEndRun PostGlobalEndRun PostGlobalEndRun >> cmd: 8 fileAction PostGlobalEndRun >> cmd: 9 fileAction pre-events pre-events >> cmd: >> cmd: Severity # Occurrences Total Occurrences >> cmd: -------- ------------- ----------------- >> cmd: Warning 5 5 >> cmd: Error 1 1 >> cmd: System 39 39 >> cmd: >> cmd: dropped waiting message count 0 >>> executable returned with exit code 0. @ Thu Mar 4 19:41:04 2021 >>> executing 'timeout 300 hdfs dfs -fs hdfs://eddie.crc.nd.edu:19000 -put DIGI-00000.root /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root' @ Thu Mar 4 19:41:14 2021 >> using /disk/vc3-root/tmp/worker-230547-11452/t.7927/cctools-temp-t.7927.NQKyeT/tmp7ftM3Y to store command output >> cmd: timeout: failed to run command 'hdfs': No such file or directory >>> Checking output file transfer. @ Thu Mar 4 19:41:14 2021 >>> executing 'env XRD_LOGLEVEL=Debug xrdcp DIGI-00000.root root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root' @ Thu Mar 4 19:41:14 2021 >> using /disk/vc3-root/tmp/worker-230547-11452/t.7927/cctools-temp-t.7927.NQKyeT/tmpNfjDou to store command output >> cmd: [2021-03-04 19:41:14.613605 -0500][Warning][Utility ] Unable to process global config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-04 19:41:14.614625 -0500][Debug ][Utility ] Unable to process user config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-04 19:41:14.614782 -0500][Debug ][PlugInMgr ] Initializing plug-in manager... >> cmd: [2021-03-04 19:41:14.614830 -0500][Debug ][PlugInMgr ] No default plug-in, loading plug-in configs... >> cmd: [2021-03-04 19:41:14.614871 -0500][Debug ][PlugInMgr ] Processing plug-in definitions in /etc/xrootd/client.plugins.d... >> cmd: [2021-03-04 19:41:14.614955 -0500][Debug ][PlugInMgr ] Unable to process directory /etc/xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-04 19:41:14.615263 -0500][Debug ][PlugInMgr ] Processing plug-in definitions in /tmp/runos_singularity_home-102140030779863162787922949639420189459/.xrootd/client.plugins.d... >> cmd: [2021-03-04 19:41:14.615359 -0500][Debug ][PlugInMgr ] Unable to process directory /tmp/runos_singularity_home-102140030779863162787922949639420189459/.xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-04 19:41:14.615631 -0500][Debug ][Poller ] Available pollers: built-in >> cmd: [2021-03-04 19:41:14.615679 -0500][Debug ][Poller ] Attempting to create a poller according to preference: built-in >> cmd: [2021-03-04 19:41:14.615720 -0500][Debug ][Poller ] Creating poller: built-in >> cmd: [2021-03-04 19:41:14.615766 -0500][Debug ][Poller ] Creating and starting the built-in poller... >> cmd: [2021-03-04 19:41:14.616115 -0500][Debug ][Poller ] Using 1 poller threads >> cmd: [2021-03-04 19:41:14.616174 -0500][Debug ][TaskMgr ] Starting the task manager... >> cmd: [2021-03-04 19:41:14.616321 -0500][Debug ][TaskMgr ] Task manager started >> cmd: [2021-03-04 19:41:14.616374 -0500][Debug ][JobMgr ] Starting the job manager... >> cmd: [2021-03-04 19:41:14.617137 -0500][Debug ][JobMgr ] Job manager started, 3 workers >> cmd: [2021-03-04 19:41:14.617213 -0500][Debug ][TaskMgr ] Registering task: "FileTimer task" to be run at: [2021-03-04 19:41:14 -0500] >> cmd: [2021-03-04 19:41:14.617299 -0500][Debug ][PostMaster ] Creating new channel to: deepthought.crc.nd.edu:1094 1 stream(s) >> cmd: [2021-03-04 19:41:14.617373 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-03-04 19:41:14.618416 -0500][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" to be run at: [2021-03-04 19:41:29 -0500] >> cmd: [2021-03-04 19:41:14.619400 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-03-04 19:41:14.619549 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-03-04 19:41:14.619667 -0500][Debug ][Poller ] Adding socket 0x150e100 to the poller >> cmd: [2021-03-04 19:43:15.141011 -0500][Error ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Socket error while handshaking: [ERROR] Socket timeout >> cmd: [2021-03-04 19:43:15.141153 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-03-04 19:43:15.141214 -0500][Debug ][Poller ] <--> Removing socket from the poller >> cmd: [2021-03-04 19:43:15.141405 -0500][Error ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] elapsed = 121, pConnectionWindow = 120 seconds. >> cmd: [2021-03-04 19:43:15.143419 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-03-04 19:43:15.143641 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-03-04 19:43:15.143745 -0500][Debug ][Poller ] Adding socket 0x150e100 to the poller >> cmd: [2021-03-04 19:45:22.376502 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2021-03-04 19:45:22.376711 -0500][Error ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Unable to connect: Connection timed out >> cmd: [2021-03-04 19:45:22.376766 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-03-04 19:45:22.376815 -0500][Debug ][Poller ] <--> Removing socket from the poller >> cmd: [2021-03-04 19:45:22.376939 -0500][Error ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] elapsed = 127, pConnectionWindow = 120 seconds. >> cmd: [2021-03-04 19:45:22.378407 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-03-04 19:45:22.378550 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-03-04 19:45:22.378641 -0500][Debug ][Poller ] Adding socket 0x150e100 to the poller >> cmd: [2021-03-04 19:45:22.378757 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2021-03-04 19:45:22.378854 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-03-04 19:45:28.932176 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Got the server hand shake response (type: manager [], protocol version 400) >> cmd: [2021-03-04 19:45:28.932442 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] kXR_protocol successful (type: manager [], protocol version 400) >> cmd: [2021-03-04 19:45:28.935149 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdcp&xrd.info=&xrd.hostname=d8civy001.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-03-04 19:45:28.935465 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Logged in, session: b1db0f00a60d0000e30000003ce20f00 >> cmd: [2021-03-04 19:45:28.935540 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream 0 connected. >> cmd: [2021-03-04 19:45:28.935586 -0500][Debug ][Utility ] Monitor library name not set. No monitoring >> cmd: [2021-03-04 19:45:28.936100 -0500][Debug ][TaskMgr ] Registering task: "WaitTask for: 0x0x15079d0" to be run at: [2021-03-04 19:45:38 -0500] >> cmd: [2021-03-04 19:45:38.664222 -0500][Debug ][TaskMgr ] Done with task: "WaitTask for: 0x0x15079d0" >> cmd: [2021-03-04 19:46:43.879734 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-03-04 19:46:43.879863 -0500][Debug ][Poller ] <[::ffff:10.32.78.121]:38876><--><[::ffff:129.74.85.55]:1094> Removing socket from the poller >> cmd: [2021-03-04 19:46:43.880018 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Recovering error for stream #0: [ERROR] Socket error. >> cmd: [2021-03-04 19:46:43.880068 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Reporting disconnection to queued message handlers. >> cmd: [2021-03-04 19:46:43.880118 -0500][Debug ][XRootD ] [deepthought.crc.nd.edu:1094] Handling error while processing kXR_stat (path: /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root, flags: none): [ERROR] Socket error. >> cmd: [2021-03-04 19:46:43.880162 -0500][Info ][XRootD ] [deepthought.crc.nd.edu:1094] Retrying request: kXR_stat (path: /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root, flags: none). >> cmd: [2021-03-04 19:46:43.881316 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-03-04 19:46:43.881457 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-03-04 19:46:43.881546 -0500][Debug ][Poller ] Adding socket 0x150e100 to the poller >> cmd: [2021-03-04 19:48:44.348019 -0500][Error ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Socket error while handshaking: [ERROR] Socket timeout >> cmd: [2021-03-04 19:48:44.348138 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-03-04 19:48:44.348193 -0500][Debug ][Poller ] <--> Removing socket from the poller >> cmd: [2021-03-04 19:48:44.348328 -0500][Error ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] elapsed = 121, pConnectionWindow = 120 seconds. >> cmd: [2021-03-04 19:48:44.349823 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-03-04 19:48:44.349972 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-03-04 19:48:44.350063 -0500][Debug ][Poller ] Adding socket 0x150e100 to the poller >> cmd: [2021-03-04 19:48:44.350199 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2021-03-04 19:48:44.350300 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-03-04 19:49:51.258402 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Got the server hand shake response (type: manager [], protocol version 400) >> cmd: [2021-03-04 19:49:51.258643 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] kXR_protocol successful (type: manager [], protocol version 400) >> cmd: [2021-03-04 19:49:51.261482 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdcp&xrd.info=&xrd.hostname=d8civy001.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-03-04 19:49:54.396195 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Logged in, session: eddc0f00a60d00003b010000dbe30f00 >> cmd: [2021-03-04 19:49:54.396344 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out kXR_endsess for session: b1db0f00a60d0000e30000003ce20f00 >> cmd: [2021-03-04 19:50:05.876445 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream 0 connected. >> cmd: [2021-03-04 19:50:34.685901 -0500][Debug ][TaskMgr ] Registering task: "WaitTask for: 0x0x15079d0" to be run at: [2021-03-04 19:50:41 -0500] >> cmd: [2021-03-04 19:50:41.712459 -0500][Debug ][TaskMgr ] Done with task: "WaitTask for: 0x0x15079d0" >> cmd: [2021-03-04 19:51:03.059795 -0500][Debug ][XRootD ] [deepthought.crc.nd.edu:1094] Handling error while processing kXR_stat (path: /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root, flags: none): [ERROR] Error response: No such file or directory. >> cmd: [2021-03-04 19:51:03.060182 -0500][Debug ][Utility ] CopyProcess: 2 jobs to prepare >> cmd: [2021-03-04 19:51:03.072323 -0500][Debug ][XRootD ] [deepthought.crc.nd.edu:1094] Handling error while processing kXR_stat (path: /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root, flags: none): [ERROR] Error response: No such file or directory. >> cmd: [2021-03-04 19:51:03.072525 -0500][Debug ][Utility ] Creating a classic copy job, from file://localhost/disk/vc3-root/tmp/worker-230547-11452/t.7927/DIGI-00000.root to root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root >> cmd: [2021-03-04 19:51:03.072665 -0500][Debug ][Utility ] Opening file://localhost/disk/vc3-root/tmp/worker-230547-11452/t.7927/DIGI-00000.root for reading >> cmd: [2021-03-04 19:51:03.072749 -0500][Debug ][File ] [0x150e6f0@file://localhost/disk/vc3-root/tmp/worker-230547-11452/t.7927/DIGI-00000.root] Sending an open command >> cmd: [2021-03-04 19:51:03.073167 -0500][Debug ][File ] [0x150e6f0@file://localhost/disk/vc3-root/tmp/worker-230547-11452/t.7927/DIGI-00000.root] Open has returned with status [SUCCESS] >> cmd: [2021-03-04 19:51:03.073306 -0500][Debug ][File ] [0x150e6f0@file://localhost/disk/vc3-root/tmp/worker-230547-11452/t.7927/DIGI-00000.root] successfully opened at localhost, handle: 0x16, session id: 1 >> cmd: [2021-03-04 19:51:03.073471 -0500][Debug ][Utility ] Opening root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root?oss.asize=368876121 for writing >> cmd: [2021-03-04 19:51:03.073562 -0500][Debug ][File ] [0x150fac0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root?oss.asize=368876121] Sending an open command >> cmd: [2021-03-04 19:51:03.074266 -0500][Debug ][PostMaster ] Creating new channel to: primeradiant03.crc.nd.edu:1096 1 stream(s) >> cmd: [2021-03-04 19:51:03.074348 -0500][Debug ][PostMaster ] [primeradiant03.crc.nd.edu:1096 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-03-04 19:51:03.075909 -0500][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: primeradiant03.crc.nd.edu:1096" to be run at: [2021-03-04 19:51:18 -0500] >> cmd: [2021-03-04 19:51:03.076850 -0500][Debug ][PostMaster ] [primeradiant03.crc.nd.edu:1096] Found 1 address(es): [::ffff:149.165.243.11]:1096 >> cmd: [2021-03-04 19:51:03.076992 -0500][Debug ][AsyncSock ] [primeradiant03.crc.nd.edu:1096 #0.0] Attempting connection to [::ffff:149.165.243.11]:1096 >> cmd: [2021-03-04 19:51:03.077080 -0500][Debug ][Poller ] Adding socket 0x70001890 to the poller >> cmd: [2021-03-04 19:51:03.077214 -0500][Debug ][AsyncSock ] [primeradiant03.crc.nd.edu:1096 #0.0] Async connection call returned >> cmd: [2021-03-04 19:51:03.077334 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-03-04 19:51:03.139286 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Got the server hand shake response (type: server [], protocol version 400) >> cmd: [2021-03-04 19:51:03.139530 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] kXR_protocol successful (type: server [], protocol version 400) >> cmd: [2021-03-04 19:51:03.142076 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdcp&xrd.info=&xrd.hostname=d8civy001.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-03-04 19:51:03.142492 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Logged in, session: f6d0020078170000a700000006d50200 >> cmd: [2021-03-04 19:51:03.142545 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Authentication is required: &P=gsi,v:10400,c:ssl,ca:ba240aa8.0|f5f0dfc2.0 >> cmd: [2021-03-04 19:51:03.142592 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Sending authentication data >> cmd: [2021-03-04 19:51:03.166068 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Trying to authenticate using gsi >> cmd: [2021-03-04 19:51:03.239897 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Sending more authentication data for gsi >> cmd: [2021-03-04 19:51:03.262822 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Authenticated with gsi. >> cmd: [2021-03-04 19:51:03.262914 -0500][Debug ][PostMaster ] [primeradiant03.crc.nd.edu:1096 #0] Stream 0 connected. >> cmd: [2021-03-04 19:51:03.429948 -0500][Debug ][File ] [0x150fac0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root?oss.asize=368876121] Open has returned with status [SUCCESS] >> cmd: [2021-03-04 19:51:03.430031 -0500][Debug ][File ] [0x150fac0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root?oss.asize=368876121] successfully opened at primeradiant03.crc.nd.edu:1096, handle: 0x0, session id: 1 >> cmd: [2021-03-04 19:51:03.430298 -0500][Debug ][File ] [0x150e6f0@file://localhost/disk/vc3-root/tmp/worker-230547-11452/t.7927/DIGI-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-03-04 19:51:03.443578 -0500][Debug ][File ] [0x150e6f0@file://localhost/disk/vc3-root/tmp/worker-230547-11452/t.7927/DIGI-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-03-04 19:51:03.455948 -0500][Debug ][File ] [0x150e6f0@file://localhost/disk/vc3-root/tmp/worker-230547-11452/t.7927/DIGI-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-03-04 19:51:03.467165 -0500][Debug ][File ] [0x150e6f0@file://localhost/disk/vc3-root/tmp/worker-230547-11452/t.7927/DIGI-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-03-04 19:51:03.478087 -0500][Debug ][File ] [0x150fac0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root?oss.asize=368876121] Sending a write command for handle 0x0 to primeradiant03.crc.nd.edu:1096 >> cmd: [16MB/351.8MB][ 4%][==> ][16MB/s] [2021-03-04 19:51:03.478574 -0500][Debug ][File ] [0x150e6f0@file://localhost/disk/vc3-root/tmp/worker-230547-11452/t.7927/DIGI-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-03-04 19:51:03.489383 -0500][Debug ][File ] [0x150fac0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root?oss.asize=368876121] Sending a write command for handle 0x0 to primeradiant03.crc.nd.edu:1096 >> cmd: [2021-03-04 19:51:03.489563 -0500][Debug ][File ] [0x150e6f0@file://localhost/disk/vc3-root/tmp/worker-230547-11452/t.7927/DIGI-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-03-04 19:51:03.500249 -0500][Debug ][File ] [0x150fac0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root?oss.asize=368876121] Sending a write command for handle 0x0 to primeradiant03.crc.nd.edu:1096 >> cmd: [2021-03-04 19:51:03.500452 -0500][Debug ][File ] [0x150e6f0@file://localhost/disk/vc3-root/tmp/worker-230547-11452/t.7927/DIGI-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-03-04 19:51:03.511013 -0500][Debug ][File ] [0x150fac0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root?oss.asize=368876121] Sending a write command for handle 0x0 to primeradiant03.crc.nd.edu:1096 >> cmd: [2021-03-04 19:51:03.511206 -0500][Debug ][File ] [0x150e6f0@file://localhost/disk/vc3-root/tmp/worker-230547-11452/t.7927/DIGI-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-03-04 19:51:03.860127 -0500][Debug ][File ] [0x150fac0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root?oss.asize=368876121] Sending a write command for handle 0x0 to primeradiant03.crc.nd.edu:1096 >> cmd: [2021-03-04 19:51:03.860349 -0500][Debug ][File ] [0x150e6f0@file://localhost/disk/vc3-root/tmp/worker-230547-11452/t.7927/DIGI-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-03-04 19:51:04.407212 -0500][Debug ][File ] [0x150fac0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root?oss.asize=368876121] Sending a write command for handle 0x0 to primeradiant03.crc.nd.edu:1096 >> cmd: [96MB/351.8MB][ 27%][=============> ][96MB/s] [2021-03-04 19:51:04.407522 -0500][Debug ][File ] [0x150e6f0@file://localhost/disk/vc3-root/tmp/worker-230547-11452/t.7927/DIGI-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-03-04 19:51:04.695943 -0500][Debug ][File ] [0x150fac0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root?oss.asize=368876121] Sending a write command for handle 0x0 to primeradiant03.crc.nd.edu:1096 >> cmd: [2021-03-04 19:51:04.696194 -0500][Debug ][File ] [0x150e6f0@file://localhost/disk/vc3-root/tmp/worker-230547-11452/t.7927/DIGI-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-03-04 19:51:05.125227 -0500][Debug ][File ] [0x150fac0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root?oss.asize=368876121] Sending a write command for handle 0x0 to primeradiant03.crc.nd.edu:1096 >> cmd: [128MB/351.8MB][ 36%][==================> ][64MB/s] [2021-03-04 19:51:05.125556 -0500][Debug ][File ] [0x150e6f0@file://localhost/disk/vc3-root/tmp/worker-230547-11452/t.7927/DIGI-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-03-04 19:51:05.493063 -0500][Debug ][File ] [0x150fac0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root?oss.asize=368876121] Sending a write command for handle 0x0 to primeradiant03.crc.nd.edu:1096 >> cmd: [2021-03-04 19:51:05.493271 -0500][Debug ][File ] [0x150e6f0@file://localhost/disk/vc3-root/tmp/worker-230547-11452/t.7927/DIGI-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-03-04 19:51:05.839441 -0500][Debug ][File ] [0x150fac0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root?oss.asize=368876121] Sending a write command for handle 0x0 to primeradiant03.crc.nd.edu:1096 >> cmd: [2021-03-04 19:51:05.839651 -0500][Debug ][File ] [0x150e6f0@file://localhost/disk/vc3-root/tmp/worker-230547-11452/t.7927/DIGI-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-03-04 19:51:06.193552 -0500][Debug ][File ] [0x150fac0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root?oss.asize=368876121] Sending a write command for handle 0x0 to primeradiant03.crc.nd.edu:1096 >> cmd: [176MB/351.8MB][ 50%][=========================> ][58.67MB/s] [2021-03-04 19:51:06.193874 -0500][Debug ][File ] [0x150e6f0@file://localhost/disk/vc3-root/tmp/worker-230547-11452/t.7927/DIGI-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-03-04 19:51:06.550533 -0500][Debug ][File ] [0x150fac0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root?oss.asize=368876121] Sending a write command for handle 0x0 to primeradiant03.crc.nd.edu:1096 >> cmd: [2021-03-04 19:51:06.550738 -0500][Debug ][File ] [0x150e6f0@file://localhost/disk/vc3-root/tmp/worker-230547-11452/t.7927/DIGI-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-03-04 19:51:06.889249 -0500][Debug ][File ] [0x150fac0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root?oss.asize=368876121] Sending a write command for handle 0x0 to primeradiant03.crc.nd.edu:1096 >> cmd: [2021-03-04 19:51:06.889407 -0500][Debug ][File ] [0x150e6f0@file://localhost/disk/vc3-root/tmp/worker-230547-11452/t.7927/DIGI-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-03-04 19:51:07.233982 -0500][Debug ][File ] [0x150fac0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root?oss.asize=368876121] Sending a write command for handle 0x0 to primeradiant03.crc.nd.edu:1096 >> cmd: [224MB/351.8MB][ 63%][===============================> ][56MB/s] [2021-03-04 19:51:07.234239 -0500][Debug ][File ] [0x150e6f0@file://localhost/disk/vc3-root/tmp/worker-230547-11452/t.7927/DIGI-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-03-04 19:51:07.601826 -0500][Debug ][File ] [0x150fac0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root?oss.asize=368876121] Sending a write command for handle 0x0 to primeradiant03.crc.nd.edu:1096 >> cmd: [2021-03-04 19:51:07.601983 -0500][Debug ][File ] [0x150e6f0@file://localhost/disk/vc3-root/tmp/worker-230547-11452/t.7927/DIGI-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-03-04 19:51:07.958531 -0500][Debug ][File ] [0x150fac0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root?oss.asize=368876121] Sending a write command for handle 0x0 to primeradiant03.crc.nd.edu:1096 >> cmd: [2021-03-04 19:51:07.958696 -0500][Debug ][File ] [0x150e6f0@file://localhost/disk/vc3-root/tmp/worker-230547-11452/t.7927/DIGI-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-03-04 19:51:08.304477 -0500][Debug ][File ] [0x150fac0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root?oss.asize=368876121] Sending a write command for handle 0x0 to primeradiant03.crc.nd.edu:1096 >> cmd: [272MB/351.8MB][ 77%][======================================> ][54.4MB/s] [2021-03-04 19:51:08.304743 -0500][Debug ][File ] [0x150e6f0@file://localhost/disk/vc3-root/tmp/worker-230547-11452/t.7927/DIGI-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-03-04 19:51:08.660988 -0500][Debug ][File ] [0x150fac0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root?oss.asize=368876121] Sending a write command for handle 0x0 to primeradiant03.crc.nd.edu:1096 >> cmd: [2021-03-04 19:51:08.661158 -0500][Debug ][File ] [0x150e6f0@file://localhost/disk/vc3-root/tmp/worker-230547-11452/t.7927/DIGI-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-03-04 19:51:09.004469 -0500][Debug ][File ] [0x150fac0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root?oss.asize=368876121] Sending a write command for handle 0x0 to primeradiant03.crc.nd.edu:1096 >> cmd: [304MB/351.8MB][ 86%][===========================================> ][50.67MB/s] [2021-03-04 19:51:09.308207 -0500][Debug ][File ] [0x150fac0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root?oss.asize=368876121] Sending a write command for handle 0x0 to primeradiant03.crc.nd.edu:1096 >> cmd: [2021-03-04 19:51:09.637190 -0500][Debug ][File ] [0x150fac0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root?oss.asize=368876121] Sending a write command for handle 0x0 to primeradiant03.crc.nd.edu:1096 >> cmd: [2021-03-04 19:51:09.920103 -0500][Debug ][File ] [0x150fac0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root?oss.asize=368876121] Sending a write command for handle 0x0 to primeradiant03.crc.nd.edu:1096 >> cmd: [351.8MB/351.8MB][100%][==================================================][58.63MB/s] [2021-03-04 19:51:11.189498 -0500][Debug ][File ] [0x150fac0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root?oss.asize=368876121] Sending a close command for handle 0x0 to primeradiant03.crc.nd.edu:1096 >> cmd: [2021-03-04 19:51:11.206281 -0500][Debug ][File ] [0x150fac0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root?oss.asize=368876121] Close returned from primeradiant03.crc.nd.edu:1096 with: [SUCCESS] >> cmd: [2021-03-04 19:51:11.206546 -0500][Debug ][File ] [0x150e6f0@file://localhost/disk/vc3-root/tmp/worker-230547-11452/t.7927/DIGI-00000.root] Sending a close command for handle 0x16 to localhost >> cmd: [2021-03-04 19:51:11.206799 -0500][Debug ][File ] [0x150e6f0@file://localhost/disk/vc3-root/tmp/worker-230547-11452/t.7927/DIGI-00000.root] Close returned from localhost with: [SUCCESS] >> cmd: [351.8MB/351.8MB][100%][==================================================][43.97MB/s] >> cmd: [2021-03-04 19:51:11.241444 -0500][Debug ][JobMgr ] Stopping the job manager... >> cmd: [2021-03-04 19:51:11.242471 -0500][Debug ][JobMgr ] Job manager stopped >> cmd: [2021-03-04 19:51:11.242557 -0500][Debug ][TaskMgr ] Stopping the task manager... >> cmd: [2021-03-04 19:51:11.242791 -0500][Debug ][TaskMgr ] Task manager stopped >> cmd: [2021-03-04 19:51:11.242847 -0500][Debug ][Poller ] Stopping the poller... >> cmd: [2021-03-04 19:51:11.243246 -0500][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" >> cmd: [2021-03-04 19:51:11.243310 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-03-04 19:51:11.243374 -0500][Debug ][Poller ] <[::ffff:10.32.78.121]:38896><--><[::ffff:129.74.85.55]:1094> Removing socket from the poller >> cmd: [2021-03-04 19:51:11.243489 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Destroying stream >> cmd: [2021-03-04 19:51:11.243545 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-03-04 19:51:11.243613 -0500][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: primeradiant03.crc.nd.edu:1096" >> cmd: [2021-03-04 19:51:11.243662 -0500][Debug ][AsyncSock ] [primeradiant03.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2021-03-04 19:51:11.243713 -0500][Debug ][Poller ] <[::ffff:10.32.78.121]:58480><--><[::ffff:149.165.243.11]:1096> Removing socket from the poller >> cmd: [2021-03-04 19:51:11.243800 -0500][Debug ][PostMaster ] [primeradiant03.crc.nd.edu:1096 #0] Destroying stream >> cmd: [2021-03-04 19:51:11.243851 -0500][Debug ][AsyncSock ] [primeradiant03.crc.nd.edu:1096 #0.0] Closing the socket >>> Checking output file transfer. @ Thu Mar 4 19:51:11 2021 >>> executing 'timeout 300 hdfs dfs -fs hdfs://eddie.crc.nd.edu:19000 -stat "Size: %b" /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root' @ Thu Mar 4 19:51:11 2021 >> using /disk/vc3-root/tmp/worker-230547-11452/t.7927/cctools-temp-t.7927.NQKyeT/tmpmZN1vI to store command output >> cmd: timeout: failed to run command 'hdfs': No such file or directory >>>>> checking output for DIGI-00000.root failed: timeout: failed to run command 'hdfs': No such file or directory @ Thu Mar 4 19:51:11 2021 >>> executing 'timeout 300 xrdfs deepthought.crc.nd.edu stat /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root' @ Thu Mar 4 19:51:11 2021 >> using /disk/vc3-root/tmp/worker-230547-11452/t.7927/cctools-temp-t.7927.NQKyeT/tmpjuc01p to store command output >> cmd: Path: /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root >> cmd: Id: 0 >> cmd: Size: 368876121 >> cmd: MTime: 2021-03-05 00:51:11 >> cmd: Flags: 24 (Offline|IsReadable) >>> File transfer successful! @ Thu Mar 4 19:51:26 2021 >>> Checking output files... @ Thu Mar 4 19:51:26 2021 >>> Checking DIGI-00000.root => digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root @ Thu Mar 4 19:51:26 2021 >>> executing 'timeout 300 hdfs dfs -fs hdfs://eddie.crc.nd.edu:19000 -stat "Size: %b" /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root' @ Thu Mar 4 19:51:26 2021 >> using /disk/vc3-root/tmp/worker-230547-11452/t.7927/cctools-temp-t.7927.NQKyeT/tmpDBTv1z to store command output >> cmd: timeout: failed to run command 'hdfs': No such file or directory >>>>> checking output for DIGI-00000.root failed: timeout: failed to run command 'hdfs': No such file or directory @ Thu Mar 4 19:51:26 2021 >>> executing 'timeout 300 xrdfs deepthought.crc.nd.edu stat /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root' @ Thu Mar 4 19:51:26 2021 >> using /disk/vc3-root/tmp/worker-230547-11452/t.7927/cctools-temp-t.7927.NQKyeT/tmpdVP815 to store command output >>>>> checking output for DIGI-00000.root failed: @ Thu Mar 4 19:56:26 2021 >>> executing '/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin/gfal-stat gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root' @ Thu Mar 4 19:56:26 2021 >> using /disk/vc3-root/tmp/worker-230547-11452/t.7927/cctools-temp-t.7927.NQKyeT/tmpMJBVzZ to store command output >> cmd: gfal-stat error: 70 (Communication error on send) - globus_xio: Unable to connect to deepthought.crc.nd.edu:2811 globus_xio: System error in connect: Connection timed out globus_xio: A system call failed: Connection timed out >>>>> checking output for DIGI-00000.root failed: gfal-stat error: 70 (Communication error on send) - globus_xio: Unable to connect to deepthought.crc.nd.edu:2811 globus_xio: System error in connect: Connection timed out globus_xio: A system call failed: Connection timed out @ Thu Mar 4 19:58:34 2021 >>> executing '/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin/gfal-stat gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root' @ Thu Mar 4 19:58:34 2021 >> using /disk/vc3-root/tmp/worker-230547-11452/t.7927/cctools-temp-t.7927.NQKyeT/tmpTpUigi to store command output >> cmd: gfal-stat error: 13 (Permission denied) - globus_ftp_client: the server responded with an error 530 530-Login incorrect. : /builddir/build/BUILD/gridftp-hdfs-1.1.1/src/gridftp_hdfs.c:hdfs_start:756: 530-Server is cancelling transfer due to over-load limit (host=deepthought.crc.nd.edu, user=kmohrman, path=(null)) 530 End. >>>>> checking output for DIGI-00000.root failed: gfal-stat error: 13 (Permission denied) - globus_ftp_client: the server responded with an error 530 530-Login incorrect. : /builddir/build/BUILD/gridftp-hdfs-1.1.1/src/gridftp_hdfs.c:hdfs_start:756: 530-Server is cancelling transfer due to over-load limit (host=deepthought.crc.nd.edu, user=kmohrman, path=(null)) 530 End. @ Thu Mar 4 19:58:53 2021 >>> executing 'stat /hadoop/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root' @ Thu Mar 4 19:58:53 2021 >> using /disk/vc3-root/tmp/worker-230547-11452/t.7927/cctools-temp-t.7927.NQKyeT/tmpAUoW5n to store command output >> cmd: stat: cannot stat '/hadoop/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root': No such file or directory >>>>> checking output for DIGI-00000.root failed: stat: cannot stat '/hadoop/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root': No such file or directory @ Thu Mar 4 19:58:53 2021 >> trace: Traceback (most recent call last): >> trace: File "task.py", line 268, in wrapper >> trace: result = fct(data, *args, **kwargs) >> trace: File "task.py", line 404, in check_outputs >> trace: raise IOError("could not verify output file '{}'".format(remote)) >> trace: IOError: could not verify output file 'digi_step_ttHJet_testUpdateGenproddim6TopMay20GST_run1/DIGI-00000_7927.root' >>>>> call to 'check_outputs' failed, exiting with exit code 211 @ Thu Mar 4 19:58:53 2021 Thu Mar 4 19:23:35 2021: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Thu Mar 4 19:23:36 2021: ApMon[WARNING]: Not sending parameters since no destination is defined. Thu Mar 4 19:23:36 2021: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. Thu Mar 4 19:41:04 2021: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Thu Mar 4 19:41:05 2021: ApMon[WARNING]: Not sending parameters since no destination is defined. Thu Mar 4 19:41:05 2021: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. >> Execution time 2152 >> Exiting with code 211 >> Reporting ExeExitCode 0 >> Reporting StageOutSE T3_US_NotreDame >> Reporting StageOutExitCode 211 Thu Mar 4 19:58:53 2021: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Thu Mar 4 19:58:54 2021: ApMon[WARNING]: Not sending parameters since no destination is defined. Thu Mar 4 19:58:54 2021: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. ==== working directory after execution @ Thu Mar 4 19:58:54 EST 2021 ==== == dir: total 518364 == dir: drwxr-xr-x 18 kmohrman campus 215 Mar 4 19:23 CMSSW_10_6_17_patch1 == dir: -rw-r--r-- 1 kmohrman campus 368876121 Mar 4 19:41 DIGI-00000.root == dir: -rwxr-xr-x 1 kmohrman campus 153093217 Mar 4 19:23 SIM-00000_4170.root == dir: -rw-r--r-- 3 kmohrman campus 3932158 Mar 4 19:22 UL17_DIGI_cfg.py == dir: -rw-r--r-- 1 kmohrman campus 3933483 Mar 4 19:23 UL17_DIGI_cfg_mod.py == dir: drwxr-xr-x 2 kmohrman campus 71 Mar 4 19:22 bin == dir: -rwxr-xr-x 3 kmohrman campus 627272 Mar 4 19:22 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 Mar 4 19:22 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 Mar 4 19:58 cctools-temp-t.7927.NQKyeT == dir: -rw------- 1 kmohrman campus 51 Mar 4 19:23 cvmfschecksum.cms-ib.cern.ch == dir: -rw------- 1 kmohrman campus 51 Mar 4 19:23 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 Mar 4 19:23 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 Mar 4 19:22 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 Mar 4 19:22 librmonitor_helper.so.FlOLgv == dir: -rw-r--r-- 2 kmohrman campus 2301 Mar 4 19:22 parameters.json == dir: -rw------- 2 kmohrman campus 9921 Mar 4 19:22 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 Mar 4 19:22 python == dir: -rw-r--r-- 1 kmohrman campus 3526 Mar 4 19:58 report.json == dir: -rw-r--r-- 3 kmohrman campus 570 Mar 4 19:22 report.json.in == dir: -rw-r--r-- 1 kmohrman campus 65588 Mar 4 19:41 report.xml == dir: -rw-r--r-- 1 kmohrman campus 4996 Mar 4 19:58 report.xml.gz == dir: -rw-r--r-- 3 kmohrman campus 593 Mar 4 19:22 sandbox-CMSSW_10_6_17_patch1-slc7_amd64_gcc700.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 37 Mar 4 19:22 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 Mar 4 19:23 t_wrapper_ready == dir: -rw-r--r-- 1 kmohrman campus 11 Mar 4 19:23 t_wrapper_start == dir: -rwxr-xr-x 3 kmohrman campus 47217 Mar 4 19:22 task.py == dir: -rwxr-xr-x 3 kmohrman campus 5986 Mar 4 19:22 wrapper.sh === wrapper done @ Thu Mar 4 19:58:54 EST 2021 === final return status = 211 @ Thu Mar 4 19:58:54 EST 2021