==== wrapper started @ Tue Jun 15 03:03:14 EDT 2021 ==== == startup: hostname: d8civy159.crc.nd.edu == startup: kernel: Linux d8civy159.crc.nd.edu 3.10.0-1160.el7.x86_64 #1 SMP Tue Aug 18 14:50:17 EDT 2020 x86_64 x86_64 x86_64 GNU/Linux ==== tracing google @ Tue Jun 15 03:03:19 EDT 2021 ==== wrapper.sh: line 20: traceroute: command not found ==== environment at startup @ Tue Jun 15 03:03:24 EDT 2021 ==== == env: VC3_VERSION_SED=4.2 == env: CCTOOLS_RESOURCE_PROCESS_START=1623740604969420 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: VC3_ROOT_GZIP=/usr/ == env: SHELL=/bin/sh == env: TERM=xterm-256color == env: MAKEFLAGS=-j4 == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-5860/t.894850/cctools-temp-t.894850.mNp8yU == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-5860/t.894850/librmonitor_helper.so.dpNbUr == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: USER=kmohrman == env: TEMP=/disk/vc3-root/tmp/worker-230547-5860/t.894850/cctools-temp-t.894850.mNp8yU == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: LD_LIBRARY_PATH=/.singularity.d/libs == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_ROOT_MAKE=/usr/ == env: VC3_DISTFILES=/disk/vc3-distfiles == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-5860/cache/tmp == env: VC3_VERSION_TAR=1.26 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-0wnKJj == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: VC3_VERSION_GZIP=1.5 == env: VC3_ENV_TAG_GLOBAL=5606 == env: PATH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-0wnKJj == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PWD=/disk/vc3-root/tmp/worker-230547-5860/t.894850 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_FULL_SED=4.2.2 == env: VC3_VERSION_WHICH=2.20 == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-5860 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_ROOT_SED=/usr/ == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: CXX=g++ == env: SHLVL=3 == env: HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_MAKE=3.82 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: DISK=6000 == env: MEMORY=7800 == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: TMP=/disk/vc3-root/tmp/worker-230547-5860/t.894850/cctools-temp-t.894850.mNp8yU == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_VERSION_PKG_CONFIG=0.27 == env: VC3_ROOT_TAR=/usr/ == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-0wnKJj.wrapper == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: CC=gcc == env: CORES=6 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CCTOOLS_RESOURCE_MONITOR_INFO=1024 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_CRC_postLHE.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=17043 == env: _=/usr/bin/env ==== cpu info @ Tue Jun 15 03:03:30 EDT 2021 ==== == cpu: processor : 0 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3072.265 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 0 == cpu: cpu cores : 8 == cpu: apicid : 0 == cpu: initial apicid : 0 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.15 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 1 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3090.673 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 1 == cpu: cpu cores : 8 == cpu: apicid : 2 == cpu: initial apicid : 2 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.15 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 2 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.743 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 2 == cpu: cpu cores : 8 == cpu: apicid : 4 == cpu: initial apicid : 4 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.15 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 3 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3090.673 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 3 == cpu: cpu cores : 8 == cpu: apicid : 6 == cpu: initial apicid : 6 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.15 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 4 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2997.680 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 4 == cpu: cpu cores : 8 == cpu: apicid : 8 == cpu: initial apicid : 8 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.15 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 5 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3099.560 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 5 == cpu: cpu cores : 8 == cpu: apicid : 10 == cpu: initial apicid : 10 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.15 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 6 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2996.728 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 6 == cpu: cpu cores : 8 == cpu: apicid : 12 == cpu: initial apicid : 12 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.15 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 7 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3002.758 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 7 == cpu: cpu cores : 8 == cpu: apicid : 14 == cpu: initial apicid : 14 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.15 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 8 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 0 == cpu: cpu cores : 8 == cpu: apicid : 32 == cpu: initial apicid : 32 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.28 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 9 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 1 == cpu: cpu cores : 8 == cpu: apicid : 34 == cpu: initial apicid : 34 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.28 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 10 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 2 == cpu: cpu cores : 8 == cpu: apicid : 36 == cpu: initial apicid : 36 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.28 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 11 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 3 == cpu: cpu cores : 8 == cpu: apicid : 38 == cpu: initial apicid : 38 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.28 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 12 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 4 == cpu: cpu cores : 8 == cpu: apicid : 40 == cpu: initial apicid : 40 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.28 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 13 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3000.219 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 5 == cpu: cpu cores : 8 == cpu: apicid : 42 == cpu: initial apicid : 42 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.28 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 14 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2997.045 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 6 == cpu: cpu cores : 8 == cpu: apicid : 44 == cpu: initial apicid : 44 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.28 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 15 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3016.247 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 7 == cpu: cpu cores : 8 == cpu: apicid : 46 == cpu: initial apicid : 46 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.28 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: === using CVMFS proxy: http://eddie.crc.nd.edu:3128 @ Tue Jun 15 03:03:55 EDT 2021 === using Frontier proxy: http://eddie.crc.nd.edu:3128 @ Tue Jun 15 03:03:55 EDT 2021 === parrot helper: /disk/vc3-root/tmp/worker-230547-5860/t.894850/lib/libparrot_helper.so @ Tue Jun 15 03:04:00 EDT 2021 ==== content of /disk/vc3-root/tmp/worker-230547-5860/cache/tmp @ Tue Jun 15 03:04:00 EDT 2021 ==== == cache: total 28 == cache: drwx------ 260 kmohrman campus 8192 Jun 15 02:58 ex_parrot_kmohrman == cache: -rw-r--r-- 1 kmohrman campus 10 Jun 14 17:55 hot_cache == cache: drwxr-x--- 260 kmohrman campus 8192 Jun 14 17:37 cvmfs === OSG certificate location: /cvmfs/oasis.opensciencegrid.org/mis/certificates @ Tue Jun 15 03:04:05 EDT 2021 === testing parrot usage @ Tue Jun 15 03:04:05 EDT 2021 === parrot OK @ Tue Jun 15 03:04:10 EDT 2021 === starting parrot to access CMSSW... @ Tue Jun 15 03:04:10 EDT 2021 ==== wrapper started @ Tue Jun 15 03:04:10 EDT 2021 ==== == startup: hostname: d8civy159.crc.nd.edu == startup: kernel: Linux d8civy159.crc.nd.edu 3.10.0-1160.el7.x86_64 #1 SMP Tue Aug 18 14:50:17 EDT 2020 x86_64 x86_64 x86_64 GNU/Linux ==== tracing google @ Tue Jun 15 03:04:10 EDT 2021 ==== wrapper.sh: line 20: traceroute: command not found ==== environment at startup @ Tue Jun 15 03:04:10 EDT 2021 ==== == env: VC3_VERSION_SED=4.2 == env: CCTOOLS_RESOURCE_PROCESS_START=1623740650361894 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/usr/ == env: LOBSTER_GFAL_COPY= == env: MAKEFLAGS=-j4 == env: PARROT_HELPER=/disk/vc3-root/tmp/worker-230547-5860/t.894850/lib/libparrot_helper.so == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-5860/t.894850/cctools-temp-t.894850.mNp8yU == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-5860/t.894850/librmonitor_helper.so.dpNbUr == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: LD_LIBRARY_PATH=/.singularity.d/libs:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-5860/t.894850/cctools-temp-t.894850.mNp8yU == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/usr/ == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-0wnKJj == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-5860/cache/tmp == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: PARROT_CVMFS_REPO= == env: VC3_VERSION_GZIP=1.5 == env: PATH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ENV_TAG_GLOBAL=5606 == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-0wnKJj == env: PWD=/disk/vc3-root/tmp/worker-230547-5860/t.894850 == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_WHICH=2.20 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: LOBSTER_LCG_CP= == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-5860 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/usr/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: CXX=g++ == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: DISK=6000 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-5860/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-5860/cache/tmp/cvmfs == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=7800 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TMP=/disk/vc3-root/tmp/worker-230547-5860/t.894850/cctools-temp-t.894850.mNp8yU == env: PYTHONPATH=python: == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_ROOT_TAR=/usr/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-0wnKJj.wrapper == env: CC=gcc == env: CCTOOLS_RESOURCE_MONITOR_INFO=1024 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=6 == env: PARROT_DEBUG_FLAGS= == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_CRC_postLHE.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=17043 == env: _=/usr/bin/env ==== cpu info @ Tue Jun 15 03:04:10 EDT 2021 ==== == cpu: processor : 0 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3006.408 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 0 == cpu: cpu cores : 8 == cpu: apicid : 0 == cpu: initial apicid : 0 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.15 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 1 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 1 == cpu: cpu cores : 8 == cpu: apicid : 2 == cpu: initial apicid : 2 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.15 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 2 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3002.600 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 2 == cpu: cpu cores : 8 == cpu: apicid : 4 == cpu: initial apicid : 4 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.15 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 3 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 3 == cpu: cpu cores : 8 == cpu: apicid : 6 == cpu: initial apicid : 6 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.15 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 4 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 4 == cpu: cpu cores : 8 == cpu: apicid : 8 == cpu: initial apicid : 8 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.15 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 5 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3002.282 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 5 == cpu: cpu cores : 8 == cpu: apicid : 10 == cpu: initial apicid : 10 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.15 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 6 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.584 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 6 == cpu: cpu cores : 8 == cpu: apicid : 12 == cpu: initial apicid : 12 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.15 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 7 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 7 == cpu: cpu cores : 8 == cpu: apicid : 14 == cpu: initial apicid : 14 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.15 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 8 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 0 == cpu: cpu cores : 8 == cpu: apicid : 32 == cpu: initial apicid : 32 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.28 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 9 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3000.695 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 1 == cpu: cpu cores : 8 == cpu: apicid : 34 == cpu: initial apicid : 34 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.28 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 10 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 2 == cpu: cpu cores : 8 == cpu: apicid : 36 == cpu: initial apicid : 36 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.28 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 11 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 3 == cpu: cpu cores : 8 == cpu: apicid : 38 == cpu: initial apicid : 38 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.28 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 12 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 4 == cpu: cpu cores : 8 == cpu: apicid : 40 == cpu: initial apicid : 40 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.28 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 13 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2997.204 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 5 == cpu: cpu cores : 8 == cpu: apicid : 42 == cpu: initial apicid : 42 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.28 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 14 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 6 == cpu: cpu cores : 8 == cpu: apicid : 44 == cpu: initial apicid : 44 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.28 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 15 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 7 == cpu: cpu cores : 8 == cpu: apicid : 46 == cpu: initial apicid : 46 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.28 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: === using parrot @ Tue Jun 15 03:04:11 EDT 2021 === sourcing CMS setup @ Tue Jun 15 03:04:11 EDT 2021 LibCvmfs version 2.4, revision 25 === sourcing OSG setup @ Tue Jun 15 03:04:12 EDT 2021 ==== environment after sourcing startup scripts @ Tue Jun 15 03:04:12 EDT 2021 ==== == env: VC3_VERSION_SED=4.2 == env: MANPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/man:/cvmfs/cms.cern.ch/share/man: == env: CCTOOLS_RESOURCE_PROCESS_START=1623740652613038 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: GFAL_PLUGIN_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/gfal2-plugins/ == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/usr/ == env: LOBSTER_GFAL_COPY=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin/gfal-copy == env: VOMS_USERCONF=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/vomses == env: MAKEFLAGS=-j4 == env: GLOBUS_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-5860/t.894850/cctools-temp-t.894850.mNp8yU == env: PERL5LIB=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5 == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: CVSROOT=:gserver:cmssw.cvs.cern.ch:/local/reps/CMSSW == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-5860/t.894850/librmonitor_helper.so.dpNbUr == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: X509_CERT_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/certificates == env: SCRAM_ARCH=slc7_amd64_gcc820 == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: LD_LIBRARY_PATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/dcap:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/lcgdm:/.singularity.d/libs:lib:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-5860/t.894850/cctools-temp-t.894850.mNp8yU == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/usr/ == env: OSG_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-0wnKJj == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-5860/cache/tmp == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: SITECONFIG_PATH=/cvmfs/cms.cern.ch/SITECONF/local == env: PARROT_CVMFS_REPO= == env: VC3_VERSION_GZIP=1.5 == env: PATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/sbin:/cvmfs/cms.cern.ch/common:/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ENV_TAG_GLOBAL=5606 == env: CMS_PATH=/cvmfs/cms.cern.ch == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-0wnKJj == env: PWD=/disk/vc3-root/tmp/worker-230547-5860/t.894850 == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_WHICH=2.20 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: X509_VOMS_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/vomsdir == env: LOBSTER_LCG_CP= == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-5860 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/usr/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: CXX=g++ == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: DISK=6000 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-5860/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-5860/cache/tmp/cvmfs == env: GFAL_CONFIG_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/gfal2.d/ == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=7800 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TMP=/disk/vc3-root/tmp/worker-230547-5860/t.894850/cctools-temp-t.894850.mNp8yU == env: PYTHONPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib/python2.7/site-packages:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/python2.7/site-packages:python:python: == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_ROOT_TAR=/usr/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-0wnKJj.wrapper == env: CC=gcc == env: CCTOOLS_RESOURCE_MONITOR_INFO=1024 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=6 == env: PARROT_DEBUG_FLAGS= == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_CRC_postLHE.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=17043 == env: _=/usr/bin/env ==== proxy information @ Tue Jun 15 03:04:12 EDT 2021 ==== == proxy: subject : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman/CN=4146303207 == proxy: issuer : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman == proxy: identity : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman == proxy: type : RFC compliant proxy == proxy: strength : 1024 bits == proxy: path : proxy == proxy: timeleft : 68:46:38 ==== working directory at startup @ Tue Jun 15 03:04:13 EDT 2021 ==== == dir: total 23224 == dir: -rw-r--r-- 2 kmohrman campus 22907139 Jun 14 18:46 UL16APV_DIGI_cfg.py == dir: drwxr-xr-x 2 kmohrman campus 71 Jun 15 03:03 bin == dir: -rwxr-xr-x 4 kmohrman campus 627272 Jun 14 17:36 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 Jun 15 03:03 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 Jun 15 03:03 cctools-temp-t.894850.mNp8yU == dir: -rw------- 1 kmohrman campus 51 Jun 15 03:04 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 Jun 15 03:04 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 Jun 15 03:03 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 Jun 15 03:03 librmonitor_helper.so.dpNbUr == dir: -rw-r--r-- 2 kmohrman campus 2132 Jun 15 03:03 parameters.json == dir: -rw------- 2 kmohrman campus 9949 Jun 15 03:03 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 Jun 15 03:03 python == dir: -rw-r--r-- 4 kmohrman campus 570 Jun 14 17:36 report.json.in == dir: -rw-r--r-- 2 kmohrman campus 593 Jun 14 17:36 sandbox-CMSSW_10_6_17_patch1-slc7_amd64_gcc700.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 37 Jun 15 03:03 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 Jun 15 03:04 t_wrapper_start == dir: -rwxr-xr-x 4 kmohrman campus 47217 Jun 14 17:36 task.py == dir: -rwxr-xr-x 4 kmohrman campus 5986 Jun 14 17:36 wrapper.sh === creating new release CMSSW_10_6_17_patch1 for scram arch slc7_amd64_gcc700 @ Tue Jun 15 03:04:13 EDT 2021 WARNING: In non-interactive mode release checks e.g. deprecated releases, production architectures are disabled. === unpacking sandbox-CMSSW_10_6_17_patch1-slc7_amd64_gcc700.tar.bz2 @ Tue Jun 15 03:04:19 EDT 2021 ==== machine load @ Tue Jun 15 03:04:21 EDT 2021 ==== top: unknown option 'M' Usage: top -hv | -bcHiOSs -d secs -n max -u|U user -p pid(s) -o field -w [cols] ==== environment before execution @ Tue Jun 15 03:04:22 EDT 2021 ==== == env: G4LEVELGAMMADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4PhotonEvaporation/5.2/data/PhotonEvaporation5.2 == env: UTM_XSD_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj == env: SRT_G4LEVELGAMMADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4PhotonEvaporation/5.2/data/PhotonEvaporation5.2 == env: VC3_VERSION_SED=4.2 == env: CMSSW_RELEASE_BASE=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1 == env: SCRAMRT_SET=CMSSW:CMSSW_10_6_17_patch1:slc7_amd64_gcc700:V2_2_9_pre13:SRT_ == env: MANPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/man:/cvmfs/cms.cern.ch/share/man: == env: CCTOOLS_RESOURCE_PROCESS_START=1623740662010348 == env: CMSSW_FWLITE_INCLUDE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include == env: SRT_GCC_RUNTIME_ASAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: ROOT_INCLUDE_PATH=/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/include/slc7_amd64_gcc700/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/include/LCG:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mctester/1.25.0a-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dd4hep/v01-10x-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtDesigner:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauolapp/1.1.5-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/charybdis/1.003-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include/SHERPA-MC:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtOpenGL:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtGui:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwig/6.521-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt3Support:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lwtnn/2.4-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4/10.4.3-pafccj2/include/Geant4:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/classlib/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cgal/4.2-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tkonlinesw/4.2.0-1_gcc7-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/starlight/r193-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtCore:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtXml:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mcdb/1.0.3-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libungif/4.1.4-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libtiff/4.0.3-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/highfive/2.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libpng/1.6.16-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pcre/8.37-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/include/xrootd/private:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/vdt/0.4.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/toprex/4.23-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tbb/2019_U3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauola/27.121.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sigcpp/2.6.2-pafccj/include/sigc++-2.0:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sqlite/3.22.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/protobuf/3.5.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pacparser/1.3.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/oracle/12.1.0.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/py2-numpy/1.16.2-nmpfii2/c-api/core/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/meschach/1.2.pCMS1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libuuid/2.22.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libunwind/1.2.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libhepml/0.2.1-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ktjet/1.06-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jimmy/4.2-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jemalloc/5.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hls/2019.08/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj10:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hector/1.3.4_patch1-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libjpeg-turbo/2.0.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/giflib/4.2.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gsl/2.2.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gdbm/1.10-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/freetype/2.5.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftw3/3.3.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftjet/1.5.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/expat/2.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dpm/1.8.0.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vecgeom/v00.05.00-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xerces-c/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xz/5.2.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dcap/2.47.8-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libxml2/2.9.1-pafccj/include/libxml2:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/curl/7.59.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cppunit/1.40.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openssl/1.0.2d-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia6/426-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/photos/215.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/zlib-x86_64/1.2.11-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/bz2lib/1.0.6-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/include/python2.7:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tinyxml2/6.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ittnotify/16.06.18-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj/include:/usr/local/include:/usr/include == env: INTEL_LICENSE_FILE=28518@lxlicen01.cern.ch,28518@lxlicen02.cern.ch,28518@lxlicen03.cern.ch == env: SRT_TEXMFHOME_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/share/Rivet/texmf == env: SRT_GEANT4_PARFULLCMS_CONFIG_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-parfullcms/2014.01.27-pafccj2/share/ParFullCMS == env: GFAL_PLUGIN_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/gfal2-plugins/ == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/usr/ == env: LOBSTER_GFAL_COPY=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin/gfal-copy == env: PDFPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/share == env: CMSSW_FULL_RELEASE_BASE=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17 == env: SRT_TNS_ADMIN_SCRAMRTDEL=/etc == env: VOMS_USERCONF=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/vomses == env: MAKEFLAGS=-j4 == env: ROOT_GCC_TOOLCHAIN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: GLOBUS_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-5860/t.894850/cctools-temp-t.894850.mNp8yU == env: G4FORCENUMBEROFTHREADS=max == env: OPENBLAS_NUM_THREADS=1 == env: SRT_PDFPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/share == env: PERL5LIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5 == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: CMSSW_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms == env: LHAPDF_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/share/LHAPDF == env: CVSROOT=:gserver:cmssw.cvs.cern.ch:/local/reps/CMSSW == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-5860/t.894850/librmonitor_helper.so.dpNbUr == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: CMSSW_GIT_HASH=CMSSW_10_6_17_patch1 == env: SRT_G4ABLADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ABLA/3.0/data/G4ABLA3.0 == env: QTDIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2 == env: SRT_SCONS_LIB_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/scons/3.0.1-pafccj/lib == env: OLDPWD=/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1 == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: G4NEUTRONXSDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NEUTRONXS/1.4/data/G4NEUTRONXS1.4 == env: QTINC=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include == env: X509_CERT_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/certificates == env: SCRAM_ARCH=slc7_amd64_gcc700 == env: GIT_SSL_CAINFO=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/ssl/certs/ca-bundle.crt == env: SRT_CMS_OPENLOOPS_PREFIX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openloops/2.1.0-pafccj2 == env: SRT_GIT_EXEC_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/libexec/git-core == env: SRT_THEPEGPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj/share/ThePEG == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: ROOT_TTREECACHE_SIZE=0 == env: EVTGENDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/evtgen/1.6.0-pafccj5/share == env: SRT_INTEL_LICENSE_FILE_SCRAMRTDEL=28518@lxlicen01.cern.ch,28518@lxlicen02.cern.ch,28518@lxlicen03.cern.ch == env: SRT_ROOT_INCLUDE_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/include/slc7_amd64_gcc700/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/include/LCG:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mctester/1.25.0a-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dd4hep/v01-10x-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtDesigner:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauolapp/1.1.5-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/charybdis/1.003-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include/SHERPA-MC:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtOpenGL:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtGui:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwig/6.521-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt3Support:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lwtnn/2.4-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4/10.4.3-pafccj2/include/Geant4:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/classlib/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cgal/4.2-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tkonlinesw/4.2.0-1_gcc7-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/starlight/r193-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtCore:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtXml:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mcdb/1.0.3-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libungif/4.1.4-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libtiff/4.0.3-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/highfive/2.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libpng/1.6.16-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pcre/8.37-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/include/xrootd/private:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/vdt/0.4.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/toprex/4.23-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tbb/2019_U3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauola/27.121.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sigcpp/2.6.2-pafccj/include/sigc++-2.0:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sqlite/3.22.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/protobuf/3.5.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pacparser/1.3.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/oracle/12.1.0.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/py2-numpy/1.16.2-nmpfii2/c-api/core/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/meschach/1.2.pCMS1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libuuid/2.22.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libunwind/1.2.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libhepml/0.2.1-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ktjet/1.06-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jimmy/4.2-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jemalloc/5.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hls/2019.08/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj10:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hector/1.3.4_patch1-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libjpeg-turbo/2.0.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/giflib/4.2.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gsl/2.2.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gdbm/1.10-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/freetype/2.5.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftw3/3.3.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftjet/1.5.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/expat/2.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dpm/1.8.0.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vecgeom/v00.05.00-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xerces-c/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xz/5.2.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dcap/2.47.8-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libxml2/2.9.1-pafccj/include/libxml2:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/curl/7.59.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cppunit/1.40.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openssl/1.0.2d-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia6/426-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/photos/215.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/zlib-x86_64/1.2.11-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/bz2lib/1.0.6-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/include/python2.7:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tinyxml2/6.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ittnotify/16.06.18-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj/include:/usr/local/include:/usr/include == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: G4LEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4EMLOW/7.3/data/G4EMLOW7.3 == env: SRT_VINCIADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vincia/2.2.04-pafccj5/share/Vincia/xmldoc == env: SRT_ROOT_TTREECACHE_PREFILL_SCRAMRTDEL=0 == env: OPAL_PREFIX=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openmpi/2.1.5-pafccj == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: ROOT_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj10:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: SHERPA_INCLUDE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include/SHERPA-MC == env: SRT_LHAPDF_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/share/LHAPDF == env: SRT_PYTHON27PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1/python:/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch-tool-conf/CMSSW_10_6_17/lib/python2.7/site-packages == env: LD_LIBRARY_PATH=/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1/biglib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/biglib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/biglib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cuda/10.1.105-pafccj2/drivers:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/dcap:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/lcgdm:/.singularity.d/libs:lib:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-5860/t.894850/cctools-temp-t.894850.mNp8yU == env: SRT_CMSSW_RELEASE_BASE_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1 == env: SRT_RIVET_ANALYSIS_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/lib == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: SRT_PERL5LIB_SCRAMRT=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/perl5 == env: SRT_CMSSW_VERSION_SCRAMRTDEL=CMSSW_10_6_17_patch1 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/usr/ == env: GCC_RUNTIME_LSAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: SCRAM_CXX11_ABI=1 == env: VALGRIND_LIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/lib/valgrind == env: SRT_CMSSW_GIT_HASH_SCRAMRTDEL=CMSSW_10_6_17_patch1 == env: SRT_ROOTSYS_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/ == env: OSG_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-0wnKJj == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-5860/cache/tmp == env: G4NEUTRONHPDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NDL/4.5/data/G4NDL4.5 == env: GEANT4_PARFULLCMS_CONFIG_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-parfullcms/2014.01.27-pafccj2/share/ParFullCMS == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: CSC_TRACK_FINDER_DATA_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/CSCTrackFinderEmulation/1.2-pafccj/data/ == env: SRT_QTINC_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: G4ENSDFSTATEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ENSDFSTATE/2.2/data/G4ENSDFSTATE2.2 == env: G4RADIOACTIVEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4RadioactiveDecay/5.2/data/RadioactiveDecay5.2 == env: ROOFITSYS=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/ == env: SRT_ROOFITSYS_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/ == env: SRT_G4RADIOACTIVEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4RadioactiveDecay/5.2/data/RadioactiveDecay5.2 == env: SRT_G4ENSDFSTATEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ENSDFSTATE/2.2/data/G4ENSDFSTATE2.2 == env: SRT_CLHEP_PARAM_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2 == env: G4ABLADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ABLA/3.0/data/G4ABLA3.0 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: SRT_SHERPA_INCLUDE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include/SHERPA-MC == env: SRT_G4FORCENUMBEROFTHREADS_SCRAMRTDEL=max == env: SRT_WORKER_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/blackhat/0.9.9-pafccj/share/blackhat/datafiles/ == env: SITECONFIG_PATH=/cvmfs/cms.cern.ch/SITECONF/local == env: PARROT_CVMFS_REPO= == env: VC3_VERSION_GZIP=1.5 == env: GCC_RUNTIME_TSAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libtsan.so == env: TNS_ADMIN=/etc == env: SRT_HEPPDT_PARAM_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj == env: PATH=/cvmfs/cms.cern.ch/share/overrides/bin:/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1/bin/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/sbin:/cvmfs/cms.cern.ch/common:/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ENV_TAG_GLOBAL=5606 == env: THEPEGPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj/share/ThePEG == env: SRT_CMSSW_SEARCH_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1/poison:/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1/src:/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/data:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/poison:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/data == env: SRT_GIT_SSL_CAINFO_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/ssl/certs/ca-bundle.crt == env: SRT_GCC_RUNTIME_LSAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: CMS_PATH=/cvmfs/cms.cern.ch == env: VC3_ROOT=/disk/vc3-root == env: SRT_UTM_XSD_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj == env: SRT_PATH_SCRAMRT=/cvmfs/cms.cern.ch/share/overrides/bin:/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1/bin/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/bin == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-0wnKJj == env: RIVET_ANALYSIS_PATH=/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/lib == env: SRT_LOCALRT_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1 == env: SRT_CMSSW_BASE_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1 == env: PWD=/disk/vc3-root/tmp/worker-230547-5860/t.894850 == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: PYTHON_VALGRIND_SUPP=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/share/valgrind/valgrind-python.supp == env: SRT_OPAL_PREFIX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openmpi/2.1.5-pafccj == env: VC3_VERSION_WHICH=2.20 == env: GCC_RUNTIME_UBSAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libubsan.so == env: LANG=C == env: SRT_QTDIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: SRT_G4NEUTRONHPDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NDL/4.5/data/G4NDL4.5 == env: X509_VOMS_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/vomsdir == env: LOBSTER_LCG_CP= == env: SRT_SHERPA_SHARE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/share/SHERPA-MC == env: SRT_GCC_RUNTIME_TSAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libtsan.so == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-5860 == env: CASCADE_PDFPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/share == env: SRT_ROOT_GCC_TOOLCHAIN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: SRT_CASCADE_PDFPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/share == env: WORKER_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/blackhat/0.9.9-pafccj/share/blackhat/datafiles/ == env: GIT_TEMPLATE_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/git-core/templates == env: G4SAIDXSDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4SAIDDATA/1.1/data/G4SAIDDATA1.1 == env: MLAS_DYNAMIC_CPU_ARCH=0 == env: SRT_CMSSW_FULL_RELEASE_BASE_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: PYTHON27PATH=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1/python:/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch-tool-conf/CMSSW_10_6_17/lib/python2.7/site-packages == env: SRT_CMSSW_FWLITE_INCLUDE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/usr/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: ROOTSYS=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/ == env: SRT_PYTHIA8DATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/share/Pythia8/xmldoc == env: SRT_HERWIGPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj/share/Herwig == env: CXX=g++ == env: SRT_QTLIB_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/lib == env: SRT_PYTHON3PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1/python:/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch-tool-conf/CMSSW_10_6_17/lib/python3.6/site-packages == env: SHERPA_LIBRARY_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/lib/SHERPA-MC == env: SRT_PYTHON_VALGRIND_SUPP_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/share/valgrind/valgrind-python.supp == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: CMSSW_SEARCH_PATH=/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1/poison:/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1/src:/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/data:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/poison:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/data == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: GENEVA_DATA_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geneva/1.0-RC3-pafccj8/share/Geneva == env: DISK=6000 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-5860/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-5860/cache/tmp/cvmfs == env: GOSAMCONTRIB_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: ROOT_TTREECACHE_PREFILL=0 == env: GENREFLEX=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/bin/genreflex == env: VINCIADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vincia/2.2.04-pafccj5/share/Vincia/xmldoc == env: SRT_G4LEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4EMLOW/7.3/data/G4EMLOW7.3 == env: SRT_GENREFLEX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/bin/genreflex == env: SRT_GOSAMCONTRIB_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: SRT_ROOT_TTREECACHE_SIZE_SCRAMRTDEL=0 == env: SRT_EVTGENDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/evtgen/1.6.0-pafccj5/share == env: SRT_GENEVA_DATA_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geneva/1.0-RC3-pafccj8/share/Geneva == env: GFAL_CONFIG_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/gfal2.d/ == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=7800 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: SRT_CMSSW_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms == env: HEPPDT_PARAM_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj == env: SRT_LD_LIBRARY_PATH_SCRAMRT=/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1/biglib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/biglib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/biglib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cuda/10.1.105-pafccj2/drivers == env: TMP=/disk/vc3-root/tmp/worker-230547-5860/t.894850/cctools-temp-t.894850.mNp8yU == env: PYTHONPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib/python2.7/site-packages:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/python2.7/site-packages:python:python: == env: PYTHON3PATH=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1/python:/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch-tool-conf/CMSSW_10_6_17/lib/python3.6/site-packages == env: QTLIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/lib == env: SCONS_LIB_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/scons/3.0.1-pafccj/lib == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: COMPILER_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: FRONTIER_CLIENT=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/ == env: SRT_G4NEUTRONXSDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NEUTRONXS/1.4/data/G4NEUTRONXS1.4 == env: SRT_SHERPA_LIBRARY_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/lib/SHERPA-MC == env: VC3_ROOT_TAR=/usr/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CLHEP_PARAM_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2 == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-0wnKJj.wrapper == env: PYTHIA8DATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/share/Pythia8/xmldoc == env: HERWIGPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj/share/Herwig == env: SRT_FRONTIER_CLIENT_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/ == env: SRT_COMPILER_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: SRT_CSC_TRACK_FINDER_DATA_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/CSCTrackFinderEmulation/1.2-pafccj/data/ == env: GCC_RUNTIME_ASAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: SRT_ROOT_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj10:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: CC=gcc == env: TEXMFHOME=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/share/Rivet/texmf == env: SRT_MLAS_DYNAMIC_CPU_ARCH_SCRAMRTDEL=0 == env: SRT_OPENBLAS_NUM_THREADS_SCRAMRTDEL=1 == env: SRT_GIT_TEMPLATE_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/git-core/templates == env: SRT_G4SAIDXSDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4SAIDDATA/1.1/data/G4SAIDDATA1.1 == env: CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: SRT_GCC_RUNTIME_UBSAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libubsan.so == env: SRT_LANG_SCRAMRTDEL=C == env: CCTOOLS_RESOURCE_MONITOR_INFO=1024 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=6 == env: PARROT_DEBUG_FLAGS= == env: SHERPA_SHARE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/share/SHERPA-MC == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: CMS_OPENLOOPS_PREFIX=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openloops/2.1.0-pafccj2 == env: GIT_EXEC_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/libexec/git-core == env: LOCALRT=/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1 == env: CMSSW_BASE=/disk/vc3-root/tmp/worker-230547-5860/t.894850/CMSSW_10_6_17_patch1 == env: SRT_SCRAM_CXX11_ABI_SCRAMRTDEL=1 == env: SRT_VALGRIND_LIB_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/lib/valgrind == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_CRC_postLHE.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=17043 == env: _=/usr/bin/env === wrapper ready @ Tue Jun 15 03:04:24 EDT 2021 ==== working directory before execution @ Tue Jun 15 03:04:24 EDT 2021 ==== == dir: total 23232 == dir: drwxr-xr-x 18 kmohrman campus 215 Jun 15 03:04 CMSSW_10_6_17_patch1 == dir: -rw-r--r-- 2 kmohrman campus 22907139 Jun 14 18:46 UL16APV_DIGI_cfg.py == dir: drwxr-xr-x 2 kmohrman campus 71 Jun 15 03:03 bin == dir: -rwxr-xr-x 4 kmohrman campus 627272 Jun 14 17:36 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 Jun 15 03:03 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 Jun 15 03:03 cctools-temp-t.894850.mNp8yU == dir: -rw------- 1 kmohrman campus 51 Jun 15 03:04 cvmfschecksum.cms-ib.cern.ch == dir: -rw------- 1 kmohrman campus 51 Jun 15 03:04 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 Jun 15 03:04 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 Jun 15 03:03 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 Jun 15 03:03 librmonitor_helper.so.dpNbUr == dir: -rw-r--r-- 2 kmohrman campus 2132 Jun 15 03:03 parameters.json == dir: -rw------- 2 kmohrman campus 9949 Jun 15 03:03 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 Jun 15 03:03 python == dir: -rw-r--r-- 4 kmohrman campus 570 Jun 14 17:36 report.json.in == dir: -rw-r--r-- 2 kmohrman campus 593 Jun 14 17:36 sandbox-CMSSW_10_6_17_patch1-slc7_amd64_gcc700.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 37 Jun 15 03:03 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 Jun 15 03:04 t_wrapper_ready == dir: -rw-r--r-- 1 kmohrman campus 11 Jun 15 03:04 t_wrapper_start == dir: -rwxr-xr-x 4 kmohrman campus 47217 Jun 14 17:36 task.py == dir: -rwxr-xr-x 4 kmohrman campus 5986 Jun 14 17:36 wrapper.sh >>> data is {u'files': {u'info': {}, u'output_info': {}, u'skipped': []}, u'cpu_time': 0, u'exe_exit_code': 0, u'events_written': 0, u'output_size': 0, u'task_exit_code': 0, u'output_storage_element': u'', u'cache': {u'start_size': 0, u'type': 2, u'end_size': 0}, u'stageout_exit_code': 0, u'output_bare_size': 0, u'transfers': defaultdict(, {}), u'task_timing': {u'wrapper_ready': 0, u'wrapper_start': 0, u'prologue_end': 0, u'epilogue_end': 0, u'stage_out_end': 0, u'stage_in_end': 0, u'processing_end': 0}, u'events_per_run': 0} @ Tue Jun 15 03:04:31 2021 >>> Trying hdfs client access method @ Tue Jun 15 03:04:31 2021 >>> executing 'timeout 300 hdfs dfs -fs hdfs://eddie.crc.nd.edu:19000 -get /store/user/kmohrman/FullProduction/FullR2/UL16APV/Round1/Batch1/postLHE_step/v1/sim_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_479727.root SIM-00000_479727.root' @ Tue Jun 15 03:04:31 2021 >> using /disk/vc3-root/tmp/worker-230547-5860/t.894850/cctools-temp-t.894850.mNp8yU/tmpruRt0x to store command output >> cmd: timeout: failed to run command 'hdfs': No such file or directory >>>>> Unable to copy input with hdfs client @ Tue Jun 15 03:04:31 2021 >>> Trying xrootd access method @ Tue Jun 15 03:04:31 2021 >>> executing 'env XRD_LOGLEVEL=Debug timeout 300 xrdfs deepthought.crc.nd.edu stat /store/user/kmohrman/FullProduction/FullR2/UL16APV/Round1/Batch1/postLHE_step/v1/sim_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_479727.root' @ Tue Jun 15 03:04:31 2021 >> using /disk/vc3-root/tmp/worker-230547-5860/t.894850/cctools-temp-t.894850.mNp8yU/tmpq2Gknc to store command output >> cmd: [2021-06-15 03:04:31.512044 -0400][Warning][Utility ] Unable to process global config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-06-15 03:04:31.513011 -0400][Debug ][Utility ] Unable to process user config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-06-15 03:04:31.513160 -0400][Debug ][PlugInMgr ] Initializing plug-in manager... >> cmd: [2021-06-15 03:04:31.513207 -0400][Debug ][PlugInMgr ] No default plug-in, loading plug-in configs... >> cmd: [2021-06-15 03:04:31.513260 -0400][Debug ][PlugInMgr ] Processing plug-in definitions in /etc/xrootd/client.plugins.d... >> cmd: [2021-06-15 03:04:31.513340 -0400][Debug ][PlugInMgr ] Unable to process directory /etc/xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-06-15 03:04:31.513649 -0400][Debug ][PlugInMgr ] Processing plug-in definitions in /tmp/runos_singularity_home-174414865812354174866066630348448011852/.xrootd/client.plugins.d... >> cmd: [2021-06-15 03:04:31.513746 -0400][Debug ][PlugInMgr ] Unable to process directory /tmp/runos_singularity_home-174414865812354174866066630348448011852/.xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-06-15 03:04:31.513891 -0400][Debug ][App ] Executing: stat /store/user/kmohrman/FullProduction/FullR2/UL16APV/Round1/Batch1/postLHE_step/v1/sim_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_479727.root >> cmd: [2021-06-15 03:04:31.513995 -0400][Debug ][Poller ] Available pollers: built-in >> cmd: [2021-06-15 03:04:31.514055 -0400][Debug ][Poller ] Attempting to create a poller according to preference: built-in >> cmd: [2021-06-15 03:04:31.514098 -0400][Debug ][Poller ] Creating poller: built-in >> cmd: [2021-06-15 03:04:31.514145 -0400][Debug ][Poller ] Creating and starting the built-in poller... >> cmd: [2021-06-15 03:04:31.514508 -0400][Debug ][Poller ] Using 1 poller threads >> cmd: [2021-06-15 03:04:31.514562 -0400][Debug ][TaskMgr ] Starting the task manager... >> cmd: [2021-06-15 03:04:31.514690 -0400][Debug ][TaskMgr ] Task manager started >> cmd: [2021-06-15 03:04:31.514737 -0400][Debug ][JobMgr ] Starting the job manager... >> cmd: [2021-06-15 03:04:31.515078 -0400][Debug ][JobMgr ] Job manager started, 3 workers >> cmd: [2021-06-15 03:04:31.515133 -0400][Debug ][TaskMgr ] Registering task: "FileTimer task" to be run at: [2021-06-15 03:04:31 -0400] >> cmd: [2021-06-15 03:04:31.515207 -0400][Debug ][PostMaster ] Creating new channel to: deepthought.crc.nd.edu:1094 1 stream(s) >> cmd: [2021-06-15 03:04:31.515270 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-06-15 03:04:31.516507 -0400][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" to be run at: [2021-06-15 03:04:46 -0400] >> cmd: [2021-06-15 03:04:31.517448 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-06-15 03:04:31.517590 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-06-15 03:04:31.517685 -0400][Debug ][Poller ] Adding socket 0x1902a10 to the poller >> cmd: [2021-06-15 03:04:31.517953 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2021-06-15 03:04:31.518070 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-06-15 03:04:31.518555 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Got the server hand shake response (type: manager [], protocol version 500) >> cmd: [2021-06-15 03:04:31.518731 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] kXR_protocol successful (type: manager [], protocol version 500) >> cmd: [2021-06-15 03:04:31.521718 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=d8civy159.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-06-15 03:04:31.522143 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Logged in, session: 919b1000980d000039000000a49c1000 >> cmd: [2021-06-15 03:04:31.522225 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream 0 connected. >> cmd: [2021-06-15 03:04:31.522272 -0400][Debug ][Utility ] Monitor library name not set. No monitoring >> cmd: [2021-06-15 03:04:31.524438 -0400][Debug ][PostMaster ] Creating new channel to: primeradiant06.crc.nd.edu:1096 1 stream(s) >> cmd: [2021-06-15 03:04:31.524500 -0400][Debug ][PostMaster ] [primeradiant06.crc.nd.edu:1096 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-06-15 03:04:31.526237 -0400][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: primeradiant06.crc.nd.edu:1096" to be run at: [2021-06-15 03:04:46 -0400] >> cmd: [2021-06-15 03:04:31.527597 -0400][Debug ][PostMaster ] [primeradiant06.crc.nd.edu:1096] Found 1 address(es): [::ffff:149.165.243.14]:1096 >> cmd: [2021-06-15 03:04:31.527726 -0400][Debug ][AsyncSock ] [primeradiant06.crc.nd.edu:1096 #0.0] Attempting connection to [::ffff:149.165.243.14]:1096 >> cmd: [2021-06-15 03:04:31.527816 -0400][Debug ][Poller ] Adding socket 0xa80016a0 to the poller >> cmd: [2021-06-15 03:04:31.527938 -0400][Debug ][AsyncSock ] [primeradiant06.crc.nd.edu:1096 #0.0] Async connection call returned >> cmd: [2021-06-15 03:04:31.528043 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-06-15 03:04:31.528383 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] Got the server hand shake response (type: server [], protocol version 500) >> cmd: [2021-06-15 03:04:31.528554 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] kXR_protocol successful (type: server [], protocol version 500) >> cmd: [2021-06-15 03:04:31.530944 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=d8civy159.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-06-15 03:04:31.531274 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] Logged in, session: 24cf040037040000d10000007bd00400 >> cmd: [2021-06-15 03:04:31.531326 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] Authentication is required: &P=gsi,v:10400,c:ssl,ca:ba240aa8.0|f5f0dfc2.0 >> cmd: [2021-06-15 03:04:31.531381 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] Sending authentication data >> cmd: [2021-06-15 03:04:31.538149 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] Trying to authenticate using gsi >> cmd: [2021-06-15 03:04:31.602823 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] Sending more authentication data for gsi >> cmd: [2021-06-15 03:04:31.607408 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] Authenticated with gsi. >> cmd: [2021-06-15 03:04:31.607489 -0400][Debug ][PostMaster ] [primeradiant06.crc.nd.edu:1096 #0] Stream 0 connected. >> cmd: Path: /store/user/kmohrman/FullProduction/FullR2/UL16APV/Round1/Batch1/postLHE_step/v1/sim_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_479727.root >> cmd: Id: 0 >> cmd: Size: 153051346 >> cmd: MTime: 2021-06-07 07:07:34 >> cmd: Flags: 24 (Offline|IsReadable) >> cmd: [2021-06-15 03:04:31.609254 -0400][Debug ][JobMgr ] Stopping the job manager... >> cmd: [2021-06-15 03:04:31.609714 -0400][Debug ][JobMgr ] Job manager stopped >> cmd: [2021-06-15 03:04:31.609764 -0400][Debug ][TaskMgr ] Stopping the task manager... >> cmd: [2021-06-15 03:04:31.610027 -0400][Debug ][TaskMgr ] Task manager stopped >> cmd: [2021-06-15 03:04:31.610076 -0400][Debug ][Poller ] Stopping the poller... >> cmd: [2021-06-15 03:04:31.610342 -0400][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" >> cmd: [2021-06-15 03:04:31.610394 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-06-15 03:04:31.610440 -0400][Debug ][Poller ] <[::ffff:10.32.80.142]:58822><--><[::ffff:129.74.85.55]:1094> Removing socket from the poller >> cmd: [2021-06-15 03:04:31.610517 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Destroying stream >> cmd: [2021-06-15 03:04:31.610564 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-06-15 03:04:31.610610 -0400][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: primeradiant06.crc.nd.edu:1096" >> cmd: [2021-06-15 03:04:31.610652 -0400][Debug ][AsyncSock ] [primeradiant06.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2021-06-15 03:04:31.610694 -0400][Debug ][Poller ] <[::ffff:10.32.80.142]:37788><--><[::ffff:149.165.243.14]:1096> Removing socket from the poller >> cmd: [2021-06-15 03:04:31.610767 -0400][Debug ][PostMaster ] [primeradiant06.crc.nd.edu:1096 #0] Destroying stream >> cmd: [2021-06-15 03:04:31.610811 -0400][Debug ][AsyncSock ] [primeradiant06.crc.nd.edu:1096 #0.0] Closing the socket >>> will stream using xrootd instead of copying @ Tue Jun 15 03:04:31 2021 >>> modified input files @ Tue Jun 15 03:04:31 2021 >> input: root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL16APV/Round1/Batch1/postLHE_step/v1/sim_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_479727.root >>> updated parameters are @ Tue Jun 15 03:04:31 2021 >> json: { >> json: "accelerate stage-in": 3, >> json: "arguments": [], >> json: "cores": 6, >> json: "default ce": "T3_US_NotreDame", >> json: "default host": "earth.crc.nd.edu", >> json: "default se": "T3_US_NotreDame", >> json: "disable streaming": false, >> json: "epilogue": null, >> json: "executable": "cmsRun", >> json: "file map": { >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL16APV/Round1/Batch1/postLHE_step/v1/sim_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_479727.root": "sim_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_479727.root" >> json: }, >> json: "gridpack": false, >> json: "input": [ >> json: "hdfs://eddie.crc.nd.edu:19000/store/user/kmohrman/FullProduction/FullR2/UL16APV/Round1/Batch1/postLHE_step/v1/", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL16APV/Round1/Batch1/postLHE_step/v1/", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL16APV/Round1/Batch1/postLHE_step/v1", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL16APV/Round1/Batch1/postLHE_step/v1", >> json: "file:///hadoop/store/user/kmohrman/FullProduction/FullR2/UL16APV/Round1/Batch1/postLHE_step/v1/" >> json: ], >> json: "mask": { >> json: "events": -1, >> json: "files": [ >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL16APV/Round1/Batch1/postLHE_step/v1/sim_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_479727.root" >> json: ], >> json: "lumis": { >> json: "1": [ >> json: [ >> json: 45877, >> json: 45877 >> json: ] >> json: ] >> json: } >> json: }, >> json: "monitoring": { >> json: "monitorid": null, >> json: "syncid": null, >> json: "taskid": "lobster_kmohrman_EFT_CRC_postLHE_crc_20210603_0734_4a1110d3110b5a7c" >> json: }, >> json: "output": [ >> json: "hdfs://eddie.crc.nd.edu:19000/store/user/kmohrman/FullProduction/FullR2/UL16APV/Round1/Batch1/postLHE_step/v1/", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL16APV/Round1/Batch1/postLHE_step/v1/", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL16APV/Round1/Batch1/postLHE_step/v1", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL16APV/Round1/Batch1/postLHE_step/v1", >> json: "file:///hadoop/store/user/kmohrman/FullProduction/FullR2/UL16APV/Round1/Batch1/postLHE_step/v1/" >> json: ], >> json: "output files": [ >> json: [ >> json: "DIGI-00000.root", >> json: "digi_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0/DIGI-00000_894850.root" >> json: ] >> json: ], >> json: "prologue": null, >> json: "pset": "UL16APV_DIGI_cfg.py", >> json: "want summary": true >> json: } >>> using sync CE T3_US_NotreDame @ Tue Jun 15 03:04:31 2021 >>> config file fragment @ Tue Jun 15 03:04:33 2021 >> pset: >> pset: import FWCore.ParameterSet.Config as cms >> pset: process.Timing = cms.Service("Timing", >> pset: useJobReport = cms.untracked.bool(True), >> pset: summaryOnly = cms.untracked.bool(True)) >> pset: >> pset: process.maxEvents = cms.untracked.PSet(input = cms.untracked.int32(-1)) >> pset: >> pset: import os >> pset: _, major, minor, _ = os.environ["CMSSW_VERSION"].split('_', 3) >> pset: if int(major) >= 7 and int(minor) >= 4: >> pset: xrdstats = cms.Service("XrdAdaptor::XrdStatisticsService", cms.untracked.PSet(reportToFJR = cms.untracked.bool(True))) >> pset: process.add_(xrdstats) >> pset: >> pset: for prod in process.producers.values(): >> pset: if prod.hasParameter('nEvents') and prod.type_() == 'ExternalLHEProducer': >> pset: prod.nEvents = cms.untracked.uint32(-1) >> pset: >> pset: process.source.fileNames = cms.untracked.vstring(['root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL16APV/Round1/Batch1/postLHE_step/v1/sim_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_479727.root']) >> pset: process.source.lumisToProcess = cms.untracked.VLuminosityBlockRange(['1:45877']) >> pset: if hasattr(process, 'options'): >> pset: process.options.wantSummary = cms.untracked.bool(True) >> pset: else: >> pset: process.options = cms.untracked.PSet(wantSummary = cms.untracked.bool(True)) >> pset: >> pset: if hasattr(process, 'options'): >> pset: process.options.numberOfThreads = cms.untracked.uint32(6) >> pset: process.options.numberOfStreams = cms.untracked.uint32(0) >> pset: else: >> pset: process.options = cms.untracked.PSet( >> pset: numberOfThreads = cms.untracked.uint32(6), >> pset: numberOfStreams = cms.untracked.uint32(0) >> pset: ) >>> executing 'cmsRun -j report.xml UL16APV_DIGI_cfg_mod.py' @ Tue Jun 15 03:04:33 2021 >> using /disk/vc3-root/tmp/worker-230547-5860/t.894850/cctools-temp-t.894850.mNp8yU/tmp4113mr to store command output >> cmd: %MSG-i ThreadStreamSetup: (NoModuleName) 15-Jun-2021 03:04:48 EDT pre-events >> cmd: setting # threads 6 >> cmd: setting # streams 6 >> cmd: %MSG >> cmd: 15-Jun-2021 03:04:56 EDT Initiating request to open file root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL16APV/Round1/Batch1/postLHE_step/v1/sim_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_479727.root >> cmd: 15-Jun-2021 03:05:01 EDT Successfully opened file root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL16APV/Round1/Batch1/postLHE_step/v1/sim_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_479727.root >> cmd: 15-Jun-2021 03:05:07 EDT Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/120011/14EE4778-6026-BA46-B37D-0497D9F17C37.root >> cmd: 15-Jun-2021 03:05:15 EDT Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/120011/14EE4778-6026-BA46-B37D-0497D9F17C37.root >> cmd: 15-Jun-2021 03:05:25 EDT Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/130030/02B49B51-0BDE-6D48-8DAF-FB25A2DED821.root >> cmd: 15-Jun-2021 03:05:32 EDT Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/130030/02B49B51-0BDE-6D48-8DAF-FB25A2DED821.root >> cmd: 15-Jun-2021 03:05:41 EDT Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/280009/635367DB-007C-114E-844D-CE4DEFFB491F.root >> cmd: 15-Jun-2021 03:05:44 EDT Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/280009/635367DB-007C-114E-844D-CE4DEFFB491F.root >> cmd: 15-Jun-2021 03:05:51 EDT Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/280010/D2D00ECB-5082-FA4B-B973-F30203D80D4B.root >> cmd: 15-Jun-2021 03:05:58 EDT Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/280010/D2D00ECB-5082-FA4B-B973-F30203D80D4B.root >> cmd: 15-Jun-2021 03:06:05 EDT Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/260024/48ACCFE9-FE9A-034B-BEAF-135C0EDC0CC7.root >> cmd: 15-Jun-2021 03:06:13 EDT Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/260024/48ACCFE9-FE9A-034B-BEAF-135C0EDC0CC7.root >> cmd: 15-Jun-2021 03:06:22 EDT Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/260025/B70C8BC8-64A4-A641-B7E2-4FD53D43B290.root >> cmd: 15-Jun-2021 03:06:33 EDT Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/260025/B70C8BC8-64A4-A641-B7E2-4FD53D43B290.root >> cmd: Begin processing the 1st record. Run 1, Event 5, LumiSection 45877 on stream 5 at 15-Jun-2021 03:06:44.109 EDT >> cmd: Begin processing the 2nd record. Run 1, Event 2, LumiSection 45877 on stream 3 at 15-Jun-2021 03:06:44.110 EDT >> cmd: Begin processing the 3rd record. Run 1, Event 7, LumiSection 45877 on stream 1 at 15-Jun-2021 03:06:44.111 EDT >> cmd: Begin processing the 4th record. Run 1, Event 11, LumiSection 45877 on stream 4 at 15-Jun-2021 03:06:44.112 EDT >> cmd: Begin processing the 5th record. Run 1, Event 10, LumiSection 45877 on stream 0 at 15-Jun-2021 03:06:44.113 EDT >> cmd: Begin processing the 6th record. Run 1, Event 16, LumiSection 45877 on stream 2 at 15-Jun-2021 03:06:44.113 EDT >> cmd: 15-Jun-2021 03:07:22 EDT Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/120011/14EE4778-6026-BA46-B37D-0497D9F17C37.root >> cmd: 15-Jun-2021 03:07:22 EDT Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/1320000/32DD6B21-79D2-124F-BF27-D2EB0939C19B.root >> cmd: 15-Jun-2021 03:07:29 EDT Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/1320000/32DD6B21-79D2-124F-BF27-D2EB0939C19B.root >> cmd: 15-Jun-2021 03:07:29 EDT Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/260025/B70C8BC8-64A4-A641-B7E2-4FD53D43B290.root >> cmd: 15-Jun-2021 03:07:29 EDT Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/260024/48ACCFE9-FE9A-034B-BEAF-135C0EDC0CC7.root >> cmd: 15-Jun-2021 03:07:29 EDT Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/280010/D2D00ECB-5082-FA4B-B973-F30203D80D4B.root >> cmd: 15-Jun-2021 03:07:29 EDT Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/130030/02B49B51-0BDE-6D48-8DAF-FB25A2DED821.root >> cmd: 15-Jun-2021 03:07:29 EDT Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/130028/4F66312E-BA5A-D449-A6C9-FDBD1C8C0CB3.root >> cmd: 15-Jun-2021 03:07:29 EDT Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/280009/635367DB-007C-114E-844D-CE4DEFFB491F.root >> cmd: 15-Jun-2021 03:07:29 EDT Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/120013/D42EB1DD-A80F-4145-8AF2-E8C997A00129.root >> cmd: 15-Jun-2021 03:07:29 EDT Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/120008/1D7B72A4-2035-D444-8028-6CA0445DF15F.root >> cmd: 15-Jun-2021 03:07:29 EDT Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/270011/D2D46AD5-7BB6-A443-AB11-1ABEF43D03A3.root >> cmd: 15-Jun-2021 03:07:29 EDT Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/260010/032CA55D-DA59-0A40-9621-3E672AC8B7CE.root >> cmd: 15-Jun-2021 03:07:32 EDT Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/120013/D42EB1DD-A80F-4145-8AF2-E8C997A00129.root >> cmd: 15-Jun-2021 03:07:39 EDT Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/120008/1D7B72A4-2035-D444-8028-6CA0445DF15F.root >> cmd: 15-Jun-2021 03:07:47 EDT Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/130028/4F66312E-BA5A-D449-A6C9-FDBD1C8C0CB3.root >> cmd: 15-Jun-2021 03:07:55 EDT Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/260010/032CA55D-DA59-0A40-9621-3E672AC8B7CE.root >> cmd: 15-Jun-2021 03:07:57 EDT Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/270011/D2D46AD5-7BB6-A443-AB11-1ABEF43D03A3.root >> cmd: Begin processing the 7th record. Run 1, Event 18, LumiSection 45877 on stream 0 at 15-Jun-2021 03:08:08.917 EDT >> cmd: Begin processing the 8th record. Run 1, Event 22, LumiSection 45877 on stream 2 at 15-Jun-2021 03:08:09.643 EDT >> cmd: Begin processing the 9th record. Run 1, Event 24, LumiSection 45877 on stream 3 at 15-Jun-2021 03:08:10.601 EDT >> cmd: Begin processing the 10th record. Run 1, Event 21, LumiSection 45877 on stream 2 at 15-Jun-2021 03:08:14.882 EDT >> cmd: Begin processing the 11th record. Run 1, Event 26, LumiSection 45877 on stream 4 at 15-Jun-2021 03:08:15.350 EDT >> cmd: Begin processing the 12th record. Run 1, Event 27, LumiSection 45877 on stream 5 at 15-Jun-2021 03:08:15.760 EDT >> cmd: Begin processing the 13th record. Run 1, Event 28, LumiSection 45877 on stream 1 at 15-Jun-2021 03:08:16.304 EDT >> cmd: Begin processing the 14th record. Run 1, Event 23, LumiSection 45877 on stream 0 at 15-Jun-2021 03:08:18.469 EDT >> cmd: Begin processing the 15th record. Run 1, Event 34, LumiSection 45877 on stream 3 at 15-Jun-2021 03:08:19.076 EDT >> cmd: Begin processing the 16th record. Run 1, Event 35, LumiSection 45877 on stream 5 at 15-Jun-2021 03:08:20.892 EDT >> cmd: Begin processing the 17th record. Run 1, Event 39, LumiSection 45877 on stream 4 at 15-Jun-2021 03:08:21.197 EDT >> cmd: Begin processing the 18th record. Run 1, Event 30, LumiSection 45877 on stream 2 at 15-Jun-2021 03:08:21.988 EDT >> cmd: Begin processing the 19th record. Run 1, Event 52, LumiSection 45877 on stream 1 at 15-Jun-2021 03:08:22.864 EDT >> cmd: Begin processing the 20th record. Run 1, Event 40, LumiSection 45877 on stream 0 at 15-Jun-2021 03:08:25.763 EDT >> cmd: Begin processing the 21st record. Run 1, Event 55, LumiSection 45877 on stream 3 at 15-Jun-2021 03:08:26.185 EDT >> cmd: Begin processing the 22nd record. Run 1, Event 49, LumiSection 45877 on stream 5 at 15-Jun-2021 03:08:27.206 EDT >> cmd: Begin processing the 23rd record. Run 1, Event 60, LumiSection 45877 on stream 2 at 15-Jun-2021 03:08:28.315 EDT >> cmd: Begin processing the 24th record. Run 1, Event 41, LumiSection 45877 on stream 4 at 15-Jun-2021 03:08:28.715 EDT >> cmd: Begin processing the 25th record. Run 1, Event 61, LumiSection 45877 on stream 1 at 15-Jun-2021 03:08:29.553 EDT >> cmd: Begin processing the 26th record. Run 1, Event 68, LumiSection 45877 on stream 0 at 15-Jun-2021 03:08:31.814 EDT >> cmd: Begin processing the 27th record. Run 1, Event 65, LumiSection 45877 on stream 2 at 15-Jun-2021 03:08:31.838 EDT >> cmd: Begin processing the 28th record. Run 1, Event 43, LumiSection 45877 on stream 1 at 15-Jun-2021 03:08:33.612 EDT >> cmd: Begin processing the 29th record. Run 1, Event 80, LumiSection 45877 on stream 4 at 15-Jun-2021 03:08:33.641 EDT >> cmd: Begin processing the 30th record. Run 1, Event 56, LumiSection 45877 on stream 3 at 15-Jun-2021 03:08:34.427 EDT >> cmd: Begin processing the 31st record. Run 1, Event 94, LumiSection 45877 on stream 5 at 15-Jun-2021 03:08:35.491 EDT >> cmd: Begin processing the 32nd record. Run 1, Event 92, LumiSection 45877 on stream 0 at 15-Jun-2021 03:08:36.048 EDT >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: Begin processing the 33rd record. Run 1, Event 82, LumiSection 45877 on stream 4 at 15-Jun-2021 03:08:38.915 EDT >> cmd: Begin processing the 34th record. Run 1, Event 71, LumiSection 45877 on stream 3 at 15-Jun-2021 03:08:39.505 EDT >> cmd: Begin processing the 35th record. Run 1, Event 87, LumiSection 45877 on stream 2 at 15-Jun-2021 03:08:40.209 EDT >> cmd: Begin processing the 36th record. Run 1, Event 81, LumiSection 45877 on stream 5 at 15-Jun-2021 03:08:41.499 EDT >> cmd: Begin processing the 37th record. Run 1, Event 100, LumiSection 45877 on stream 0 at 15-Jun-2021 03:08:41.524 EDT >> cmd: Begin processing the 38th record. Run 1, Event 97, LumiSection 45877 on stream 1 at 15-Jun-2021 03:08:42.138 EDT >> cmd: Begin processing the 39th record. Run 1, Event 105, LumiSection 45877 on stream 4 at 15-Jun-2021 03:08:43.962 EDT >> cmd: Begin processing the 40th record. Run 1, Event 96, LumiSection 45877 on stream 2 at 15-Jun-2021 03:08:45.583 EDT >> cmd: Begin processing the 41st record. Run 1, Event 101, LumiSection 45877 on stream 3 at 15-Jun-2021 03:08:46.132 EDT >> cmd: Begin processing the 42nd record. Run 1, Event 102, LumiSection 45877 on stream 5 at 15-Jun-2021 03:08:47.260 EDT >> cmd: Begin processing the 43rd record. Run 1, Event 118, LumiSection 45877 on stream 0 at 15-Jun-2021 03:08:47.608 EDT >> cmd: Begin processing the 44th record. Run 1, Event 121, LumiSection 45877 on stream 4 at 15-Jun-2021 03:08:48.695 EDT >> cmd: Begin processing the 45th record. Run 1, Event 106, LumiSection 45877 on stream 1 at 15-Jun-2021 03:08:48.696 EDT >> cmd: Begin processing the 46th record. Run 1, Event 126, LumiSection 45877 on stream 3 at 15-Jun-2021 03:08:51.951 EDT >> cmd: Begin processing the 47th record. Run 1, Event 120, LumiSection 45877 on stream 2 at 15-Jun-2021 03:08:51.973 EDT >> cmd: Begin processing the 48th record. Run 1, Event 127, LumiSection 45877 on stream 5 at 15-Jun-2021 03:08:53.780 EDT >> cmd: Begin processing the 49th record. Run 1, Event 123, LumiSection 45877 on stream 4 at 15-Jun-2021 03:08:53.888 EDT >> cmd: Begin processing the 50th record. Run 1, Event 133, LumiSection 45877 on stream 0 at 15-Jun-2021 03:08:54.634 EDT >> cmd: Begin processing the 51st record. Run 1, Event 134, LumiSection 45877 on stream 1 at 15-Jun-2021 03:08:55.782 EDT >> cmd: Begin processing the 52nd record. Run 1, Event 135, LumiSection 45877 on stream 3 at 15-Jun-2021 03:08:55.958 EDT >> cmd: Begin processing the 53rd record. Run 1, Event 136, LumiSection 45877 on stream 2 at 15-Jun-2021 03:08:59.913 EDT >> cmd: Begin processing the 54th record. Run 1, Event 148, LumiSection 45877 on stream 5 at 15-Jun-2021 03:09:00.556 EDT >> cmd: Begin processing the 55th record. Run 1, Event 149, LumiSection 45877 on stream 4 at 15-Jun-2021 03:09:01.155 EDT >> cmd: Begin processing the 56th record. Run 1, Event 161, LumiSection 45877 on stream 0 at 15-Jun-2021 03:09:02.028 EDT >> cmd: Begin processing the 57th record. Run 1, Event 140, LumiSection 45877 on stream 1 at 15-Jun-2021 03:09:02.062 EDT >> cmd: Begin processing the 58th record. Run 1, Event 154, LumiSection 45877 on stream 3 at 15-Jun-2021 03:09:03.750 EDT >> cmd: Begin processing the 59th record. Run 1, Event 155, LumiSection 45877 on stream 2 at 15-Jun-2021 03:09:04.708 EDT >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: Begin processing the 60th record. Run 1, Event 164, LumiSection 45877 on stream 0 at 15-Jun-2021 03:09:05.451 EDT >> cmd: Begin processing the 61st record. Run 1, Event 168, LumiSection 45877 on stream 5 at 15-Jun-2021 03:09:08.080 EDT >> cmd: Begin processing the 62nd record. Run 1, Event 166, LumiSection 45877 on stream 1 at 15-Jun-2021 03:09:09.391 EDT >> cmd: Begin processing the 63rd record. Run 1, Event 146, LumiSection 45877 on stream 4 at 15-Jun-2021 03:09:09.980 EDT >> cmd: Begin processing the 64th record. Run 1, Event 174, LumiSection 45877 on stream 2 at 15-Jun-2021 03:09:10.817 EDT >> cmd: Begin processing the 65th record. Run 1, Event 171, LumiSection 45877 on stream 3 at 15-Jun-2021 03:09:10.818 EDT >> cmd: Begin processing the 66th record. Run 1, Event 175, LumiSection 45877 on stream 0 at 15-Jun-2021 03:09:11.989 EDT >> cmd: Begin processing the 67th record. Run 1, Event 177, LumiSection 45877 on stream 5 at 15-Jun-2021 03:09:12.973 EDT >> cmd: Begin processing the 68th record. Run 1, Event 179, LumiSection 45877 on stream 4 at 15-Jun-2021 03:09:15.164 EDT >> cmd: Begin processing the 69th record. Run 1, Event 182, LumiSection 45877 on stream 1 at 15-Jun-2021 03:09:15.232 EDT >> cmd: Begin processing the 70th record. Run 1, Event 176, LumiSection 45877 on stream 3 at 15-Jun-2021 03:09:18.499 EDT >> cmd: Begin processing the 71st record. Run 1, Event 181, LumiSection 45877 on stream 0 at 15-Jun-2021 03:09:19.378 EDT >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: Begin processing the 72nd record. Run 1, Event 189, LumiSection 45877 on stream 4 at 15-Jun-2021 03:09:21.479 EDT >> cmd: Begin processing the 73rd record. Run 1, Event 188, LumiSection 45877 on stream 0 at 15-Jun-2021 03:09:22.963 EDT >> cmd: Begin processing the 74th record. Run 1, Event 200, LumiSection 45877 on stream 3 at 15-Jun-2021 03:09:25.092 EDT >> cmd: Begin processing the 75th record. Run 1, Event 197, LumiSection 45877 on stream 2 at 15-Jun-2021 03:09:25.559 EDT >> cmd: Begin processing the 76th record. Run 1, Event 210, LumiSection 45877 on stream 5 at 15-Jun-2021 03:09:27.094 EDT >> cmd: Begin processing the 77th record. Run 1, Event 196, LumiSection 45877 on stream 1 at 15-Jun-2021 03:09:27.193 EDT >> cmd: Begin processing the 78th record. Run 1, Event 209, LumiSection 45877 on stream 0 at 15-Jun-2021 03:09:29.142 EDT >> cmd: Begin processing the 79th record. Run 1, Event 213, LumiSection 45877 on stream 4 at 15-Jun-2021 03:09:29.546 EDT >> cmd: Begin processing the 80th record. Run 1, Event 219, LumiSection 45877 on stream 3 at 15-Jun-2021 03:09:31.468 EDT >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: Begin processing the 81st record. Run 1, Event 216, LumiSection 45877 on stream 2 at 15-Jun-2021 03:09:33.090 EDT >> cmd: Begin processing the 82nd record. Run 1, Event 211, LumiSection 45877 on stream 5 at 15-Jun-2021 03:09:33.328 EDT >> cmd: Begin processing the 83rd record. Run 1, Event 215, LumiSection 45877 on stream 4 at 15-Jun-2021 03:09:34.944 EDT >> cmd: Begin processing the 84th record. Run 1, Event 223, LumiSection 45877 on stream 1 at 15-Jun-2021 03:09:36.266 EDT >> cmd: Begin processing the 85th record. Run 1, Event 235, LumiSection 45877 on stream 3 at 15-Jun-2021 03:09:37.212 EDT >> cmd: Begin processing the 86th record. Run 1, Event 236, LumiSection 45877 on stream 0 at 15-Jun-2021 03:09:38.717 EDT >> cmd: Begin processing the 87th record. Run 1, Event 228, LumiSection 45877 on stream 2 at 15-Jun-2021 03:09:38.809 EDT >> cmd: Begin processing the 88th record. Run 1, Event 249, LumiSection 45877 on stream 5 at 15-Jun-2021 03:09:40.161 EDT >> cmd: Begin processing the 89th record. Run 1, Event 239, LumiSection 45877 on stream 4 at 15-Jun-2021 03:09:41.589 EDT >> cmd: Begin processing the 90th record. Run 1, Event 243, LumiSection 45877 on stream 0 at 15-Jun-2021 03:09:43.844 EDT >> cmd: Begin processing the 91st record. Run 1, Event 231, LumiSection 45877 on stream 2 at 15-Jun-2021 03:09:44.176 EDT >> cmd: Begin processing the 92nd record. Run 1, Event 255, LumiSection 45877 on stream 1 at 15-Jun-2021 03:09:44.829 EDT >> cmd: Begin processing the 93rd record. Run 1, Event 250, LumiSection 45877 on stream 3 at 15-Jun-2021 03:09:44.964 EDT >> cmd: Begin processing the 94th record. Run 1, Event 258, LumiSection 45877 on stream 4 at 15-Jun-2021 03:09:47.751 EDT >> cmd: Begin processing the 95th record. Run 1, Event 262, LumiSection 45877 on stream 5 at 15-Jun-2021 03:09:47.989 EDT >> cmd: Begin processing the 96th record. Run 1, Event 251, LumiSection 45877 on stream 0 at 15-Jun-2021 03:09:49.192 EDT >> cmd: Begin processing the 97th record. Run 1, Event 261, LumiSection 45877 on stream 1 at 15-Jun-2021 03:09:49.227 EDT >> cmd: Begin processing the 98th record. Run 1, Event 252, LumiSection 45877 on stream 2 at 15-Jun-2021 03:09:49.959 EDT >> cmd: Begin processing the 99th record. Run 1, Event 263, LumiSection 45877 on stream 3 at 15-Jun-2021 03:09:50.370 EDT >> cmd: Begin processing the 100th record. Run 1, Event 279, LumiSection 45877 on stream 1 at 15-Jun-2021 03:09:53.937 EDT >> cmd: Begin processing the 101st record. Run 1, Event 281, LumiSection 45877 on stream 5 at 15-Jun-2021 03:09:55.707 EDT >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: Begin processing the 102nd record. Run 1, Event 282, LumiSection 45877 on stream 0 at 15-Jun-2021 03:09:57.127 EDT >> cmd: Begin processing the 103rd record. Run 1, Event 283, LumiSection 45877 on stream 2 at 15-Jun-2021 03:09:57.690 EDT >> cmd: Begin processing the 104th record. Run 1, Event 285, LumiSection 45877 on stream 3 at 15-Jun-2021 03:09:57.769 EDT >> cmd: Begin processing the 105th record. Run 1, Event 267, LumiSection 45877 on stream 4 at 15-Jun-2021 03:09:59.137 EDT >> cmd: Begin processing the 106th record. Run 1, Event 288, LumiSection 45877 on stream 1 at 15-Jun-2021 03:10:01.070 EDT >> cmd: Begin processing the 107th record. Run 1, Event 289, LumiSection 45877 on stream 5 at 15-Jun-2021 03:10:02.199 EDT >> cmd: Begin processing the 108th record. Run 1, Event 295, LumiSection 45877 on stream 2 at 15-Jun-2021 03:10:03.478 EDT >> cmd: Begin processing the 109th record. Run 1, Event 290, LumiSection 45877 on stream 0 at 15-Jun-2021 03:10:03.623 EDT >> cmd: Begin processing the 110th record. Run 1, Event 302, LumiSection 45877 on stream 3 at 15-Jun-2021 03:10:06.098 EDT >> cmd: Begin processing the 111th record. Run 1, Event 296, LumiSection 45877 on stream 4 at 15-Jun-2021 03:10:07.030 EDT >> cmd: Begin processing the 112th record. Run 1, Event 292, LumiSection 45877 on stream 1 at 15-Jun-2021 03:10:07.945 EDT >> cmd: Begin processing the 113th record. Run 1, Event 303, LumiSection 45877 on stream 2 at 15-Jun-2021 03:10:09.650 EDT >> cmd: Begin processing the 114th record. Run 1, Event 309, LumiSection 45877 on stream 5 at 15-Jun-2021 03:10:10.586 EDT >> cmd: Begin processing the 115th record. Run 1, Event 310, LumiSection 45877 on stream 0 at 15-Jun-2021 03:10:13.038 EDT >> cmd: Begin processing the 116th record. Run 1, Event 318, LumiSection 45877 on stream 1 at 15-Jun-2021 03:10:13.703 EDT >> cmd: Begin processing the 117th record. Run 1, Event 311, LumiSection 45877 on stream 4 at 15-Jun-2021 03:10:13.742 EDT >> cmd: Begin processing the 118th record. Run 1, Event 319, LumiSection 45877 on stream 2 at 15-Jun-2021 03:10:15.478 EDT >> cmd: Begin processing the 119th record. Run 1, Event 324, LumiSection 45877 on stream 5 at 15-Jun-2021 03:10:15.747 EDT >> cmd: Begin processing the 120th record. Run 1, Event 305, LumiSection 45877 on stream 0 at 15-Jun-2021 03:10:19.434 EDT >> cmd: Begin processing the 121st record. Run 1, Event 327, LumiSection 45877 on stream 4 at 15-Jun-2021 03:10:19.659 EDT >> cmd: Begin processing the 122nd record. Run 1, Event 335, LumiSection 45877 on stream 5 at 15-Jun-2021 03:10:20.253 EDT >> cmd: Begin processing the 123rd record. Run 1, Event 340, LumiSection 45877 on stream 1 at 15-Jun-2021 03:10:21.672 EDT >> cmd: Begin processing the 124th record. Run 1, Event 330, LumiSection 45877 on stream 1 at 15-Jun-2021 03:10:24.875 EDT >> cmd: Begin processing the 125th record. Run 1, Event 342, LumiSection 45877 on stream 4 at 15-Jun-2021 03:10:25.549 EDT >> cmd: Begin processing the 126th record. Run 1, Event 345, LumiSection 45877 on stream 0 at 15-Jun-2021 03:10:27.037 EDT >> cmd: Begin processing the 127th record. Run 1, Event 349, LumiSection 45877 on stream 1 at 15-Jun-2021 03:10:33.290 EDT >> cmd: Begin processing the 128th record. Run 1, Event 337, LumiSection 45877 on stream 4 at 15-Jun-2021 03:10:33.291 EDT >> cmd: Begin processing the 129th record. Run 1, Event 365, LumiSection 45877 on stream 4 at 15-Jun-2021 03:10:39.785 EDT >> cmd: Begin processing the 130th record. Run 1, Event 359, LumiSection 45877 on stream 1 at 15-Jun-2021 03:10:41.440 EDT >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: Begin processing the 131st record. Run 1, Event 355, LumiSection 45877 on stream 4 at 15-Jun-2021 03:10:50.316 EDT >> cmd: Begin processing the 132nd record. Run 1, Event 378, LumiSection 45877 on stream 4 at 15-Jun-2021 03:10:56.088 EDT >> cmd: Begin processing the 133rd record. Run 1, Event 370, LumiSection 45877 on stream 4 at 15-Jun-2021 03:11:01.964 EDT >> cmd: [2021-06-15 03:13:17.412267 -0400][Error ][XRootD ] [primeradiant03.crc.nd.edu:1094] Unable to get the response to request kXR_readv (handle: 0x00000000, chunks: 45, total size: 21430921) >> cmd: [2021-06-15 03:13:17.412560 -0400][Error ][File ] [0x5e3e8580@root://ndcms.crc.nd.edu:1094//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/120008/1D7B72A4-2035-D444-8028-6CA0445DF15F.root?tried=primeradiant06.crc.nd.edu] Fatal file state error. Message kXR_readv (handle: 0x00000000, chunks: 45, total size: 21430921) returned with [ERROR] Operation expired >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 15-Jun-2021 03:13:17 EDT pre-events >> cmd: XrdRequestManager::handle(name='root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/120008/1D7B72A4-2035-D444-8028-6CA0445DF15F.root) failure when reading from primeradiant03.crc.nd.edu:1094 (site T3_US_NotreDame); failed with error '[ERROR] Operation expired' (errno=0, code=206). >> cmd: %MSG >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 15-Jun-2021 03:13:17 EDT pre-events >> cmd: Request failure when reading from primeradiant03.crc.nd.edu:1094 (site T3_US_NotreDame) >> cmd: %MSG >> cmd: %MSG-w XrdAdaptor: (NoModuleName) 15-Jun-2021 03:13:17 EDT pre-events >> cmd: Data is now served from instead of previous T3_US_NotreDame >> cmd: %MSG >> cmd: [2021-06-15 03:13:20.412821 -0400][Error ][XRootD ] [primeradiant06.crc.nd.edu:1094] Unable to get the response to request kXR_readv (handle: 0x03000000, chunks: 44, total size: 20953155) >> cmd: [2021-06-15 03:13:20.413087 -0400][Error ][File ] [0x10404b80@root://ndcms.crc.nd.edu:1094//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/270011/D2D46AD5-7BB6-A443-AB11-1ABEF43D03A3.root] Fatal file state error. Message kXR_readv (handle: 0x03000000, chunks: 44, total size: 20953155) returned with [ERROR] Operation expired >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 15-Jun-2021 03:13:20 EDT pre-events >> cmd: XrdRequestManager::handle(name='root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/270011/D2D46AD5-7BB6-A443-AB11-1ABEF43D03A3.root) failure when reading from primeradiant06.crc.nd.edu:1094 (site T3_US_NotreDame); failed with error '[ERROR] Operation expired' (errno=0, code=206). >> cmd: %MSG >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 15-Jun-2021 03:13:20 EDT pre-events >> cmd: Request failure when reading from primeradiant06.crc.nd.edu:1094 (site T3_US_NotreDame) >> cmd: %MSG >> cmd: %MSG-w XrdAdaptor: (NoModuleName) 15-Jun-2021 03:13:20 EDT pre-events >> cmd: Data is now served from instead of previous T3_US_NotreDame >> cmd: %MSG >> cmd: [2021-06-15 03:13:22.413332 -0400][Error ][XRootD ] [primeradiant01.crc.nd.edu:1094] Unable to get the response to request kXR_open (file: /store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/120008/1D7B72A4-2035-D444-8028-6CA0445DF15F.root?tried=primeradiant03.crc.nd.edu,primeradiant06.crc.nd.edu, mode: 0660, flags: kXR_open_read kXR_async kXR_retstat ) >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 15-Jun-2021 03:13:22 EDT pre-events >> cmd: Caught a CMSSW exception when running connection recovery. >> cmd: %MSG >> cmd: ----- Begin Fatal Exception 15-Jun-2021 03:13:22 EDT----------------------- >> cmd: An exception of category 'FileReadError' occurred while >> cmd: [0] Processing Event run: 1 lumi: 45877 event: 319 stream: 2 >> cmd: [1] Running path 'PREMIXRAWoutput_step' >> cmd: [2] Prefetching for module PoolOutputModule/'PREMIXRAWoutput' >> cmd: [3] Prefetching for module CSCDigiProducer/'simMuonCSCDigis' >> cmd: [4] Calling method for module PreMixingModule/'mixData' >> cmd: [5] Reading branch EventAuxiliary >> cmd: [6] Calling XrdFile::readv() >> cmd: [7] XrdAdaptor::ClientRequest::HandleResponse() failure while running connection recovery >> cmd: [8] Handling XrdAdaptor::RequestManager::requestFailure() >> cmd: [9] In XrdAdaptor::RequestManager::OpenHandler::HandleResponseWithHosts() >> cmd: Exception Message: >> cmd: XrdCl::File::Open(name='root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/120008/1D7B72A4-2035-D444-8028-6CA0445DF15F.root', flags=0x10, permissions=0660) => error '[ERROR] Operation expired' (errno=0, code=206) >> cmd: Additional Info: >> cmd: [a] Original error: '[ERROR] Operation expired' (errno=0, code=206, source=primeradiant03.crc.nd.edu:1094 (site T3_US_NotreDame)). >> cmd: [b] Original failed source is primeradiant03.crc.nd.edu:1094 (site T3_US_NotreDame) >> cmd: [c] Disabled source: primeradiant03.crc.nd.edu:1094 >> cmd: ----- End Fatal Exception ------------------------------------------------- >> cmd: [2021-06-15 03:13:28.414423 -0400][Error ][XRootD ] [primeradiant05.crc.nd.edu:1094] Impossible to send message kXR_open (file: /store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/1320000/32DD6B21-79D2-124F-BF27-D2EB0939C19B.root?tried=primeradiant06.crc.nd.edu,primeradiant02.crc.nd.edu, mode: 0660, flags: kXR_open_read kXR_async kXR_retstat ). Trying to recover. >> cmd: [2021-06-15 03:13:28.414566 -0400][Error ][XRootD ] [primeradiant05.crc.nd.edu:1094] Unable to get the response to request kXR_open (file: /store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/1320000/32DD6B21-79D2-124F-BF27-D2EB0939C19B.root?tried=primeradiant06.crc.nd.edu,primeradiant02.crc.nd.edu, mode: 0660, flags: kXR_open_read kXR_async kXR_retstat ) >> cmd: [2021-06-15 03:13:28.414663 -0400][Error ][XRootD ] [primeradiant05.crc.nd.edu:1094] Unable to get the response to request kXR_readv (handle: 0x00000000, chunks: 49, total size: 20138390) >> cmd: [2021-06-15 03:13:28.414853 -0400][Error ][File ] [0x99c7e900@root://ndcms.crc.nd.edu:1094//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/130028/4F66312E-BA5A-D449-A6C9-FDBD1C8C0CB3.root?tried=primeradiant06.crc.nd.edu] Fatal file state error. Message kXR_readv (handle: 0x00000000, chunks: 49, total size: 20138390) returned with [ERROR] Operation expired >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 15-Jun-2021 03:13:28 EDT pre-events >> cmd: XrdRequestManager::handle(name='root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/130028/4F66312E-BA5A-D449-A6C9-FDBD1C8C0CB3.root) failure when reading from primeradiant05.crc.nd.edu:1094 (site T3_US_NotreDame); failed with error '[ERROR] Operation expired' (errno=0, code=206). >> cmd: %MSG >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 15-Jun-2021 03:13:28 EDT pre-events >> cmd: Request failure when reading from primeradiant05.crc.nd.edu:1094 (site T3_US_NotreDame) >> cmd: %MSG >> cmd: %MSG-w XrdAdaptor: (NoModuleName) 15-Jun-2021 03:13:28 EDT pre-events >> cmd: Data is now served from instead of previous T3_US_NotreDame >> cmd: %MSG >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 15-Jun-2021 03:13:28 EDT pre-events >> cmd: Caught a CMSSW exception when running connection recovery. >> cmd: %MSG >> cmd: ----- Begin Fatal Exception 15-Jun-2021 03:13:28 EDT----------------------- >> cmd: An exception of category 'FileReadError' occurred while >> cmd: [0] Processing Event run: 1 lumi: 45877 event: 335 stream: 5 >> cmd: [1] Running path 'PREMIXRAWoutput_step' >> cmd: [2] Prefetching for module PoolOutputModule/'PREMIXRAWoutput' >> cmd: [3] Prefetching for module CSCDigiProducer/'simMuonCSCDigis' >> cmd: [4] Calling method for module PreMixingModule/'mixData' >> cmd: [5] Rethrowing an exception that happened on a different thread. >> cmd: [6] Reading branch PileupSummaryInfos_addPileupInfo__DIGI. >> cmd: [7] Calling XrdFile::readv() >> cmd: [8] XrdAdaptor::ClientRequest::HandleResponse() failure while running connection recovery >> cmd: [9] Handling XrdAdaptor::RequestManager::requestFailure() >> cmd: [10] In XrdAdaptor::RequestManager::OpenHandler::HandleResponseWithHosts() >> cmd: Exception Message: >> cmd: XrdCl::File::Open(name='root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/130028/4F66312E-BA5A-D449-A6C9-FDBD1C8C0CB3.root', flags=0x10, permissions=0660) => error '[ERROR] Server responded with an error: [3011] Too many attempts to stage read access to the file >> cmd: ' (errno=3011, code=400) >> cmd: Additional Info: >> cmd: [a] Original error: '[ERROR] Operation expired' (errno=0, code=206, source=primeradiant05.crc.nd.edu:1094 (site T3_US_NotreDame)). >> cmd: [b] Original failed source is primeradiant05.crc.nd.edu:1094 (site T3_US_NotreDame) >> cmd: [c] Disabled source: primeradiant05.crc.nd.edu:1094 >> cmd: ----- End Fatal Exception ------------------------------------------------- >> cmd: [2021-06-15 03:13:35.415458 -0400][Error ][XRootD ] [primeradiant06.crc.nd.edu:1094] Impossible to send message kXR_readv (handle: 0x04000000, chunks: 43, total size: 20780300). Trying to recover. >> cmd: [2021-06-15 03:13:35.415562 -0400][Error ][XRootD ] [primeradiant06.crc.nd.edu:1094] Unable to get the response to request kXR_readv (handle: 0x04000000, chunks: 43, total size: 20780300) >> cmd: [2021-06-15 03:13:35.415730 -0400][Error ][File ] [0x57d53e00@root://ndcms.crc.nd.edu:1094//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/1320000/32DD6B21-79D2-124F-BF27-D2EB0939C19B.root?tried=primeradiant02.crc.nd.edu] Fatal file state error. Message kXR_readv (handle: 0x04000000, chunks: 43, total size: 20780300) returned with [ERROR] Operation expired >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 15-Jun-2021 03:13:35 EDT pre-events >> cmd: XrdRequestManager::handle(name='root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/1320000/32DD6B21-79D2-124F-BF27-D2EB0939C19B.root) failure when reading from primeradiant06.crc.nd.edu:1094 (site T3_US_NotreDame); failed with error '[ERROR] Operation expired' (errno=0, code=206). >> cmd: %MSG >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 15-Jun-2021 03:13:35 EDT pre-events >> cmd: Request failure when reading from primeradiant06.crc.nd.edu:1094 (site T3_US_NotreDame) >> cmd: %MSG >> cmd: %MSG-w XrdAdaptor: (NoModuleName) 15-Jun-2021 03:13:35 EDT pre-events >> cmd: Data is now served from instead of previous T3_US_NotreDame >> cmd: %MSG >> cmd: [2021-06-15 03:13:42.416631 -0400][Error ][XRootD ] [primeradiant02.crc.nd.edu:1094] Unable to get the response to request kXR_readv (handle: 0x02000000, chunks: 47, total size: 23024878) >> cmd: [2021-06-15 03:13:42.416841 -0400][Error ][File ] [0x49726f00@root://ndcms.crc.nd.edu:1094//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/260010/032CA55D-DA59-0A40-9621-3E672AC8B7CE.root?tried=primeradiant04.crc.nd.edu,primeradiant01.crc.nd.edu] Fatal file state error. Message kXR_readv (handle: 0x02000000, chunks: 47, total size: 23024878) returned with [ERROR] Operation expired >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 15-Jun-2021 03:13:42 EDT pre-events >> cmd: XrdRequestManager::handle(name='root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/260010/032CA55D-DA59-0A40-9621-3E672AC8B7CE.root) failure when reading from primeradiant02.crc.nd.edu:1094 (site T3_US_NotreDame); failed with error '[ERROR] Operation expired' (errno=0, code=206). >> cmd: %MSG >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 15-Jun-2021 03:13:42 EDT pre-events >> cmd: Request failure when reading from primeradiant02.crc.nd.edu:1094 (site T3_US_NotreDame) >> cmd: %MSG >> cmd: %MSG-w XrdAdaptor: (NoModuleName) 15-Jun-2021 03:13:42 EDT pre-events >> cmd: Data is now served from instead of previous T3_US_NotreDame >> cmd: %MSG >> cmd: [2021-06-15 03:14:05.419386 -0400][Error ][XRootD ] [primeradiant06.crc.nd.edu:1094] Impossible to send message kXR_readv (handle: 0x00000000, chunks: 41, total size: 19769007). Trying to recover. >> cmd: [2021-06-15 03:14:05.419529 -0400][Error ][XRootD ] [primeradiant06.crc.nd.edu:1094] Unable to get the response to request kXR_readv (handle: 0x00000000, chunks: 41, total size: 19769007) >> cmd: [2021-06-15 03:14:12.420505 -0400][Error ][XRootD ] [primeradiant02.crc.nd.edu:1094] Impossible to send message kXR_open (file: /store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/120013/D42EB1DD-A80F-4145-8AF2-E8C997A00129.root?tried=primeradiant06.crc.nd.edu,primeradiant04.crc.nd.edu, mode: 0660, flags: kXR_open_read kXR_async kXR_retstat ). Trying to recover. >> cmd: [2021-06-15 03:14:12.420652 -0400][Error ][XRootD ] [primeradiant02.crc.nd.edu:1094] Unable to get the response to request kXR_open (file: /store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/120013/D42EB1DD-A80F-4145-8AF2-E8C997A00129.root?tried=primeradiant06.crc.nd.edu,primeradiant04.crc.nd.edu, mode: 0660, flags: kXR_open_read kXR_async kXR_retstat ) >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 15-Jun-2021 03:16:30 EDT pre-events >> cmd: Caught a CMSSW exception when running connection recovery. >> cmd: %MSG >> cmd: [2021-06-15 03:16:30.417776 -0400][Error ][File ] [0xace68080@root://ndcms.crc.nd.edu:1094//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/120013/D42EB1DD-A80F-4145-8AF2-E8C997A00129.root] Fatal file state error. Message kXR_readv (handle: 0x00000000, chunks: 41, total size: 19769007) returned with [ERROR] Operation expired >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 15-Jun-2021 03:16:30 EDT pre-events >> cmd: Caught a CMSSW exception when running connection recovery. >> cmd: %MSG >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 15-Jun-2021 03:16:30 EDT pre-events >> cmd: XrdRequestManager::handle(name='root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/120013/D42EB1DD-A80F-4145-8AF2-E8C997A00129.root) failure when reading from primeradiant06.crc.nd.edu:1094 (site T3_US_NotreDame); failed with error '[ERROR] Operation expired' (errno=0, code=206). >> cmd: %MSG >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 15-Jun-2021 03:16:30 EDT pre-events >> cmd: Request failure when reading from primeradiant06.crc.nd.edu:1094 (site T3_US_NotreDame) >> cmd: %MSG >> cmd: %MSG-w XrdAdaptor: (NoModuleName) 15-Jun-2021 03:16:30 EDT pre-events >> cmd: Data is now served from instead of previous T3_US_NotreDame >> cmd: %MSG >> cmd: ----- Begin Fatal Exception 15-Jun-2021 03:16:30 EDT----------------------- >> cmd: An exception of category 'FileReadError' occurred while >> cmd: [0] Processing Event run: 1 lumi: 45877 event: 302 stream: 3 >> cmd: [1] Running path 'PREMIXRAWoutput_step' >> cmd: [2] Prefetching for module PoolOutputModule/'PREMIXRAWoutput' >> cmd: [3] Prefetching for module CSCDigiProducer/'simMuonCSCDigis' >> cmd: [4] Calling method for module PreMixingModule/'mixData' >> cmd: [5] Reading branch EventAuxiliary >> cmd: [6] Calling XrdFile::readv() >> cmd: [7] XrdAdaptor::ClientRequest::HandleResponse() failure while running connection recovery >> cmd: [8] In XrdAdaptor::RequestManager::requestFailure() >> cmd: Exception Message: >> cmd: XrdAdaptor::RequestManager::requestFailure Open(name='root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/270011/D2D46AD5-7BB6-A443-AB11-1ABEF43D03A3.root', flags=0x10, permissions=0660, old source=primeradiant06.crc.nd.edu:1094 (site T3_US_NotreDame)) => timeout when waiting for file open >> cmd: Additional Info: >> cmd: [a] Original error: '[ERROR] Operation expired' (errno=0, code=206, source=primeradiant06.crc.nd.edu:1094 (site T3_US_NotreDame)). >> cmd: [b] Disabled source: primeradiant06.crc.nd.edu:1094 >> cmd: ----- End Fatal Exception ------------------------------------------------- >> cmd: ----- Begin Fatal Exception 15-Jun-2021 03:16:30 EDT----------------------- >> cmd: An exception of category 'FileReadError' occurred while >> cmd: [0] Processing Event run: 1 lumi: 45877 event: 359 stream: 1 >> cmd: [1] Running path 'PREMIXRAWoutput_step' >> cmd: [2] Prefetching for module PoolOutputModule/'PREMIXRAWoutput' >> cmd: [3] Prefetching for module CSCDigiProducer/'simMuonCSCDigis' >> cmd: [4] Calling method for module PreMixingModule/'mixData' >> cmd: [5] Reading branch EventAuxiliary >> cmd: [6] Calling XrdFile::readv() >> cmd: [7] XrdAdaptor::ClientRequest::HandleResponse() failure while running connection recovery >> cmd: [8] Handling XrdAdaptor::RequestManager::requestFailure() >> cmd: [9] In XrdAdaptor::RequestManager::OpenHandler::HandleResponseWithHosts() >> cmd: Exception Message: >> cmd: XrdCl::File::Open(name='root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/260010/032CA55D-DA59-0A40-9621-3E672AC8B7CE.root', flags=0x10, permissions=0660) => error '[ERROR] Server responded with an error: [3011] Too many attempts to stage read access to the file >> cmd: ' (errno=3011, code=400) >> cmd: Additional Info: >> cmd: [a] Original error: '[ERROR] Operation expired' (errno=0, code=206, source=primeradiant02.crc.nd.edu:1094 (site T3_US_NotreDame)). >> cmd: [b] Original failed source is primeradiant02.crc.nd.edu:1094 (site T3_US_NotreDame) >> cmd: [c] Disabled source: primeradiant02.crc.nd.edu:1094 >> cmd: ----- End Fatal Exception ------------------------------------------------- >> cmd: [2021-06-15 03:16:33.439056 -0400][Error ][XRootD ] [primeradiant04.crc.nd.edu:1094] Unable to get the response to request kXR_open (file: /store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/270011/D2D46AD5-7BB6-A443-AB11-1ABEF43D03A3.root?tried=primeradiant02.crc.nd.edu,primeradiant06.crc.nd.edu, mode: 0660, flags: kXR_open_read kXR_async kXR_retstat ) >> cmd: [2021-06-15 03:16:43.440607 -0400][Error ][XRootD ] [primeradiant05.crc.nd.edu:1094] Impossible to send message kXR_open (file: /store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/1320000/32DD6B21-79D2-124F-BF27-D2EB0939C19B.root?tried=primeradiant02.crc.nd.edu,primeradiant06.crc.nd.edu, mode: 0660, flags: kXR_open_read kXR_async kXR_retstat ). Trying to recover. >> cmd: [2021-06-15 03:16:43.440812 -0400][Error ][XRootD ] [primeradiant05.crc.nd.edu:1094] Unable to get the response to request kXR_open (file: /store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/1320000/32DD6B21-79D2-124F-BF27-D2EB0939C19B.root?tried=primeradiant02.crc.nd.edu,primeradiant06.crc.nd.edu, mode: 0660, flags: kXR_open_read kXR_async kXR_retstat ) >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 15-Jun-2021 03:16:43 EDT pre-events >> cmd: Caught a CMSSW exception when running connection recovery. >> cmd: %MSG >> cmd: ----- Begin Fatal Exception 15-Jun-2021 03:16:43 EDT----------------------- >> cmd: An exception of category 'FileReadError' occurred while >> cmd: [0] Processing Event run: 1 lumi: 45877 event: 345 stream: 0 >> cmd: [1] Running path 'PREMIXRAWoutput_step' >> cmd: [2] Prefetching for module PoolOutputModule/'PREMIXRAWoutput' >> cmd: [3] Prefetching for module CSCDigiProducer/'simMuonCSCDigis' >> cmd: [4] Calling method for module PreMixingModule/'mixData' >> cmd: [5] Reading branch EventAuxiliary >> cmd: [6] Calling XrdFile::readv() >> cmd: [7] XrdAdaptor::ClientRequest::HandleResponse() failure while running connection recovery >> cmd: [8] Handling XrdAdaptor::RequestManager::requestFailure() >> cmd: [9] In XrdAdaptor::RequestManager::OpenHandler::HandleResponseWithHosts() >> cmd: Exception Message: >> cmd: XrdCl::File::Open(name='root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/1320000/32DD6B21-79D2-124F-BF27-D2EB0939C19B.root', flags=0x10, permissions=0660) => error '[ERROR] Operation expired' (errno=0, code=206) >> cmd: Additional Info: >> cmd: [a] Original error: '[ERROR] Operation expired' (errno=0, code=206, source=primeradiant06.crc.nd.edu:1094 (site T3_US_NotreDame)). >> cmd: [b] Original failed source is primeradiant06.crc.nd.edu:1094 (site T3_US_NotreDame) >> cmd: [c] Disabled source: primeradiant06.crc.nd.edu:1094 >> cmd: ----- End Fatal Exception ------------------------------------------------- >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 15-Jun-2021 03:19:40 EDT pre-events >> cmd: Caught a CMSSW exception when running connection recovery. >> cmd: %MSG >> cmd: ----- Begin Fatal Exception 15-Jun-2021 03:19:40 EDT----------------------- >> cmd: An exception of category 'FileReadError' occurred while >> cmd: [0] Processing Event run: 1 lumi: 45877 event: 370 stream: 4 >> cmd: [1] Running path 'PREMIXRAWoutput_step' >> cmd: [2] Prefetching for module PoolOutputModule/'PREMIXRAWoutput' >> cmd: [3] Prefetching for module CSCDigiProducer/'simMuonCSCDigis' >> cmd: [4] Calling method for module PreMixingModule/'mixData' >> cmd: [5] Reading branch EventAuxiliary >> cmd: [6] Calling XrdFile::readv() >> cmd: [7] XrdAdaptor::ClientRequest::HandleResponse() failure while running connection recovery >> cmd: [8] In XrdAdaptor::RequestManager::requestFailure() >> cmd: Exception Message: >> cmd: XrdAdaptor::RequestManager::requestFailure Open(name='root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/120013/D42EB1DD-A80F-4145-8AF2-E8C997A00129.root', flags=0x10, permissions=0660, old source=primeradiant06.crc.nd.edu:1094 (site T3_US_NotreDame)) => timeout when waiting for file open >> cmd: Additional Info: >> cmd: [a] Original error: '[ERROR] Operation expired' (errno=0, code=206, source=primeradiant06.crc.nd.edu:1094 (site T3_US_NotreDame)). >> cmd: [b] Disabled source: primeradiant06.crc.nd.edu:1094 >> cmd: ----- End Fatal Exception ------------------------------------------------- >> cmd: 15-Jun-2021 03:19:40 EDT Closed file root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL16APV/Round1/Batch1/postLHE_step/v1/sim_step_ttllNuNuJetNoHiggs_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_479727.root >> cmd: 15-Jun-2021 03:19:40 EDT Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/1320000/32DD6B21-79D2-124F-BF27-D2EB0939C19B.root >> cmd: 15-Jun-2021 03:19:40 EDT Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/260010/032CA55D-DA59-0A40-9621-3E672AC8B7CE.root >> cmd: 15-Jun-2021 03:19:40 EDT Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/120008/1D7B72A4-2035-D444-8028-6CA0445DF15F.root >> cmd: 15-Jun-2021 03:19:40 EDT Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/270011/D2D46AD5-7BB6-A443-AB11-1ABEF43D03A3.root >> cmd: 15-Jun-2021 03:19:41 EDT Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/120013/D42EB1DD-A80F-4145-8AF2-E8C997A00129.root >> cmd: 15-Jun-2021 03:19:41 EDT Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL16_106X_mcRun2_asymptotic_v13-v1/130028/4F66312E-BA5A-D449-A6C9-FDBD1C8C0CB3.root >> cmd: >> cmd: TrigReport ---------- Event Summary ------------ >> cmd: TrigReport Events total = 133 passed = 133 failed = 0 >> cmd: >> cmd: TrigReport ---------- Path Summary ------------ >> cmd: TrigReport Trig Bit# Executed Passed Failed Error Name >> cmd: >> cmd: TrigReport -------End-Path Summary ------------ >> cmd: TrigReport Trig Bit# Executed Passed Failed Error Name >> cmd: TrigReport 0 1 133 127 0 6 PREMIXRAWoutput_step >> cmd: >> cmd: TrigReport ------ Modules in End-Path: PREMIXRAWoutput_step ------------ >> cmd: TrigReport Trig Bit# Visited Passed Failed Error Name >> cmd: TrigReport 0 0 133 127 0 6 PREMIXRAWoutput >> cmd: >> cmd: TrigReport ---------- Module Summary ------------ >> cmd: TrigReport Visited Executed Passed Failed Error Name >> cmd: TrigReport 532 127 127 0 6 DMEcalDigis >> cmd: TrigReport 133 127 127 0 6 DMEcalPreshowerDigis >> cmd: TrigReport 133 127 127 0 6 DMEcalTriggerPrimitiveDigis >> cmd: TrigReport 399 127 127 0 6 DMHcalDigis >> cmd: TrigReport 0 0 0 0 0 DMHcalTTPDigis >> cmd: TrigReport 133 127 127 0 6 DMHcalTriggerPrimitiveDigis >> cmd: TrigReport 133 133 133 0 0 L1simulation_step >> cmd: TrigReport 0 0 0 0 0 MEtoEDMConverter >> cmd: TrigReport 133 127 127 0 6 PREMIXRAWoutput >> cmd: TrigReport 133 133 133 0 0 PREMIXRAWoutput_step >> cmd: TrigReport 133 127 127 0 6 SiStripDigiToRaw >> cmd: TrigReport 133 133 133 0 0 TriggerResults >> cmd: TrigReport 266 127 127 0 6 addPileupInfo >> cmd: TrigReport 133 133 133 0 0 ak4GenJets >> cmd: TrigReport 133 133 133 0 0 ak4GenJetsNoNu >> cmd: TrigReport 133 133 133 0 0 ak8GenJets >> cmd: TrigReport 133 133 133 0 0 ak8GenJetsNoNu >> cmd: TrigReport 133 127 127 0 6 bmtfStage2Raw >> cmd: TrigReport 133 127 127 0 6 caloLayer1RawFed1354 >> cmd: TrigReport 133 127 127 0 6 caloLayer1RawFed1356 >> cmd: TrigReport 133 127 127 0 6 caloLayer1RawFed1358 >> cmd: TrigReport 133 127 127 0 6 caloStage2Raw >> cmd: TrigReport 133 127 127 0 6 cscpacker >> cmd: TrigReport 133 133 133 0 0 datamixing_step >> cmd: TrigReport 133 133 133 0 0 digi2raw_step >> cmd: TrigReport 133 133 133 0 0 digitisation_step >> cmd: TrigReport 133 127 127 0 6 dtpacker >> cmd: TrigReport 133 127 127 0 6 ecalPacker >> cmd: TrigReport 133 133 133 0 0 endjob_step >> cmd: TrigReport 133 127 127 0 6 esDigiToRaw >> cmd: TrigReport 133 133 133 0 0 genCandidatesForMET >> cmd: TrigReport 133 133 133 0 0 genMetCalo >> cmd: TrigReport 133 133 133 0 0 genMetTrue >> cmd: TrigReport 532 133 133 0 0 genParticles >> cmd: TrigReport 133 133 133 0 0 genParticlesForJets >> cmd: TrigReport 133 133 133 0 0 genParticlesForJetsNoNu >> cmd: TrigReport 133 133 133 0 0 genParticlesForMETAllVisible >> cmd: TrigReport 133 133 133 0 0 generatorSmeared >> cmd: TrigReport 133 127 127 0 6 gmtStage2Raw >> cmd: TrigReport 133 127 127 0 6 gtStage2Raw >> cmd: TrigReport 133 127 127 0 6 hcalRawDataVME >> cmd: TrigReport 1330 133 133 0 0 mix >> cmd: TrigReport 3192 133 127 0 6 mixData >> cmd: TrigReport 0 0 0 0 0 omtfStage2Raw >> cmd: TrigReport 133 133 133 0 0 randomEngineStateProducer >> cmd: TrigReport 133 127 127 0 6 rawDataCollector >> cmd: TrigReport 133 127 127 0 6 rpcpacker >> cmd: TrigReport 133 127 127 0 6 siPixelRawData >> cmd: TrigReport 133 127 127 0 6 simBmtfDigis >> cmd: TrigReport 532 127 127 0 6 simCaloStage2Digis >> cmd: TrigReport 266 127 127 0 6 simCaloStage2Layer1Digis >> cmd: TrigReport 399 127 127 0 6 simCscTriggerPrimitiveDigis >> cmd: TrigReport 266 127 127 0 6 simDtTriggerPrimitiveDigis >> cmd: TrigReport 133 127 127 0 6 simEmtfDigis >> cmd: TrigReport 133 127 127 0 6 simGmtCaloSumDigis >> cmd: TrigReport 798 127 127 0 6 simGmtStage2Digis >> cmd: TrigReport 133 133 133 0 0 simGtExtFakeStage2Digis >> cmd: TrigReport 133 127 127 0 6 simGtStage2Digis >> cmd: TrigReport 0 0 0 0 0 simHcalTriggerPrimitiveDigis >> cmd: TrigReport 665 127 127 0 6 simMuonCSCDigis >> cmd: TrigReport 266 127 127 0 6 simMuonDTDigis >> cmd: TrigReport 266 127 127 0 6 simMuonRPCDigis >> cmd: TrigReport 133 127 127 0 6 simOmtfDigis >> cmd: TrigReport 266 127 127 0 6 simTwinMuxDigis >> cmd: >> cmd: TimeReport ---------- Event Summary ---[sec]---- >> cmd: TimeReport event loop CPU/event = 3.365320 >> cmd: TimeReport event loop Real/event = 5.878909 >> cmd: TimeReport sum Streams Real/event = 25.147406 >> cmd: TimeReport efficiency CPU/Real/thread = 0.095407 >> cmd: >> cmd: TimeReport ---------- Path Summary ---[Real sec]---- >> cmd: TimeReport per event per exec Name >> cmd: TimeReport 0.000000 0.000000 digitisation_step >> cmd: TimeReport 0.000000 0.000000 datamixing_step >> cmd: TimeReport 0.000000 0.000000 L1simulation_step >> cmd: TimeReport 0.000000 0.000000 digi2raw_step >> cmd: TimeReport per event per exec Name >> cmd: >> cmd: TimeReport -------End-Path Summary ---[Real sec]---- >> cmd: TimeReport per event per exec Name >> cmd: TimeReport 0.000000 0.000000 endjob_step >> cmd: TimeReport 25.140265 25.140265 PREMIXRAWoutput_step >> cmd: TimeReport per event per exec Name >> cmd: >> cmd: TimeReport ---------- Modules in Path: digitisation_step ---[Real sec]---- >> cmd: TimeReport per event per visit Name >> cmd: >> cmd: TimeReport ---------- Modules in Path: datamixing_step ---[Real sec]---- >> cmd: TimeReport per event per visit Name >> cmd: >> cmd: TimeReport ---------- Modules in Path: L1simulation_step ---[Real sec]---- >> cmd: TimeReport per event per visit Name >> cmd: >> cmd: TimeReport ---------- Modules in Path: digi2raw_step ---[Real sec]---- >> cmd: TimeReport per event per visit Name >> cmd: TimeReport per event per visit Name >> cmd: >> cmd: TimeReport ------ Modules in End-Path: endjob_step ---[Real sec]---- >> cmd: TimeReport per event per visit Name >> cmd: >> cmd: TimeReport ------ Modules in End-Path: PREMIXRAWoutput_step ---[Real sec]---- >> cmd: TimeReport per event per visit Name >> cmd: TimeReport 0.496213 0.496213 PREMIXRAWoutput >> cmd: TimeReport per event per visit Name >> cmd: >> cmd: TimeReport ---------- Module Summary ---[Real sec]---- >> cmd: TimeReport per event per exec per visit Name >> cmd: TimeReport 0.012378 0.012962 0.012962 DMEcalDigis >> cmd: TimeReport 0.002537 0.002656 0.002656 DMEcalPreshowerDigis >> cmd: TimeReport 0.043555 0.045613 0.045613 DMEcalTriggerPrimitiveDigis >> cmd: TimeReport 0.000697 0.000730 0.000730 DMHcalDigis >> cmd: TimeReport 0.000000 0.000000 0.000000 DMHcalTTPDigis >> cmd: TimeReport 0.010294 0.010780 0.010780 DMHcalTriggerPrimitiveDigis >> cmd: TimeReport 0.000001 0.000001 0.000001 L1simulation_step >> cmd: TimeReport 0.000000 0.000000 0.000000 MEtoEDMConverter >> cmd: TimeReport 0.496213 0.519656 0.496213 PREMIXRAWoutput >> cmd: TimeReport 0.000017 0.000017 0.000017 PREMIXRAWoutput_step >> cmd: TimeReport 0.032287 0.033813 0.033813 SiStripDigiToRaw >> cmd: TimeReport 0.000004 0.000004 0.000004 TriggerResults >> cmd: TimeReport 0.000054 0.000056 0.000056 addPileupInfo >> cmd: TimeReport 0.000845 0.000845 0.000845 ak4GenJets >> cmd: TimeReport 0.000717 0.000717 0.000717 ak4GenJetsNoNu >> cmd: TimeReport 0.000886 0.000886 0.000886 ak8GenJets >> cmd: TimeReport 0.000853 0.000853 0.000853 ak8GenJetsNoNu >> cmd: TimeReport 0.001647 0.001724 0.001724 bmtfStage2Raw >> cmd: TimeReport 0.000743 0.000778 0.000778 caloLayer1RawFed1354 >> cmd: TimeReport 0.000626 0.000656 0.000656 caloLayer1RawFed1356 >> cmd: TimeReport 0.000638 0.000668 0.000668 caloLayer1RawFed1358 >> cmd: TimeReport 0.000181 0.000190 0.000190 caloStage2Raw >> cmd: TimeReport 0.030134 0.031558 0.031558 cscpacker >> cmd: TimeReport 0.000002 0.000002 0.000002 datamixing_step >> cmd: TimeReport 0.000001 0.000001 0.000001 digi2raw_step >> cmd: TimeReport 0.000008 0.000008 0.000008 digitisation_step >> cmd: TimeReport 0.000438 0.000459 0.000459 dtpacker >> cmd: TimeReport 0.015558 0.016294 0.016294 ecalPacker >> cmd: TimeReport 0.000002 0.000002 0.000002 endjob_step >> cmd: TimeReport 0.002184 0.002287 0.002287 esDigiToRaw >> cmd: TimeReport 0.000320 0.000320 0.000320 genCandidatesForMET >> cmd: TimeReport 0.000117 0.000117 0.000117 genMetCalo >> cmd: TimeReport 0.000104 0.000104 0.000104 genMetTrue >> cmd: TimeReport 0.024127 0.024127 0.024127 genParticles >> cmd: TimeReport 0.000429 0.000429 0.000429 genParticlesForJets >> cmd: TimeReport 0.000367 0.000367 0.000367 genParticlesForJetsNoNu >> cmd: TimeReport 0.000339 0.000339 0.000339 genParticlesForMETAllVisible >> cmd: TimeReport 0.000005 0.000005 0.000005 generatorSmeared >> cmd: TimeReport 0.000163 0.000171 0.000171 gmtStage2Raw >> cmd: TimeReport 0.000265 0.000277 0.000277 gtStage2Raw >> cmd: TimeReport 0.001828 0.001915 0.001915 hcalRawDataVME >> cmd: TimeReport 1.676695 1.676695 1.676695 mix >> cmd: TimeReport 22.204099 22.204099 22.204099 mixData >> cmd: TimeReport 0.000000 0.000000 0.000000 omtfStage2Raw >> cmd: TimeReport 0.000018 0.000018 0.000018 randomEngineStateProducer >> cmd: TimeReport 0.001754 0.001837 0.001837 rawDataCollector >> cmd: TimeReport 0.005465 0.005723 0.005723 rpcpacker >> cmd: TimeReport 0.010592 0.011092 0.011092 siPixelRawData >> cmd: TimeReport 0.067265 0.070443 0.070443 simBmtfDigis >> cmd: TimeReport 0.006050 0.006335 0.006335 simCaloStage2Digis >> cmd: TimeReport 0.002321 0.002431 0.002431 simCaloStage2Layer1Digis >> cmd: TimeReport 0.012541 0.013133 0.013133 simCscTriggerPrimitiveDigis >> cmd: TimeReport 0.006590 0.006902 0.006902 simDtTriggerPrimitiveDigis >> cmd: TimeReport 0.007117 0.007453 0.007453 simEmtfDigis >> cmd: TimeReport 0.002026 0.002121 0.002121 simGmtCaloSumDigis >> cmd: TimeReport 0.000086 0.000090 0.000090 simGmtStage2Digis >> cmd: TimeReport 0.000520 0.000520 0.000520 simGtExtFakeStage2Digis >> cmd: TimeReport 0.002184 0.002288 0.002288 simGtStage2Digis >> cmd: TimeReport 0.000000 0.000000 0.000000 simHcalTriggerPrimitiveDigis >> cmd: TimeReport 0.107747 0.112838 0.112838 simMuonCSCDigis >> cmd: TimeReport 0.000428 0.000448 0.000448 simMuonDTDigis >> cmd: TimeReport 0.093583 0.098004 0.098004 simMuonRPCDigis >> cmd: TimeReport 0.005145 0.005388 0.005388 simOmtfDigis >> cmd: TimeReport 0.000868 0.000909 0.000909 simTwinMuxDigis >> cmd: TimeReport per event per exec per visit Name >> cmd: >> cmd: T---Report end! >> cmd: >> cmd: TimeReport> Time report complete in 907.116 seconds >> cmd: Time Summary: >> cmd: - Min event: 3.19942 >> cmd: - Max event: 518.458 >> cmd: - Avg event: 25.1404 >> cmd: - Total loop: 781.417 >> cmd: - Total init: 125.151 >> cmd: - Total job: 907.116 >> cmd: - EventSetup Lock: 120.87 >> cmd: - EventSetup Get: 29.0569 >> cmd: Event Throughput: 0.170204 ev/s >> cmd: CPU Summary: >> cmd: - Total loop: 1199.36 >> cmd: - Total init: 36.3672 >> cmd: - Total extra: 0 >> cmd: - Total job: 1236.64 >> cmd: Processing Summary: >> cmd: - Number of Events: 133 >> cmd: - Number of Global Begin Lumi Calls: 1 >> cmd: - Number of Global Begin Run Calls: 1 >> cmd: >> cmd: >> cmd: ============================================= >> cmd: >> cmd: MessageLogger Summary >> cmd: >> cmd: type category sev module subroutine count total >> cmd: ---- -------------------- -- ---------------- ---------------- ----- ----- >> cmd: 1 XrdAdaptor -w (NoModuleName) 6 6 >> cmd: 2 XrdAdaptorInternal -w (NoModuleName) 18 18 >> cmd: 3 TimeReport -e AfterModEndJob 1 1 >> cmd: 4 Fatal Exception -s PostProcessPath 6 6 >> cmd: 5 fileAction -s PreMixingModule: 18 18 >> cmd: 6 fileAction -s PreMixingModule: 12 12 >> cmd: 7 fileAction -s PreMixingModule: 6 6 >> cmd: 8 fileAction -s file_close 1 1 >> cmd: 9 fileAction -s file_open 2 2 >> cmd: >> cmd: type category Examples: run/evt run/evt run/evt >> cmd: ---- -------------------- ---------------- ---------------- ---------------- >> cmd: 1 XrdAdaptor pre-events pre-events pre-events >> cmd: 2 XrdAdaptorInternal pre-events pre-events pre-events >> cmd: 3 TimeReport PostGlobalEndRun >> cmd: 4 Fatal Exception 1/319 1/335 1/370 >> cmd: 5 fileAction 1/10 1/10 1/2 >> cmd: 6 fileAction pre-events pre-events pre-events >> cmd: 7 fileAction PostGlobalEndRun PostGlobalEndRun PostGlobalEndRun >> cmd: 8 fileAction PostGlobalEndRun >> cmd: 9 fileAction pre-events pre-events >> cmd: >> cmd: Severity # Occurrences Total Occurrences >> cmd: -------- ------------- ----------------- >> cmd: Warning 24 24 >> cmd: Error 1 1 >> cmd: System 45 45 >> cmd: >> cmd: dropped waiting message count 0 >>> executable returned with exit code 85. @ Tue Jun 15 03:19:43 2021 >> trace: Traceback (most recent call last): >> trace: File "task.py", line 268, in wrapper >> trace: result = fct(data, *args, **kwargs) >> trace: File "task.py", line 1052, in run_command >> trace: raise subprocess.CalledProcessError(p.returncode, cmd) >> trace: CalledProcessError: Command '[u'cmsRun', '-j', 'report.xml', u'UL16APV_DIGI_cfg_mod.py']' returned non-zero exit status 85 >>>>> call to 'run_command' failed, exiting with exit code 185 @ Tue Jun 15 03:19:43 2021 Tue Jun 15 03:04:31 2021: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Tue Jun 15 03:04:32 2021: ApMon[WARNING]: Not sending parameters since no destination is defined. Tue Jun 15 03:04:32 2021: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. Tue Jun 15 03:19:43 2021: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Tue Jun 15 03:19:43 2021: ApMon[WARNING]: Not sending parameters since no destination is defined. Tue Jun 15 03:19:43 2021: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. >> Execution time -1623740650 >> Exiting with code 185 >> Reporting ExeExitCode 8021 >> Reporting StageOutSE >> Reporting StageOutExitCode 0 Tue Jun 15 03:19:43 2021: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Tue Jun 15 03:19:44 2021: ApMon[WARNING]: Not sending parameters since no destination is defined. Tue Jun 15 03:19:44 2021: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. ==== working directory after execution @ Tue Jun 15 03:19:44 EDT 2021 ==== == dir: total 299740 == dir: drwxr-xr-x 18 kmohrman campus 215 Jun 15 03:04 CMSSW_10_6_17_patch1 == dir: -rw-r--r-- 1 kmohrman campus 260148068 Jun 15 03:19 DIGI-00000.root == dir: -rw-r--r-- 2 kmohrman campus 22907139 Jun 14 18:46 UL16APV_DIGI_cfg.py == dir: -rw-r--r-- 1 kmohrman campus 22908643 Jun 15 03:04 UL16APV_DIGI_cfg_mod.py == dir: drwxr-xr-x 2 kmohrman campus 71 Jun 15 03:03 bin == dir: -rwxr-xr-x 3 kmohrman campus 627272 Jun 14 17:36 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 Jun 15 03:03 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 Jun 15 03:19 cctools-temp-t.894850.mNp8yU == dir: -rw------- 1 kmohrman campus 51 Jun 15 03:04 cvmfschecksum.cms-ib.cern.ch == dir: -rw------- 1 kmohrman campus 51 Jun 15 03:04 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 Jun 15 03:04 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 Jun 15 03:03 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 Jun 15 03:03 librmonitor_helper.so.dpNbUr == dir: -rw-r--r-- 2 kmohrman campus 2132 Jun 15 03:03 parameters.json == dir: -rw------- 2 kmohrman campus 9949 Jun 15 03:03 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 Jun 15 03:03 python == dir: -rw-r--r-- 1 kmohrman campus 3367 Jun 15 03:19 report.json == dir: -rw-r--r-- 3 kmohrman campus 570 Jun 14 17:36 report.json.in == dir: -rw-r--r-- 1 kmohrman campus 72065 Jun 15 03:19 report.xml == dir: -rw-r--r-- 1 kmohrman campus 5911 Jun 15 03:19 report.xml.gz == dir: -rw-r--r-- 2 kmohrman campus 593 Jun 14 17:36 sandbox-CMSSW_10_6_17_patch1-slc7_amd64_gcc700.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 37 Jun 15 03:03 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 Jun 15 03:04 t_wrapper_ready == dir: -rw-r--r-- 1 kmohrman campus 11 Jun 15 03:04 t_wrapper_start == dir: -rwxr-xr-x 3 kmohrman campus 47217 Jun 14 17:36 task.py == dir: -rwxr-xr-x 3 kmohrman campus 5986 Jun 14 17:36 wrapper.sh === wrapper done @ Tue Jun 15 03:19:44 EDT 2021 === final return status = 185 @ Tue Jun 15 03:19:45 EDT 2021