==== wrapper started @ Thu Mar 4 21:22:30 EST 2021 ==== == startup: hostname: d6cneh007.crc.nd.edu == startup: kernel: Linux d6cneh007.crc.nd.edu 3.10.0-1160.el7.x86_64 #1 SMP Tue Aug 18 14:50:17 EDT 2020 x86_64 x86_64 x86_64 GNU/Linux ==== tracing google @ Thu Mar 4 21:22:35 EST 2021 ==== wrapper.sh: line 20: traceroute: command not found ==== environment at startup @ Thu Mar 4 21:22:41 EST 2021 ==== == env: VC3_VERSION_SED=4.2 == env: CCTOOLS_RESOURCE_PROCESS_START=1614910961018131 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: VC3_ROOT_GZIP=/usr/ == env: SHELL=/bin/sh == env: TERM=xterm-256color == env: MAKEFLAGS=-j4 == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-13670/t.13553/cctools-temp-t.13553.79WTvE == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-13670/t.13553/librmonitor_helper.so.lpBOl8 == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_20 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: USER=kmohrman == env: TEMP=/disk/vc3-root/tmp/worker-230547-13670/t.13553/cctools-temp-t.13553.79WTvE == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: LD_LIBRARY_PATH=/.singularity.d/libs == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_ROOT_MAKE=/usr/ == env: VC3_DISTFILES=/disk/vc3-distfiles == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-13670/cache/tmp == env: VC3_VERSION_TAR=1.26 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-AWW3Po == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: VC3_VERSION_GZIP=1.5 == env: VC3_ENV_TAG_GLOBAL=13419 == env: PATH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-AWW3Po == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PWD=/disk/vc3-root/tmp/worker-230547-13670/t.13553 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_FULL_SED=4.2.2 == env: VC3_VERSION_WHICH=2.20 == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-13670 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_ROOT_SED=/usr/ == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: CXX=g++ == env: SHLVL=3 == env: HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_MAKE=3.82 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: DISK=255 == env: MEMORY=964 == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: TMP=/disk/vc3-root/tmp/worker-230547-13670/t.13553/cctools-temp-t.13553.79WTvE == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_VERSION_PKG_CONFIG=0.27 == env: VC3_ROOT_TAR=/usr/ == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-AWW3Po.wrapper == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: CC=gcc == env: CORES=1 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CCTOOLS_RESOURCE_MONITOR_INFO=1024 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_ALL_postLHE_crc.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=15738 == env: _=/usr/bin/env ==== cpu info @ Thu Mar 4 21:22:46 EST 2021 ==== == cpu: processor : 0 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2667.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 0 == cpu: cpu cores : 6 == cpu: apicid : 0 == cpu: initial apicid : 0 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.59 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 1 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1600.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 1 == cpu: cpu cores : 6 == cpu: apicid : 2 == cpu: initial apicid : 2 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.59 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 2 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2667.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 2 == cpu: cpu cores : 6 == cpu: apicid : 4 == cpu: initial apicid : 4 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.59 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 3 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1867.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 8 == cpu: cpu cores : 6 == cpu: apicid : 16 == cpu: initial apicid : 16 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.59 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 4 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2667.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 9 == cpu: cpu cores : 6 == cpu: apicid : 18 == cpu: initial apicid : 18 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.59 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 5 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1600.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 10 == cpu: cpu cores : 6 == cpu: apicid : 20 == cpu: initial apicid : 20 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.59 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 6 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2267.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 0 == cpu: cpu cores : 6 == cpu: apicid : 32 == cpu: initial apicid : 32 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.23 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 7 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1600.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 1 == cpu: cpu cores : 6 == cpu: apicid : 34 == cpu: initial apicid : 34 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.23 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 8 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2667.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 2 == cpu: cpu cores : 6 == cpu: apicid : 36 == cpu: initial apicid : 36 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.23 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 9 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2667.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 8 == cpu: cpu cores : 6 == cpu: apicid : 48 == cpu: initial apicid : 48 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.23 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 10 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1600.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 9 == cpu: cpu cores : 6 == cpu: apicid : 50 == cpu: initial apicid : 50 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.23 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 11 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2667.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 10 == cpu: cpu cores : 6 == cpu: apicid : 52 == cpu: initial apicid : 52 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.23 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: === using CVMFS proxy: http://eddie.crc.nd.edu:3128 @ Thu Mar 4 21:23:11 EST 2021 === using Frontier proxy: http://eddie.crc.nd.edu:3128 @ Thu Mar 4 21:23:11 EST 2021 === parrot helper: /disk/vc3-root/tmp/worker-230547-13670/t.13553/lib/libparrot_helper.so @ Thu Mar 4 21:23:16 EST 2021 ==== content of /disk/vc3-root/tmp/worker-230547-13670/cache/tmp @ Thu Mar 4 21:23:16 EST 2021 ==== == cache: total 28 == cache: drwx------ 261 kmohrman campus 8192 Mar 4 21:19 ex_parrot_kmohrman == cache: -rw-r--r-- 1 kmohrman campus 10 Mar 4 20:27 hot_cache == cache: drwxr-x--- 260 kmohrman campus 8192 Mar 4 20:16 cvmfs === OSG certificate location: /cvmfs/oasis.opensciencegrid.org/mis/certificates @ Thu Mar 4 21:23:21 EST 2021 === testing parrot usage @ Thu Mar 4 21:23:21 EST 2021 === parrot OK @ Thu Mar 4 21:23:26 EST 2021 === starting parrot to access CMSSW... @ Thu Mar 4 21:23:26 EST 2021 ==== wrapper started @ Thu Mar 4 21:23:26 EST 2021 ==== == startup: hostname: d6cneh007.crc.nd.edu == startup: kernel: Linux d6cneh007.crc.nd.edu 3.10.0-1160.el7.x86_64 #1 SMP Tue Aug 18 14:50:17 EDT 2020 x86_64 x86_64 x86_64 GNU/Linux ==== tracing google @ Thu Mar 4 21:23:26 EST 2021 ==== wrapper.sh: line 20: traceroute: command not found ==== environment at startup @ Thu Mar 4 21:23:26 EST 2021 ==== == env: VC3_VERSION_SED=4.2 == env: CCTOOLS_RESOURCE_PROCESS_START=1614911006503579 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/usr/ == env: LOBSTER_GFAL_COPY= == env: MAKEFLAGS=-j4 == env: PARROT_HELPER=/disk/vc3-root/tmp/worker-230547-13670/t.13553/lib/libparrot_helper.so == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-13670/t.13553/cctools-temp-t.13553.79WTvE == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-13670/t.13553/librmonitor_helper.so.lpBOl8 == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_20 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: LD_LIBRARY_PATH=/.singularity.d/libs:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-13670/t.13553/cctools-temp-t.13553.79WTvE == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/usr/ == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-AWW3Po == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-13670/cache/tmp == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: PARROT_CVMFS_REPO= == env: VC3_VERSION_GZIP=1.5 == env: PATH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ENV_TAG_GLOBAL=13419 == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-AWW3Po == env: PWD=/disk/vc3-root/tmp/worker-230547-13670/t.13553 == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_WHICH=2.20 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: LOBSTER_LCG_CP= == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-13670 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/usr/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: CXX=g++ == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: DISK=255 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-13670/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-13670/cache/tmp/cvmfs == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=964 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TMP=/disk/vc3-root/tmp/worker-230547-13670/t.13553/cctools-temp-t.13553.79WTvE == env: PYTHONPATH=python: == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_ROOT_TAR=/usr/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-AWW3Po.wrapper == env: CC=gcc == env: CCTOOLS_RESOURCE_MONITOR_INFO=1024 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=1 == env: PARROT_DEBUG_FLAGS= == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_ALL_postLHE_crc.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=15738 == env: _=/usr/bin/env ==== cpu info @ Thu Mar 4 21:23:26 EST 2021 ==== == cpu: processor : 0 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1733.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 0 == cpu: cpu cores : 6 == cpu: apicid : 0 == cpu: initial apicid : 0 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.59 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 1 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2667.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 1 == cpu: cpu cores : 6 == cpu: apicid : 2 == cpu: initial apicid : 2 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.59 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 2 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1867.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 2 == cpu: cpu cores : 6 == cpu: apicid : 4 == cpu: initial apicid : 4 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.59 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 3 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2667.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 8 == cpu: cpu cores : 6 == cpu: apicid : 16 == cpu: initial apicid : 16 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.59 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 4 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1733.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 9 == cpu: cpu cores : 6 == cpu: apicid : 18 == cpu: initial apicid : 18 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.59 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 5 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2667.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 10 == cpu: cpu cores : 6 == cpu: apicid : 20 == cpu: initial apicid : 20 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.59 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 6 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2667.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 0 == cpu: cpu cores : 6 == cpu: apicid : 32 == cpu: initial apicid : 32 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.23 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 7 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2400.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 1 == cpu: cpu cores : 6 == cpu: apicid : 34 == cpu: initial apicid : 34 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.23 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 8 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2667.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 2 == cpu: cpu cores : 6 == cpu: apicid : 36 == cpu: initial apicid : 36 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.23 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 9 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2667.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 8 == cpu: cpu cores : 6 == cpu: apicid : 48 == cpu: initial apicid : 48 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.23 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 10 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1600.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 9 == cpu: cpu cores : 6 == cpu: apicid : 50 == cpu: initial apicid : 50 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.23 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 11 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1733.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 10 == cpu: cpu cores : 6 == cpu: apicid : 52 == cpu: initial apicid : 52 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.23 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: === using parrot @ Thu Mar 4 21:23:27 EST 2021 === sourcing CMS setup @ Thu Mar 4 21:23:27 EST 2021 LibCvmfs version 2.4, revision 25 === sourcing OSG setup @ Thu Mar 4 21:23:28 EST 2021 ==== environment after sourcing startup scripts @ Thu Mar 4 21:23:28 EST 2021 ==== == env: VC3_VERSION_SED=4.2 == env: MANPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/man:/cvmfs/cms.cern.ch/share/man: == env: CCTOOLS_RESOURCE_PROCESS_START=1614911008976796 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: GFAL_PLUGIN_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/gfal2-plugins/ == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/usr/ == env: LOBSTER_GFAL_COPY=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin/gfal-copy == env: VOMS_USERCONF=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/vomses == env: MAKEFLAGS=-j4 == env: GLOBUS_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-13670/t.13553/cctools-temp-t.13553.79WTvE == env: PERL5LIB=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5 == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: CVSROOT=:gserver:cmssw.cvs.cern.ch:/local/reps/CMSSW == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-13670/t.13553/librmonitor_helper.so.lpBOl8 == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: X509_CERT_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/certificates == env: SCRAM_ARCH=slc7_amd64_gcc820 == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_20 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: LD_LIBRARY_PATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/dcap:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/lcgdm:/.singularity.d/libs:lib:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-13670/t.13553/cctools-temp-t.13553.79WTvE == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/usr/ == env: OSG_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-AWW3Po == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-13670/cache/tmp == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: SITECONFIG_PATH=/cvmfs/cms.cern.ch/SITECONF/local == env: PARROT_CVMFS_REPO= == env: VC3_VERSION_GZIP=1.5 == env: PATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/sbin:/cvmfs/cms.cern.ch/common:/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ENV_TAG_GLOBAL=13419 == env: CMS_PATH=/cvmfs/cms.cern.ch == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-AWW3Po == env: PWD=/disk/vc3-root/tmp/worker-230547-13670/t.13553 == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_WHICH=2.20 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: X509_VOMS_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/vomsdir == env: LOBSTER_LCG_CP= == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-13670 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/usr/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: CXX=g++ == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: DISK=255 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-13670/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-13670/cache/tmp/cvmfs == env: GFAL_CONFIG_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/gfal2.d/ == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=964 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TMP=/disk/vc3-root/tmp/worker-230547-13670/t.13553/cctools-temp-t.13553.79WTvE == env: PYTHONPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib/python2.7/site-packages:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/python2.7/site-packages:python:python: == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_ROOT_TAR=/usr/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-AWW3Po.wrapper == env: CC=gcc == env: CCTOOLS_RESOURCE_MONITOR_INFO=1024 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=1 == env: PARROT_DEBUG_FLAGS= == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_ALL_postLHE_crc.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=15738 == env: _=/usr/bin/env ==== proxy information @ Thu Mar 4 21:23:29 EST 2021 ==== == proxy: subject : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman/CN=1808231461 == proxy: issuer : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman == proxy: identity : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman == proxy: type : RFC compliant proxy == proxy: strength : 1024 bits == proxy: path : proxy == proxy: timeleft : 156:22:35 ==== working directory at startup @ Thu Mar 4 21:23:29 EST 2021 ==== == dir: total 884 == dir: -rwxr-xr-x 2 kmohrman campus 1580 Mar 4 21:22 0001_1834_report.json == dir: -rwxr-xr-x 2 kmohrman campus 1578 Mar 4 21:22 0001_2459_report.json == dir: -rwxr-xr-x 2 kmohrman campus 1582 Mar 4 21:22 0001_2703_report.json == dir: -rwxr-xr-x 2 kmohrman campus 1582 Mar 4 21:22 0001_2972_report.json == dir: -rwxr-xr-x 2 kmohrman campus 1582 Mar 4 21:22 0001_3071_report.json == dir: -rwxr-xr-x 2 kmohrman campus 1364 Mar 4 21:22 0001_3160_report.json == dir: drwxr-xr-x 2 kmohrman campus 71 Mar 4 21:22 bin == dir: -rwxr-xr-x 4 kmohrman campus 627272 Mar 4 20:15 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 Mar 4 21:22 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 Mar 4 21:22 cctools-temp-t.13553.79WTvE == dir: -rw------- 1 kmohrman campus 51 Mar 4 21:23 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 Mar 4 21:23 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 Mar 4 21:22 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 Mar 4 21:22 librmonitor_helper.so.lpBOl8 == dir: -rw-r--r-- 2 kmohrman campus 868 Mar 4 21:22 merge_cfg.py == dir: -rw-r--r-- 2 kmohrman campus 808 Mar 4 21:22 merge_reports.py == dir: -rw-r--r-- 2 kmohrman campus 3006 Mar 4 21:22 parameters.json == dir: -rw------- 2 kmohrman campus 9921 Mar 4 21:22 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 Mar 4 21:22 python == dir: -rw-r--r-- 4 kmohrman campus 570 Mar 4 20:15 report.json.in == dir: -rw-r--r-- 2 kmohrman campus 549 Mar 4 21:11 sandbox-CMSSW_10_6_20-slc7_amd64_gcc700.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 37 Mar 4 21:22 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 Mar 4 21:23 t_wrapper_start == dir: -rwxr-xr-x 4 kmohrman campus 47217 Mar 4 20:15 task.py == dir: -rwxr-xr-x 4 kmohrman campus 5986 Mar 4 20:15 wrapper.sh === creating new release CMSSW_10_6_20 for scram arch slc7_amd64_gcc700 @ Thu Mar 4 21:23:29 EST 2021 WARNING: In non-interactive mode release checks e.g. deprecated releases, production architectures are disabled. === unpacking sandbox-CMSSW_10_6_20-slc7_amd64_gcc700.tar.bz2 @ Thu Mar 4 21:23:33 EST 2021 ==== machine load @ Thu Mar 4 21:23:36 EST 2021 ==== top: unknown option 'M' Usage: top -hv | -bcHiOSs -d secs -n max -u|U user -p pid(s) -o field -w [cols] ==== environment before execution @ Thu Mar 4 21:23:36 EST 2021 ==== == env: G4LEVELGAMMADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4PhotonEvaporation/5.2/data/PhotonEvaporation5.2 == env: UTM_XSD_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj == env: SRT_G4LEVELGAMMADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4PhotonEvaporation/5.2/data/PhotonEvaporation5.2 == env: VC3_VERSION_SED=4.2 == env: CMSSW_RELEASE_BASE=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20 == env: SCRAMRT_SET=CMSSW:CMSSW_10_6_20:slc7_amd64_gcc700:V2_2_9_pre12:SRT_ == env: MANPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/man:/cvmfs/cms.cern.ch/share/man: == env: CCTOOLS_RESOURCE_PROCESS_START=1614911016329657 == env: CMSSW_FWLITE_INCLUDE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include == env: SRT_GCC_RUNTIME_ASAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: ROOT_INCLUDE_PATH=/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/include/LCG:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mctester/1.25.0a-pafccj9/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj6/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dd4hep/v01-10x-pafccj9/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtDesigner:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauolapp/1.1.5-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/charybdis/1.003-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj2/include/SHERPA-MC:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtOpenGL:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtGui:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwig/6.521-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt3Support:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lwtnn/2.4-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4/10.4.3-pafccj2/include/Geant4:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/classlib/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cgal/4.2-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tkonlinesw/4.2.0-1_gcc7-pafccj9/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/starlight/r193-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtCore:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtXml:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mcdb/1.0.3-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libungif/4.1.4-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libtiff/4.0.3-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/highfive/2.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libpng/1.6.16-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pcre/8.37-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/include/xrootd/private:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/vdt/0.4.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/toprex/4.23-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tbb/2019_U3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauola/27.121.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sigcpp/2.6.2-pafccj/include/sigc++-2.0:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sqlite/3.22.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/protobuf/3.5.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pacparser/1.3.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/oracle/12.1.0.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/py2-numpy/1.16.2-nmpfii2/c-api/core/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/meschach/1.2.pCMS1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lz4/1.9.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libuuid/2.22.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libunwind/1.2.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libhepml/0.2.1-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ktjet/1.06-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jimmy/4.2-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jemalloc/5.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hls/2019.08/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj12:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hector/1.3.4_patch1-pafccj9/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libjpeg-turbo/2.0.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/giflib/4.2.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gsl/2.2.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gdbm/1.10-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/freetype/2.5.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftw3/3.3.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftjet/1.5.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/expat/2.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dpm/1.8.0.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vecgeom/v00.05.00-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xerces-c/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xz/5.2.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dcap/2.47.8-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libxml2/2.9.1-pafccj/include/libxml2:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/curl/7.59.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cppunit/1.40.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openssl/1.0.2d-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia6/426-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/photos/215.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/zlib-x86_64/1.2.11-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/bz2lib/1.0.6-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/include/python2.7:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tinyxml2/6.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ittnotify/16.06.18-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj/include:/usr/local/include:/usr/include == env: INTEL_LICENSE_FILE=28518@lxlicen01.cern.ch,28518@lxlicen02.cern.ch,28518@lxlicen03.cern.ch == env: SRT_TEXMFHOME_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj8/share/Rivet/texmf == env: SRT_GEANT4_PARFULLCMS_CONFIG_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-parfullcms/2014.01.27-pafccj2/share/ParFullCMS == env: GFAL_PLUGIN_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/gfal2-plugins/ == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/usr/ == env: LOBSTER_GFAL_COPY=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin/gfal-copy == env: PDFPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj8/share == env: SRT_TNS_ADMIN_SCRAMRTDEL=/etc == env: VOMS_USERCONF=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/vomses == env: MAKEFLAGS=-j4 == env: ROOT_GCC_TOOLCHAIN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: GLOBUS_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-13670/t.13553/cctools-temp-t.13553.79WTvE == env: G4FORCENUMBEROFTHREADS=max == env: OPENBLAS_NUM_THREADS=1 == env: SRT_PDFPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj8/share == env: PERL5LIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5 == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: CMSSW_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms == env: LHAPDF_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/share/LHAPDF == env: CVSROOT=:gserver:cmssw.cvs.cern.ch:/local/reps/CMSSW == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-13670/t.13553/librmonitor_helper.so.lpBOl8 == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: CMSSW_GIT_HASH=CMSSW_10_6_20 == env: SRT_G4ABLADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ABLA/3.0/data/G4ABLA3.0 == env: QTDIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2 == env: SRT_SCONS_LIB_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/scons/3.0.1-pafccj/lib == env: OLDPWD=/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20 == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: G4NEUTRONXSDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NEUTRONXS/1.4/data/G4NEUTRONXS1.4 == env: QTINC=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include == env: X509_CERT_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/certificates == env: SCRAM_ARCH=slc7_amd64_gcc700 == env: GIT_SSL_CAINFO=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/ssl/certs/ca-bundle.crt == env: SRT_CMS_OPENLOOPS_PREFIX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openloops/2.1.0-pafccj2 == env: SRT_GIT_EXEC_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/libexec/git-core == env: SRT_THEPEGPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj2/share/ThePEG == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_20 == env: ROOT_TTREECACHE_SIZE=0 == env: EVTGENDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/evtgen/1.6.0-pafccj5/share == env: SRT_INTEL_LICENSE_FILE_SCRAMRTDEL=28518@lxlicen01.cern.ch,28518@lxlicen02.cern.ch,28518@lxlicen03.cern.ch == env: SRT_ROOT_INCLUDE_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/include/LCG:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mctester/1.25.0a-pafccj9/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj6/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dd4hep/v01-10x-pafccj9/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtDesigner:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauolapp/1.1.5-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/charybdis/1.003-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj2/include/SHERPA-MC:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtOpenGL:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtGui:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwig/6.521-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt3Support:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lwtnn/2.4-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4/10.4.3-pafccj2/include/Geant4:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/classlib/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cgal/4.2-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tkonlinesw/4.2.0-1_gcc7-pafccj9/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/starlight/r193-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtCore:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtXml:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mcdb/1.0.3-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libungif/4.1.4-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libtiff/4.0.3-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/highfive/2.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libpng/1.6.16-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pcre/8.37-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/include/xrootd/private:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/vdt/0.4.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/toprex/4.23-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tbb/2019_U3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauola/27.121.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sigcpp/2.6.2-pafccj/include/sigc++-2.0:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sqlite/3.22.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/protobuf/3.5.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pacparser/1.3.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/oracle/12.1.0.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/py2-numpy/1.16.2-nmpfii2/c-api/core/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/meschach/1.2.pCMS1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lz4/1.9.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libuuid/2.22.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libunwind/1.2.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libhepml/0.2.1-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ktjet/1.06-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jimmy/4.2-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jemalloc/5.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hls/2019.08/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj12:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hector/1.3.4_patch1-pafccj9/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libjpeg-turbo/2.0.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/giflib/4.2.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gsl/2.2.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gdbm/1.10-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/freetype/2.5.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftw3/3.3.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftjet/1.5.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/expat/2.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dpm/1.8.0.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vecgeom/v00.05.00-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xerces-c/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xz/5.2.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dcap/2.47.8-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libxml2/2.9.1-pafccj/include/libxml2:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/curl/7.59.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cppunit/1.40.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openssl/1.0.2d-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia6/426-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/photos/215.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/zlib-x86_64/1.2.11-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/bz2lib/1.0.6-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/include/python2.7:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tinyxml2/6.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ittnotify/16.06.18-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj/include:/usr/local/include:/usr/include == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: G4LEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4EMLOW/7.3/data/G4EMLOW7.3 == env: SRT_VINCIADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vincia/2.2.04-pafccj5/share/Vincia/xmldoc == env: SRT_ROOT_TTREECACHE_PREFILL_SCRAMRTDEL=0 == env: OPAL_PREFIX=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openmpi/2.1.5-pafccj == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: ROOT_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj12:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: SHERPA_INCLUDE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj2/include/SHERPA-MC == env: SRT_LHAPDF_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/share/LHAPDF == env: SRT_PYTHON27PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20/python:/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-tool-conf/45.0-pafccj26/lib/python2.7/site-packages == env: LD_LIBRARY_PATH=/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20/biglib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/biglib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cuda/10.1.105-pafccj2/drivers:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/dcap:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/lcgdm:/.singularity.d/libs:lib:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-13670/t.13553/cctools-temp-t.13553.79WTvE == env: SRT_CMSSW_RELEASE_BASE_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20 == env: SRT_RIVET_ANALYSIS_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj8/lib == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: SRT_PERL5LIB_SCRAMRT=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/perl5 == env: SRT_CMSSW_VERSION_SCRAMRTDEL=CMSSW_10_6_20 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/usr/ == env: GCC_RUNTIME_LSAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: SCRAM_CXX11_ABI=1 == env: VALGRIND_LIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/lib/valgrind == env: SRT_CMSSW_GIT_HASH_SCRAMRTDEL=CMSSW_10_6_20 == env: SRT_ROOTSYS_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj6/ == env: OSG_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-AWW3Po == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-13670/cache/tmp == env: G4NEUTRONHPDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NDL/4.5/data/G4NDL4.5 == env: GEANT4_PARFULLCMS_CONFIG_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-parfullcms/2014.01.27-pafccj2/share/ParFullCMS == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: CSC_TRACK_FINDER_DATA_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/CSCTrackFinderEmulation/1.2-pafccj/data/ == env: SRT_QTINC_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: G4ENSDFSTATEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ENSDFSTATE/2.2/data/G4ENSDFSTATE2.2 == env: G4RADIOACTIVEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4RadioactiveDecay/5.2/data/RadioactiveDecay5.2 == env: ROOFITSYS=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj6/ == env: SRT_ROOFITSYS_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj6/ == env: SRT_G4RADIOACTIVEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4RadioactiveDecay/5.2/data/RadioactiveDecay5.2 == env: SRT_G4ENSDFSTATEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ENSDFSTATE/2.2/data/G4ENSDFSTATE2.2 == env: SRT_CLHEP_PARAM_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2 == env: G4ABLADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ABLA/3.0/data/G4ABLA3.0 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: SRT_SHERPA_INCLUDE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj2/include/SHERPA-MC == env: SRT_G4FORCENUMBEROFTHREADS_SCRAMRTDEL=max == env: SRT_WORKER_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/blackhat/0.9.9-pafccj/share/blackhat/datafiles/ == env: SITECONFIG_PATH=/cvmfs/cms.cern.ch/SITECONF/local == env: PARROT_CVMFS_REPO= == env: VC3_VERSION_GZIP=1.5 == env: GCC_RUNTIME_TSAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libtsan.so == env: TNS_ADMIN=/etc == env: SRT_HEPPDT_PARAM_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj == env: PATH=/cvmfs/cms.cern.ch/share/overrides/bin:/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20/bin/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/sbin:/cvmfs/cms.cern.ch/common:/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ENV_TAG_GLOBAL=13419 == env: THEPEGPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj2/share/ThePEG == env: SRT_CMSSW_SEARCH_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20/poison:/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20/src:/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20/external/slc7_amd64_gcc700/data:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/external/slc7_amd64_gcc700/data == env: SRT_GIT_SSL_CAINFO_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/ssl/certs/ca-bundle.crt == env: SRT_GCC_RUNTIME_LSAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: CMS_PATH=/cvmfs/cms.cern.ch == env: VC3_ROOT=/disk/vc3-root == env: SRT_UTM_XSD_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj == env: SRT_PATH_SCRAMRT=/cvmfs/cms.cern.ch/share/overrides/bin:/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20/bin/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/bin == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-AWW3Po == env: RIVET_ANALYSIS_PATH=/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj8/lib == env: SRT_LOCALRT_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20 == env: SRT_CMSSW_BASE_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20 == env: PWD=/disk/vc3-root/tmp/worker-230547-13670/t.13553 == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: PYTHON_VALGRIND_SUPP=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/share/valgrind/valgrind-python.supp == env: SRT_OPAL_PREFIX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openmpi/2.1.5-pafccj == env: VC3_VERSION_WHICH=2.20 == env: GCC_RUNTIME_UBSAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libubsan.so == env: LANG=C == env: SRT_QTDIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: SRT_G4NEUTRONHPDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NDL/4.5/data/G4NDL4.5 == env: X509_VOMS_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/vomsdir == env: LOBSTER_LCG_CP= == env: SRT_SHERPA_SHARE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj2/share/SHERPA-MC == env: SRT_GCC_RUNTIME_TSAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libtsan.so == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-13670 == env: CASCADE_PDFPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/share == env: SRT_ROOT_GCC_TOOLCHAIN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: SRT_CASCADE_PDFPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/share == env: WORKER_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/blackhat/0.9.9-pafccj/share/blackhat/datafiles/ == env: GIT_TEMPLATE_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/git-core/templates == env: G4SAIDXSDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4SAIDDATA/1.1/data/G4SAIDDATA1.1 == env: MLAS_DYNAMIC_CPU_ARCH=0 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: PYTHON27PATH=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20/python:/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-tool-conf/45.0-pafccj26/lib/python2.7/site-packages == env: SRT_CMSSW_FWLITE_INCLUDE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/usr/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: ROOTSYS=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj6/ == env: SRT_PYTHIA8DATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/share/Pythia8/xmldoc == env: SRT_HERWIGPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj3/share/Herwig == env: CXX=g++ == env: SRT_QTLIB_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/lib == env: SRT_PYTHON3PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20/python:/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-tool-conf/45.0-pafccj26/lib/python3.6/site-packages == env: SHERPA_LIBRARY_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj2/lib/SHERPA-MC == env: SRT_PYTHON_VALGRIND_SUPP_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/share/valgrind/valgrind-python.supp == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: CMSSW_SEARCH_PATH=/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20/poison:/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20/src:/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20/external/slc7_amd64_gcc700/data:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/external/slc7_amd64_gcc700/data == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: GENEVA_DATA_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geneva/1.0-RC3-pafccj8/share/Geneva == env: DISK=255 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-13670/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-13670/cache/tmp/cvmfs == env: GOSAMCONTRIB_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: ROOT_TTREECACHE_PREFILL=0 == env: GENREFLEX=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj6/bin/genreflex == env: VINCIADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vincia/2.2.04-pafccj5/share/Vincia/xmldoc == env: SRT_G4LEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4EMLOW/7.3/data/G4EMLOW7.3 == env: SRT_GENREFLEX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj6/bin/genreflex == env: SRT_GOSAMCONTRIB_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: SRT_ROOT_TTREECACHE_SIZE_SCRAMRTDEL=0 == env: SRT_EVTGENDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/evtgen/1.6.0-pafccj5/share == env: SRT_GENEVA_DATA_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geneva/1.0-RC3-pafccj8/share/Geneva == env: GFAL_CONFIG_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/gfal2.d/ == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=964 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: SRT_CMSSW_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms == env: HEPPDT_PARAM_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj == env: SRT_LD_LIBRARY_PATH_SCRAMRT=/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20/biglib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/biglib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cuda/10.1.105-pafccj2/drivers == env: TMP=/disk/vc3-root/tmp/worker-230547-13670/t.13553/cctools-temp-t.13553.79WTvE == env: PYTHONPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib/python2.7/site-packages:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/python2.7/site-packages:python:python: == env: PYTHON3PATH=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20/python:/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-tool-conf/45.0-pafccj26/lib/python3.6/site-packages == env: QTLIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/lib == env: SCONS_LIB_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/scons/3.0.1-pafccj/lib == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: COMPILER_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: FRONTIER_CLIENT=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/ == env: SRT_G4NEUTRONXSDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NEUTRONXS/1.4/data/G4NEUTRONXS1.4 == env: SRT_SHERPA_LIBRARY_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj2/lib/SHERPA-MC == env: VC3_ROOT_TAR=/usr/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CLHEP_PARAM_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2 == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-AWW3Po.wrapper == env: PYTHIA8DATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/share/Pythia8/xmldoc == env: HERWIGPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj3/share/Herwig == env: SRT_FRONTIER_CLIENT_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/ == env: SRT_COMPILER_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: SRT_CSC_TRACK_FINDER_DATA_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/CSCTrackFinderEmulation/1.2-pafccj/data/ == env: GCC_RUNTIME_ASAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: SRT_ROOT_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj12:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: CC=gcc == env: TEXMFHOME=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj8/share/Rivet/texmf == env: SRT_MLAS_DYNAMIC_CPU_ARCH_SCRAMRTDEL=0 == env: SRT_OPENBLAS_NUM_THREADS_SCRAMRTDEL=1 == env: SRT_GIT_TEMPLATE_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/git-core/templates == env: SRT_G4SAIDXSDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4SAIDDATA/1.1/data/G4SAIDDATA1.1 == env: CMSSW_VERSION=CMSSW_10_6_20 == env: SRT_GCC_RUNTIME_UBSAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libubsan.so == env: SRT_LANG_SCRAMRTDEL=C == env: CCTOOLS_RESOURCE_MONITOR_INFO=1024 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=1 == env: PARROT_DEBUG_FLAGS= == env: SHERPA_SHARE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj2/share/SHERPA-MC == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: CMS_OPENLOOPS_PREFIX=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openloops/2.1.0-pafccj2 == env: GIT_EXEC_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/libexec/git-core == env: LOCALRT=/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20 == env: CMSSW_BASE=/disk/vc3-root/tmp/worker-230547-13670/t.13553/CMSSW_10_6_20 == env: SRT_SCRAM_CXX11_ABI_SCRAMRTDEL=1 == env: SRT_VALGRIND_LIB_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/lib/valgrind == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_ALL_postLHE_crc.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=15738 == env: _=/usr/bin/env === wrapper ready @ Thu Mar 4 21:23:38 EST 2021 ==== working directory before execution @ Thu Mar 4 21:23:38 EST 2021 ==== == dir: total 892 == dir: -rwxr-xr-x 2 kmohrman campus 1580 Mar 4 21:22 0001_1834_report.json == dir: -rwxr-xr-x 2 kmohrman campus 1578 Mar 4 21:22 0001_2459_report.json == dir: -rwxr-xr-x 2 kmohrman campus 1582 Mar 4 21:22 0001_2703_report.json == dir: -rwxr-xr-x 2 kmohrman campus 1582 Mar 4 21:22 0001_2972_report.json == dir: -rwxr-xr-x 2 kmohrman campus 1582 Mar 4 21:22 0001_3071_report.json == dir: -rwxr-xr-x 2 kmohrman campus 1364 Mar 4 21:22 0001_3160_report.json == dir: drwxr-xr-x 18 kmohrman campus 215 Mar 4 21:23 CMSSW_10_6_20 == dir: drwxr-xr-x 2 kmohrman campus 71 Mar 4 21:22 bin == dir: -rwxr-xr-x 4 kmohrman campus 627272 Mar 4 20:15 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 Mar 4 21:22 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 Mar 4 21:22 cctools-temp-t.13553.79WTvE == dir: -rw------- 1 kmohrman campus 51 Mar 4 21:23 cvmfschecksum.cms-ib.cern.ch == dir: -rw------- 1 kmohrman campus 51 Mar 4 21:23 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 Mar 4 21:23 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 Mar 4 21:22 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 Mar 4 21:22 librmonitor_helper.so.lpBOl8 == dir: -rw-r--r-- 2 kmohrman campus 868 Mar 4 21:22 merge_cfg.py == dir: -rw-r--r-- 2 kmohrman campus 808 Mar 4 21:22 merge_reports.py == dir: -rw-r--r-- 2 kmohrman campus 3006 Mar 4 21:22 parameters.json == dir: -rw------- 2 kmohrman campus 9921 Mar 4 21:22 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 Mar 4 21:22 python == dir: -rw-r--r-- 4 kmohrman campus 570 Mar 4 20:15 report.json.in == dir: -rw-r--r-- 2 kmohrman campus 549 Mar 4 21:11 sandbox-CMSSW_10_6_20-slc7_amd64_gcc700.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 37 Mar 4 21:22 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 Mar 4 21:23 t_wrapper_ready == dir: -rw-r--r-- 1 kmohrman campus 11 Mar 4 21:23 t_wrapper_start == dir: -rwxr-xr-x 4 kmohrman campus 47217 Mar 4 20:15 task.py == dir: -rwxr-xr-x 4 kmohrman campus 5986 Mar 4 20:15 wrapper.sh >>> data is {u'files': {u'info': {}, u'output_info': {}, u'skipped': []}, u'cpu_time': 0, u'exe_exit_code': 0, u'events_written': 0, u'output_size': 0, u'task_exit_code': 0, u'output_storage_element': u'', u'cache': {u'start_size': 0, u'type': 2, u'end_size': 0}, u'stageout_exit_code': 0, u'output_bare_size': 0, u'transfers': defaultdict(, {}), u'task_timing': {u'wrapper_ready': 0, u'wrapper_start': 0, u'prologue_end': 0, u'epilogue_end': 0, u'stage_out_end': 0, u'stage_in_end': 0, u'processing_end': 0}, u'events_per_run': 0} @ Thu Mar 4 21:23:46 2021 >>> Trying hdfs client access method @ Thu Mar 4 21:23:46 2021 >>> executing 'timeout 300 hdfs dfs -fs hdfs://eddie.crc.nd.edu:19000 -get /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_11834.root MAOD-00000_11834.root' @ Thu Mar 4 21:23:46 2021 >> using /disk/vc3-root/tmp/worker-230547-13670/t.13553/cctools-temp-t.13553.79WTvE/tmp_4w9Ey to store command output >> cmd: timeout: failed to run command 'hdfs': No such file or directory >>>>> Unable to copy input with hdfs client @ Thu Mar 4 21:23:46 2021 >>> Trying xrootd access method @ Thu Mar 4 21:23:46 2021 >>> executing 'env XRD_LOGLEVEL=Debug timeout 300 xrdfs deepthought.crc.nd.edu stat /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_11834.root' @ Thu Mar 4 21:23:46 2021 >> using /disk/vc3-root/tmp/worker-230547-13670/t.13553/cctools-temp-t.13553.79WTvE/tmpwKdIjs to store command output >> cmd: [2021-03-04 21:23:47.029338 -0500][Warning][Utility ] Unable to process global config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-04 21:23:47.030441 -0500][Debug ][Utility ] Unable to process user config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-04 21:23:47.030651 -0500][Debug ][PlugInMgr ] Initializing plug-in manager... >> cmd: [2021-03-04 21:23:47.030712 -0500][Debug ][PlugInMgr ] No default plug-in, loading plug-in configs... >> cmd: [2021-03-04 21:23:47.030761 -0500][Debug ][PlugInMgr ] Processing plug-in definitions in /etc/xrootd/client.plugins.d... >> cmd: [2021-03-04 21:23:47.030863 -0500][Debug ][PlugInMgr ] Unable to process directory /etc/xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-04 21:23:47.031228 -0500][Debug ][PlugInMgr ] Processing plug-in definitions in /tmp/runos_singularity_home-102599951013971108985653159496743475414/.xrootd/client.plugins.d... >> cmd: [2021-03-04 21:23:47.031342 -0500][Debug ][PlugInMgr ] Unable to process directory /tmp/runos_singularity_home-102599951013971108985653159496743475414/.xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-04 21:23:47.031534 -0500][Debug ][App ] Executing: stat /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_11834.root >> cmd: [2021-03-04 21:23:47.031641 -0500][Debug ][Poller ] Available pollers: built-in >> cmd: [2021-03-04 21:23:47.031690 -0500][Debug ][Poller ] Attempting to create a poller according to preference: built-in >> cmd: [2021-03-04 21:23:47.031736 -0500][Debug ][Poller ] Creating poller: built-in >> cmd: [2021-03-04 21:23:47.031788 -0500][Debug ][Poller ] Creating and starting the built-in poller... >> cmd: [2021-03-04 21:23:47.032238 -0500][Debug ][Poller ] Using 1 poller threads >> cmd: [2021-03-04 21:23:47.032302 -0500][Debug ][TaskMgr ] Starting the task manager... >> cmd: [2021-03-04 21:23:47.032459 -0500][Debug ][TaskMgr ] Task manager started >> cmd: [2021-03-04 21:23:47.032521 -0500][Debug ][JobMgr ] Starting the job manager... >> cmd: [2021-03-04 21:23:47.032914 -0500][Debug ][JobMgr ] Job manager started, 3 workers >> cmd: [2021-03-04 21:23:47.032989 -0500][Debug ][TaskMgr ] Registering task: "FileTimer task" to be run at: [2021-03-04 21:23:47 -0500] >> cmd: [2021-03-04 21:23:47.033081 -0500][Debug ][PostMaster ] Creating new channel to: deepthought.crc.nd.edu:1094 1 stream(s) >> cmd: [2021-03-04 21:23:47.033154 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-03-04 21:23:47.034156 -0500][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" to be run at: [2021-03-04 21:24:02 -0500] >> cmd: [2021-03-04 21:23:47.035152 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-03-04 21:23:47.035307 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-03-04 21:23:47.035423 -0500][Debug ][Poller ] Adding socket 0x1c92a60 to the poller >> cmd: [2021-03-04 21:23:47.035801 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2021-03-04 21:23:47.035982 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-03-04 21:23:47.036650 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Got the server hand shake response (type: manager [], protocol version 400) >> cmd: [2021-03-04 21:23:47.036903 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] kXR_protocol successful (type: manager [], protocol version 400) >> cmd: [2021-03-04 21:23:47.040886 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=d6cneh007.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-03-04 21:23:47.041377 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Logged in, session: 343d1000a60d0000310100002d451000 >> cmd: [2021-03-04 21:23:47.041478 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream 0 connected. >> cmd: [2021-03-04 21:23:47.041539 -0500][Debug ][Utility ] Monitor library name not set. No monitoring >> cmd: [2021-03-04 21:23:47.042552 -0500][Debug ][PostMaster ] Creating new channel to: primeradiant05.crc.nd.edu:1096 1 stream(s) >> cmd: [2021-03-04 21:23:47.042635 -0500][Debug ][PostMaster ] [primeradiant05.crc.nd.edu:1096 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-03-04 21:23:47.044281 -0500][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: primeradiant05.crc.nd.edu:1096" to be run at: [2021-03-04 21:24:02 -0500] >> cmd: [2021-03-04 21:23:47.045476 -0500][Debug ][PostMaster ] [primeradiant05.crc.nd.edu:1096] Found 1 address(es): [::ffff:149.165.243.13]:1096 >> cmd: [2021-03-04 21:23:47.045675 -0500][Debug ][AsyncSock ] [primeradiant05.crc.nd.edu:1096 #0.0] Attempting connection to [::ffff:149.165.243.13]:1096 >> cmd: [2021-03-04 21:23:47.045789 -0500][Debug ][Poller ] Adding socket 0x900016a0 to the poller >> cmd: [2021-03-04 21:23:47.045937 -0500][Debug ][AsyncSock ] [primeradiant05.crc.nd.edu:1096 #0.0] Async connection call returned >> cmd: [2021-03-04 21:23:47.046114 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-03-04 21:23:47.046604 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Got the server hand shake response (type: server [], protocol version 400) >> cmd: [2021-03-04 21:23:47.046846 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] kXR_protocol successful (type: server [], protocol version 400) >> cmd: [2021-03-04 21:23:47.050054 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=d6cneh007.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-03-04 21:23:47.050510 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Logged in, session: 6be102008c160000520100005ce50200 >> cmd: [2021-03-04 21:23:47.050569 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Authentication is required: &P=gsi,v:10400,c:ssl,ca:ba240aa8.0|f5f0dfc2.0 >> cmd: [2021-03-04 21:23:47.050619 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Sending authentication data >> cmd: [2021-03-04 21:23:47.058549 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Trying to authenticate using gsi >> cmd: [2021-03-04 21:23:47.163350 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Sending more authentication data for gsi >> cmd: [2021-03-04 21:23:47.171725 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Authenticated with gsi. >> cmd: [2021-03-04 21:23:47.171883 -0500][Debug ][PostMaster ] [primeradiant05.crc.nd.edu:1096 #0] Stream 0 connected. >> cmd: Path: /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_11834.root >> cmd: Id: 0 >> cmd: Size: 46769736 >> cmd: MTime: 2021-03-05 01:52:47 >> cmd: Flags: 24 (Offline|IsReadable) >> cmd: [2021-03-04 21:23:47.175520 -0500][Debug ][JobMgr ] Stopping the job manager... >> cmd: [2021-03-04 21:23:47.176314 -0500][Debug ][JobMgr ] Job manager stopped >> cmd: [2021-03-04 21:23:47.176468 -0500][Debug ][TaskMgr ] Stopping the task manager... >> cmd: [2021-03-04 21:23:47.176832 -0500][Debug ][TaskMgr ] Task manager stopped >> cmd: [2021-03-04 21:23:47.176913 -0500][Debug ][Poller ] Stopping the poller... >> cmd: [2021-03-04 21:23:47.177249 -0500][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" >> cmd: [2021-03-04 21:23:47.177309 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-03-04 21:23:47.177397 -0500][Debug ][Poller ] <[::ffff:10.32.73.238]:52314><--><[::ffff:129.74.85.55]:1094> Removing socket from the poller >> cmd: [2021-03-04 21:23:47.177494 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Destroying stream >> cmd: [2021-03-04 21:23:47.177546 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-03-04 21:23:47.177600 -0500][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: primeradiant05.crc.nd.edu:1096" >> cmd: [2021-03-04 21:23:47.177648 -0500][Debug ][AsyncSock ] [primeradiant05.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2021-03-04 21:23:47.177696 -0500][Debug ][Poller ] <[::ffff:10.32.73.238]:60100><--><[::ffff:149.165.243.13]:1096> Removing socket from the poller >> cmd: [2021-03-04 21:23:47.177776 -0500][Debug ][PostMaster ] [primeradiant05.crc.nd.edu:1096 #0] Destroying stream >> cmd: [2021-03-04 21:23:47.177825 -0500][Debug ][AsyncSock ] [primeradiant05.crc.nd.edu:1096 #0.0] Closing the socket >>> will stream using xrootd instead of copying @ Thu Mar 4 21:23:47 2021 >>> Trying hdfs client access method @ Thu Mar 4 21:23:47 2021 >>> executing 'timeout 300 hdfs dfs -fs hdfs://eddie.crc.nd.edu:19000 -get /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_13160.root MAOD-00000_13160.root' @ Thu Mar 4 21:23:47 2021 >> using /disk/vc3-root/tmp/worker-230547-13670/t.13553/cctools-temp-t.13553.79WTvE/tmpaoQC8I to store command output >> cmd: timeout: failed to run command 'hdfs': No such file or directory >>>>> Unable to copy input with hdfs client @ Thu Mar 4 21:23:47 2021 >>> Trying xrootd access method @ Thu Mar 4 21:23:47 2021 >>> executing 'env XRD_LOGLEVEL=Debug timeout 300 xrdfs deepthought.crc.nd.edu stat /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_13160.root' @ Thu Mar 4 21:23:47 2021 >> using /disk/vc3-root/tmp/worker-230547-13670/t.13553/cctools-temp-t.13553.79WTvE/tmplmtDQ2 to store command output >> cmd: [2021-03-04 21:23:47.452696 -0500][Warning][Utility ] Unable to process global config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-04 21:23:47.453845 -0500][Debug ][Utility ] Unable to process user config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-04 21:23:47.454022 -0500][Debug ][PlugInMgr ] Initializing plug-in manager... >> cmd: [2021-03-04 21:23:47.454077 -0500][Debug ][PlugInMgr ] No default plug-in, loading plug-in configs... >> cmd: [2021-03-04 21:23:47.454125 -0500][Debug ][PlugInMgr ] Processing plug-in definitions in /etc/xrootd/client.plugins.d... >> cmd: [2021-03-04 21:23:47.454224 -0500][Debug ][PlugInMgr ] Unable to process directory /etc/xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-04 21:23:47.454617 -0500][Debug ][PlugInMgr ] Processing plug-in definitions in /tmp/runos_singularity_home-102599951013971108985653159496743475414/.xrootd/client.plugins.d... >> cmd: [2021-03-04 21:23:47.454724 -0500][Debug ][PlugInMgr ] Unable to process directory /tmp/runos_singularity_home-102599951013971108985653159496743475414/.xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-04 21:23:47.454915 -0500][Debug ][App ] Executing: stat /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_13160.root >> cmd: [2021-03-04 21:23:47.455023 -0500][Debug ][Poller ] Available pollers: built-in >> cmd: [2021-03-04 21:23:47.455072 -0500][Debug ][Poller ] Attempting to create a poller according to preference: built-in >> cmd: [2021-03-04 21:23:47.455118 -0500][Debug ][Poller ] Creating poller: built-in >> cmd: [2021-03-04 21:23:47.455170 -0500][Debug ][Poller ] Creating and starting the built-in poller... >> cmd: [2021-03-04 21:23:47.455591 -0500][Debug ][Poller ] Using 1 poller threads >> cmd: [2021-03-04 21:23:47.455661 -0500][Debug ][TaskMgr ] Starting the task manager... >> cmd: [2021-03-04 21:23:47.455810 -0500][Debug ][TaskMgr ] Task manager started >> cmd: [2021-03-04 21:23:47.455863 -0500][Debug ][JobMgr ] Starting the job manager... >> cmd: [2021-03-04 21:23:47.456302 -0500][Debug ][JobMgr ] Job manager started, 3 workers >> cmd: [2021-03-04 21:23:47.456389 -0500][Debug ][TaskMgr ] Registering task: "FileTimer task" to be run at: [2021-03-04 21:23:47 -0500] >> cmd: [2021-03-04 21:23:47.456476 -0500][Debug ][PostMaster ] Creating new channel to: deepthought.crc.nd.edu:1094 1 stream(s) >> cmd: [2021-03-04 21:23:47.456547 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-03-04 21:23:47.457583 -0500][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" to be run at: [2021-03-04 21:24:02 -0500] >> cmd: [2021-03-04 21:23:47.458887 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-03-04 21:23:47.459043 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-03-04 21:23:47.459147 -0500][Debug ][Poller ] Adding socket 0x1669a60 to the poller >> cmd: [2021-03-04 21:23:47.459520 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2021-03-04 21:23:47.459702 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-03-04 21:23:47.460333 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Got the server hand shake response (type: manager [], protocol version 400) >> cmd: [2021-03-04 21:23:47.460585 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] kXR_protocol successful (type: manager [], protocol version 400) >> cmd: [2021-03-04 21:23:47.463512 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=d6cneh007.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-03-04 21:23:47.463914 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Logged in, session: 383d1000a60d00003101000031451000 >> cmd: [2021-03-04 21:23:47.463990 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream 0 connected. >> cmd: [2021-03-04 21:23:47.464040 -0500][Debug ][Utility ] Monitor library name not set. No monitoring >> cmd: [2021-03-04 21:23:47.464881 -0500][Debug ][PostMaster ] Creating new channel to: primeradiant05.crc.nd.edu:1096 1 stream(s) >> cmd: [2021-03-04 21:23:47.464961 -0500][Debug ][PostMaster ] [primeradiant05.crc.nd.edu:1096 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-03-04 21:23:47.466804 -0500][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: primeradiant05.crc.nd.edu:1096" to be run at: [2021-03-04 21:24:02 -0500] >> cmd: [2021-03-04 21:23:47.468274 -0500][Debug ][PostMaster ] [primeradiant05.crc.nd.edu:1096] Found 1 address(es): [::ffff:149.165.243.13]:1096 >> cmd: [2021-03-04 21:23:47.468431 -0500][Debug ][AsyncSock ] [primeradiant05.crc.nd.edu:1096 #0.0] Attempting connection to [::ffff:149.165.243.13]:1096 >> cmd: [2021-03-04 21:23:47.468529 -0500][Debug ][Poller ] Adding socket 0x16a0 to the poller >> cmd: [2021-03-04 21:23:47.468865 -0500][Debug ][AsyncSock ] [primeradiant05.crc.nd.edu:1096 #0.0] Async connection call returned >> cmd: [2021-03-04 21:23:47.468962 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-03-04 21:23:47.469316 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Got the server hand shake response (type: server [], protocol version 400) >> cmd: [2021-03-04 21:23:47.469512 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] kXR_protocol successful (type: server [], protocol version 400) >> cmd: [2021-03-04 21:23:47.472418 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=d6cneh007.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-03-04 21:23:47.473228 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Logged in, session: 6de102008c160000390100005ee50200 >> cmd: [2021-03-04 21:23:47.473280 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Authentication is required: &P=gsi,v:10400,c:ssl,ca:ba240aa8.0|f5f0dfc2.0 >> cmd: [2021-03-04 21:23:47.473340 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Sending authentication data >> cmd: [2021-03-04 21:23:47.480154 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Trying to authenticate using gsi >> cmd: [2021-03-04 21:23:47.547914 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Sending more authentication data for gsi >> cmd: [2021-03-04 21:23:47.555375 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Authenticated with gsi. >> cmd: [2021-03-04 21:23:47.555480 -0500][Debug ][PostMaster ] [primeradiant05.crc.nd.edu:1096 #0] Stream 0 connected. >> cmd: Path: /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_13160.root >> cmd: Id: 0 >> cmd: Size: 33778480 >> cmd: MTime: 2021-03-05 02:21:41 >> cmd: Flags: 24 (Offline|IsReadable) >> cmd: [2021-03-04 21:23:47.557983 -0500][Debug ][JobMgr ] Stopping the job manager... >> cmd: [2021-03-04 21:23:47.558878 -0500][Debug ][JobMgr ] Job manager stopped >> cmd: [2021-03-04 21:23:47.558961 -0500][Debug ][TaskMgr ] Stopping the task manager... >> cmd: [2021-03-04 21:23:47.559185 -0500][Debug ][TaskMgr ] Task manager stopped >> cmd: [2021-03-04 21:23:47.559255 -0500][Debug ][Poller ] Stopping the poller... >> cmd: [2021-03-04 21:23:47.559574 -0500][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" >> cmd: [2021-03-04 21:23:47.559651 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-03-04 21:23:47.559711 -0500][Debug ][Poller ] <[::ffff:10.32.73.238]:52318><--><[::ffff:129.74.85.55]:1094> Removing socket from the poller >> cmd: [2021-03-04 21:23:47.559807 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Destroying stream >> cmd: [2021-03-04 21:23:47.559862 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-03-04 21:23:47.559917 -0500][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: primeradiant05.crc.nd.edu:1096" >> cmd: [2021-03-04 21:23:47.559993 -0500][Debug ][AsyncSock ] [primeradiant05.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2021-03-04 21:23:47.560051 -0500][Debug ][Poller ] <[::ffff:10.32.73.238]:60104><--><[::ffff:149.165.243.13]:1096> Removing socket from the poller >> cmd: [2021-03-04 21:23:47.560135 -0500][Debug ][PostMaster ] [primeradiant05.crc.nd.edu:1096 #0] Destroying stream >> cmd: [2021-03-04 21:23:47.560187 -0500][Debug ][AsyncSock ] [primeradiant05.crc.nd.edu:1096 #0.0] Closing the socket >>> will stream using xrootd instead of copying @ Thu Mar 4 21:23:47 2021 >>> Trying hdfs client access method @ Thu Mar 4 21:23:47 2021 >>> executing 'timeout 300 hdfs dfs -fs hdfs://eddie.crc.nd.edu:19000 -get /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12972.root MAOD-00000_12972.root' @ Thu Mar 4 21:23:47 2021 >> using /disk/vc3-root/tmp/worker-230547-13670/t.13553/cctools-temp-t.13553.79WTvE/tmpcxQefI to store command output >> cmd: timeout: failed to run command 'hdfs': No such file or directory >>>>> Unable to copy input with hdfs client @ Thu Mar 4 21:23:47 2021 >>> Trying xrootd access method @ Thu Mar 4 21:23:47 2021 >>> executing 'env XRD_LOGLEVEL=Debug timeout 300 xrdfs deepthought.crc.nd.edu stat /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12972.root' @ Thu Mar 4 21:23:47 2021 >> using /disk/vc3-root/tmp/worker-230547-13670/t.13553/cctools-temp-t.13553.79WTvE/tmpRiJdDh to store command output >> cmd: [2021-03-04 21:23:47.828746 -0500][Warning][Utility ] Unable to process global config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-04 21:23:47.829815 -0500][Debug ][Utility ] Unable to process user config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-04 21:23:47.829986 -0500][Debug ][PlugInMgr ] Initializing plug-in manager... >> cmd: [2021-03-04 21:23:47.830041 -0500][Debug ][PlugInMgr ] No default plug-in, loading plug-in configs... >> cmd: [2021-03-04 21:23:47.830089 -0500][Debug ][PlugInMgr ] Processing plug-in definitions in /etc/xrootd/client.plugins.d... >> cmd: [2021-03-04 21:23:47.830187 -0500][Debug ][PlugInMgr ] Unable to process directory /etc/xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-04 21:23:47.830548 -0500][Debug ][PlugInMgr ] Processing plug-in definitions in /tmp/runos_singularity_home-102599951013971108985653159496743475414/.xrootd/client.plugins.d... >> cmd: [2021-03-04 21:23:47.830655 -0500][Debug ][PlugInMgr ] Unable to process directory /tmp/runos_singularity_home-102599951013971108985653159496743475414/.xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-04 21:23:47.830836 -0500][Debug ][App ] Executing: stat /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12972.root >> cmd: [2021-03-04 21:23:47.830941 -0500][Debug ][Poller ] Available pollers: built-in >> cmd: [2021-03-04 21:23:47.830990 -0500][Debug ][Poller ] Attempting to create a poller according to preference: built-in >> cmd: [2021-03-04 21:23:47.831036 -0500][Debug ][Poller ] Creating poller: built-in >> cmd: [2021-03-04 21:23:47.831088 -0500][Debug ][Poller ] Creating and starting the built-in poller... >> cmd: [2021-03-04 21:23:47.831465 -0500][Debug ][Poller ] Using 1 poller threads >> cmd: [2021-03-04 21:23:47.831536 -0500][Debug ][TaskMgr ] Starting the task manager... >> cmd: [2021-03-04 21:23:47.831679 -0500][Debug ][TaskMgr ] Task manager started >> cmd: [2021-03-04 21:23:47.831733 -0500][Debug ][JobMgr ] Starting the job manager... >> cmd: [2021-03-04 21:23:47.832099 -0500][Debug ][JobMgr ] Job manager started, 3 workers >> cmd: [2021-03-04 21:23:47.832155 -0500][Debug ][TaskMgr ] Registering task: "FileTimer task" to be run at: [2021-03-04 21:23:47 -0500] >> cmd: [2021-03-04 21:23:47.832235 -0500][Debug ][PostMaster ] Creating new channel to: deepthought.crc.nd.edu:1094 1 stream(s) >> cmd: [2021-03-04 21:23:47.832306 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-03-04 21:23:47.833380 -0500][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" to be run at: [2021-03-04 21:24:02 -0500] >> cmd: [2021-03-04 21:23:47.834377 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-03-04 21:23:47.834532 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-03-04 21:23:47.834636 -0500][Debug ][Poller ] Adding socket 0x125aa60 to the poller >> cmd: [2021-03-04 21:23:47.835029 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2021-03-04 21:23:47.835213 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-03-04 21:23:47.835863 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Got the server hand shake response (type: manager [], protocol version 400) >> cmd: [2021-03-04 21:23:47.836123 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] kXR_protocol successful (type: manager [], protocol version 400) >> cmd: [2021-03-04 21:23:47.839742 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=d6cneh007.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-03-04 21:23:47.840146 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Logged in, session: 3e3d1000a60d00004401000037451000 >> cmd: [2021-03-04 21:23:47.840225 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream 0 connected. >> cmd: [2021-03-04 21:23:47.840275 -0500][Debug ][Utility ] Monitor library name not set. No monitoring >> cmd: [2021-03-04 21:23:47.841119 -0500][Debug ][PostMaster ] Creating new channel to: primeradiant03.crc.nd.edu:1096 1 stream(s) >> cmd: [2021-03-04 21:23:47.841201 -0500][Debug ][PostMaster ] [primeradiant03.crc.nd.edu:1096 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-03-04 21:23:47.843015 -0500][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: primeradiant03.crc.nd.edu:1096" to be run at: [2021-03-04 21:24:02 -0500] >> cmd: [2021-03-04 21:23:47.844060 -0500][Debug ][PostMaster ] [primeradiant03.crc.nd.edu:1096] Found 1 address(es): [::ffff:149.165.243.11]:1096 >> cmd: [2021-03-04 21:23:47.844205 -0500][Debug ][AsyncSock ] [primeradiant03.crc.nd.edu:1096 #0.0] Attempting connection to [::ffff:149.165.243.11]:1096 >> cmd: [2021-03-04 21:23:47.844295 -0500][Debug ][Poller ] Adding socket 0xa00016a0 to the poller >> cmd: [2021-03-04 21:23:47.844434 -0500][Debug ][AsyncSock ] [primeradiant03.crc.nd.edu:1096 #0.0] Async connection call returned >> cmd: [2021-03-04 21:23:47.844543 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-03-04 21:23:47.844935 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Got the server hand shake response (type: server [], protocol version 400) >> cmd: [2021-03-04 21:23:47.845113 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] kXR_protocol successful (type: server [], protocol version 400) >> cmd: [2021-03-04 21:23:47.847943 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=d6cneh007.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-03-04 21:23:47.848428 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Logged in, session: a1eb0200781700006c010000a9ef0200 >> cmd: [2021-03-04 21:23:47.848485 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Authentication is required: &P=gsi,v:10400,c:ssl,ca:ba240aa8.0|f5f0dfc2.0 >> cmd: [2021-03-04 21:23:47.848535 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Sending authentication data >> cmd: [2021-03-04 21:23:47.855280 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Trying to authenticate using gsi >> cmd: [2021-03-04 21:23:47.946622 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Sending more authentication data for gsi >> cmd: [2021-03-04 21:23:47.954870 -0500][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Authenticated with gsi. >> cmd: [2021-03-04 21:23:47.955022 -0500][Debug ][PostMaster ] [primeradiant03.crc.nd.edu:1096 #0] Stream 0 connected. >> cmd: Path: /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12972.root >> cmd: Id: 0 >> cmd: Size: 46781363 >> cmd: MTime: 2021-03-05 02:15:13 >> cmd: Flags: 24 (Offline|IsReadable) >> cmd: [2021-03-04 21:23:47.958176 -0500][Debug ][JobMgr ] Stopping the job manager... >> cmd: [2021-03-04 21:23:47.959036 -0500][Debug ][JobMgr ] Job manager stopped >> cmd: [2021-03-04 21:23:47.959112 -0500][Debug ][TaskMgr ] Stopping the task manager... >> cmd: [2021-03-04 21:23:47.959342 -0500][Debug ][TaskMgr ] Task manager stopped >> cmd: [2021-03-04 21:23:47.959421 -0500][Debug ][Poller ] Stopping the poller... >> cmd: [2021-03-04 21:23:47.959735 -0500][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" >> cmd: [2021-03-04 21:23:47.959815 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-03-04 21:23:47.959876 -0500][Debug ][Poller ] <[::ffff:10.32.73.238]:52322><--><[::ffff:129.74.85.55]:1094> Removing socket from the poller >> cmd: [2021-03-04 21:23:47.959970 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Destroying stream >> cmd: [2021-03-04 21:23:47.960025 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-03-04 21:23:47.960079 -0500][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: primeradiant03.crc.nd.edu:1096" >> cmd: [2021-03-04 21:23:47.960146 -0500][Debug ][AsyncSock ] [primeradiant03.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2021-03-04 21:23:47.960204 -0500][Debug ][Poller ] <[::ffff:10.32.73.238]:50120><--><[::ffff:149.165.243.11]:1096> Removing socket from the poller >> cmd: [2021-03-04 21:23:47.960287 -0500][Debug ][PostMaster ] [primeradiant03.crc.nd.edu:1096 #0] Destroying stream >> cmd: [2021-03-04 21:23:47.960348 -0500][Debug ][AsyncSock ] [primeradiant03.crc.nd.edu:1096 #0.0] Closing the socket >>> will stream using xrootd instead of copying @ Thu Mar 4 21:23:47 2021 >>> Trying hdfs client access method @ Thu Mar 4 21:23:47 2021 >>> executing 'timeout 300 hdfs dfs -fs hdfs://eddie.crc.nd.edu:19000 -get /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_13071.root MAOD-00000_13071.root' @ Thu Mar 4 21:23:47 2021 >> using /disk/vc3-root/tmp/worker-230547-13670/t.13553/cctools-temp-t.13553.79WTvE/tmpCptrpU to store command output >> cmd: timeout: failed to run command 'hdfs': No such file or directory >>>>> Unable to copy input with hdfs client @ Thu Mar 4 21:23:48 2021 >>> Trying xrootd access method @ Thu Mar 4 21:23:48 2021 >>> executing 'env XRD_LOGLEVEL=Debug timeout 300 xrdfs deepthought.crc.nd.edu stat /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_13071.root' @ Thu Mar 4 21:23:48 2021 >> using /disk/vc3-root/tmp/worker-230547-13670/t.13553/cctools-temp-t.13553.79WTvE/tmpWF1NDt to store command output >> cmd: [2021-03-04 21:23:48.230969 -0500][Warning][Utility ] Unable to process global config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-04 21:23:48.232373 -0500][Debug ][Utility ] Unable to process user config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-04 21:23:48.232568 -0500][Debug ][PlugInMgr ] Initializing plug-in manager... >> cmd: [2021-03-04 21:23:48.232629 -0500][Debug ][PlugInMgr ] No default plug-in, loading plug-in configs... >> cmd: [2021-03-04 21:23:48.232685 -0500][Debug ][PlugInMgr ] Processing plug-in definitions in /etc/xrootd/client.plugins.d... >> cmd: [2021-03-04 21:23:48.232798 -0500][Debug ][PlugInMgr ] Unable to process directory /etc/xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-04 21:23:48.233217 -0500][Debug ][PlugInMgr ] Processing plug-in definitions in /tmp/runos_singularity_home-102599951013971108985653159496743475414/.xrootd/client.plugins.d... >> cmd: [2021-03-04 21:23:48.233341 -0500][Debug ][PlugInMgr ] Unable to process directory /tmp/runos_singularity_home-102599951013971108985653159496743475414/.xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-04 21:23:48.233550 -0500][Debug ][App ] Executing: stat /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_13071.root >> cmd: [2021-03-04 21:23:48.233668 -0500][Debug ][Poller ] Available pollers: built-in >> cmd: [2021-03-04 21:23:48.233724 -0500][Debug ][Poller ] Attempting to create a poller according to preference: built-in >> cmd: [2021-03-04 21:23:48.233778 -0500][Debug ][Poller ] Creating poller: built-in >> cmd: [2021-03-04 21:23:48.233837 -0500][Debug ][Poller ] Creating and starting the built-in poller... >> cmd: [2021-03-04 21:23:48.234299 -0500][Debug ][Poller ] Using 1 poller threads >> cmd: [2021-03-04 21:23:48.234380 -0500][Debug ][TaskMgr ] Starting the task manager... >> cmd: [2021-03-04 21:23:48.234558 -0500][Debug ][TaskMgr ] Task manager started >> cmd: [2021-03-04 21:23:48.234615 -0500][Debug ][JobMgr ] Starting the job manager... >> cmd: [2021-03-04 21:23:48.235052 -0500][Debug ][JobMgr ] Job manager started, 3 workers >> cmd: [2021-03-04 21:23:48.235119 -0500][Debug ][TaskMgr ] Registering task: "FileTimer task" to be run at: [2021-03-04 21:23:48 -0500] >> cmd: [2021-03-04 21:23:48.235208 -0500][Debug ][PostMaster ] Creating new channel to: deepthought.crc.nd.edu:1094 1 stream(s) >> cmd: [2021-03-04 21:23:48.235286 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-03-04 21:23:48.236500 -0500][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" to be run at: [2021-03-04 21:24:03 -0500] >> cmd: [2021-03-04 21:23:48.237950 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-03-04 21:23:48.238145 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-03-04 21:23:48.238266 -0500][Debug ][Poller ] Adding socket 0x6a4a60 to the poller >> cmd: [2021-03-04 21:23:48.238646 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2021-03-04 21:23:48.238797 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-03-04 21:23:48.239277 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Got the server hand shake response (type: manager [], protocol version 400) >> cmd: [2021-03-04 21:23:48.239488 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] kXR_protocol successful (type: manager [], protocol version 400) >> cmd: [2021-03-04 21:23:48.242974 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=d6cneh007.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-03-04 21:23:48.243493 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Logged in, session: 443d1000a60d0000260100003d451000 >> cmd: [2021-03-04 21:23:48.243590 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream 0 connected. >> cmd: [2021-03-04 21:23:48.243646 -0500][Debug ][Utility ] Monitor library name not set. No monitoring >> cmd: [2021-03-04 21:23:48.244520 -0500][Debug ][PostMaster ] Creating new channel to: primeradiant05.crc.nd.edu:1096 1 stream(s) >> cmd: [2021-03-04 21:23:48.244593 -0500][Debug ][PostMaster ] [primeradiant05.crc.nd.edu:1096 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-03-04 21:23:48.246101 -0500][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: primeradiant05.crc.nd.edu:1096" to be run at: [2021-03-04 21:24:03 -0500] >> cmd: [2021-03-04 21:23:48.247313 -0500][Debug ][PostMaster ] [primeradiant05.crc.nd.edu:1096] Found 1 address(es): [::ffff:149.165.243.13]:1096 >> cmd: [2021-03-04 21:23:48.247512 -0500][Debug ][AsyncSock ] [primeradiant05.crc.nd.edu:1096 #0.0] Attempting connection to [::ffff:149.165.243.13]:1096 >> cmd: [2021-03-04 21:23:48.247617 -0500][Debug ][Poller ] Adding socket 0xc0016a0 to the poller >> cmd: [2021-03-04 21:23:48.248144 -0500][Debug ][AsyncSock ] [primeradiant05.crc.nd.edu:1096 #0.0] Async connection call returned >> cmd: [2021-03-04 21:23:48.248268 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-03-04 21:23:48.249202 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Got the server hand shake response (type: server [], protocol version 400) >> cmd: [2021-03-04 21:23:48.249435 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] kXR_protocol successful (type: server [], protocol version 400) >> cmd: [2021-03-04 21:23:48.252139 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=d6cneh007.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-03-04 21:23:48.252725 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Logged in, session: 72e102008c1600005d01000063e50200 >> cmd: [2021-03-04 21:23:48.252790 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Authentication is required: &P=gsi,v:10400,c:ssl,ca:ba240aa8.0|f5f0dfc2.0 >> cmd: [2021-03-04 21:23:48.252845 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Sending authentication data >> cmd: [2021-03-04 21:23:48.260735 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Trying to authenticate using gsi >> cmd: [2021-03-04 21:23:48.332851 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Sending more authentication data for gsi >> cmd: [2021-03-04 21:23:48.340789 -0500][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Authenticated with gsi. >> cmd: [2021-03-04 21:23:48.340907 -0500][Debug ][PostMaster ] [primeradiant05.crc.nd.edu:1096 #0] Stream 0 connected. >> cmd: Path: /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_13071.root >> cmd: Id: 0 >> cmd: Size: 46765888 >> cmd: MTime: 2021-03-05 02:18:43 >> cmd: Flags: 24 (Offline|IsReadable) >> cmd: [2021-03-04 21:23:48.351492 -0500][Debug ][JobMgr ] Stopping the job manager... >> cmd: [2021-03-04 21:23:48.352204 -0500][Debug ][JobMgr ] Job manager stopped >> cmd: [2021-03-04 21:23:48.352270 -0500][Debug ][TaskMgr ] Stopping the task manager... >> cmd: [2021-03-04 21:23:48.352473 -0500][Debug ][TaskMgr ] Task manager stopped >> cmd: [2021-03-04 21:23:48.352550 -0500][Debug ][Poller ] Stopping the poller... >> cmd: [2021-03-04 21:23:48.352960 -0500][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" >> cmd: [2021-03-04 21:23:48.353026 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-03-04 21:23:48.353086 -0500][Debug ][Poller ] <[::ffff:10.32.73.238]:52326><--><[::ffff:129.74.85.55]:1094> Removing socket from the poller >> cmd: [2021-03-04 21:23:48.353189 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Destroying stream >> cmd: [2021-03-04 21:23:48.353251 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-03-04 21:23:48.353312 -0500][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: primeradiant05.crc.nd.edu:1096" >> cmd: [2021-03-04 21:23:48.353391 -0500][Debug ][AsyncSock ] [primeradiant05.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2021-03-04 21:23:48.353450 -0500][Debug ][Poller ] <[::ffff:10.32.73.238]:60112><--><[::ffff:149.165.243.13]:1096> Removing socket from the poller >> cmd: [2021-03-04 21:23:48.353551 -0500][Debug ][PostMaster ] [primeradiant05.crc.nd.edu:1096 #0] Destroying stream >> cmd: [2021-03-04 21:23:48.353610 -0500][Debug ][AsyncSock ] [primeradiant05.crc.nd.edu:1096 #0.0] Closing the socket >>> will stream using xrootd instead of copying @ Thu Mar 4 21:23:48 2021 >>> Bypassing further access checks and using 'root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/' for input @ Thu Mar 4 21:23:48 2021 >>> Trying xrootd access method @ Thu Mar 4 21:23:48 2021 >>> will stream using xrootd instead of copying @ Thu Mar 4 21:23:48 2021 >>> Trying xrootd access method @ Thu Mar 4 21:23:48 2021 >>> will stream using xrootd instead of copying @ Thu Mar 4 21:23:48 2021 >>> modified input files @ Thu Mar 4 21:23:48 2021 >> input: root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_11834.root >> input: root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_13160.root >> input: root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12972.root >> input: root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_13071.root >> input: root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12703.root >> input: root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12459.root >>> updated parameters are @ Thu Mar 4 21:23:48 2021 >> json: { >> json: "accelerate stage-in": 3, >> json: "arguments": [ >> json: "outputFile=MAOD-00000.root" >> json: ], >> json: "default ce": "T3_US_NotreDame", >> json: "default host": "earth.crc.nd.edu", >> json: "default se": "T3_US_NotreDame", >> json: "disable streaming": false, >> json: "epilogue": [ >> json: "python", >> json: "merge_reports.py", >> json: "report.json", >> json: "0001_2459_report.json", >> json: "0001_2703_report.json", >> json: "0001_2972_report.json", >> json: "0001_1834_report.json", >> json: "0001_3071_report.json", >> json: "0001_3160_report.json" >> json: ], >> json: "executable": "cmsRun", >> json: "file map": { >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_11834.root": "mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_11834.root", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12459.root": "mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12459.root", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12703.root": "mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12703.root", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12972.root": "mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12972.root", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_13071.root": "mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_13071.root", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_13160.root": "mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_13160.root" >> json: }, >> json: "gridpack": false, >> json: "input": [ >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/" >> json: ], >> json: "mask": { >> json: "events": -1, >> json: "files": [ >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_11834.root", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_13160.root", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12972.root", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_13071.root", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12703.root", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12459.root" >> json: ], >> json: "lumis": null >> json: }, >> json: "monitoring": { >> json: "monitorid": null, >> json: "syncid": null, >> json: "taskid": "lobster_kmohrman_EFT_ALL_postLHE_crc_20210304_1732_bcad2768f22f6a1f" >> json: }, >> json: "output": [ >> json: "hdfs://eddie.crc.nd.edu:19000/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4", >> json: "file:///hadoop/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/" >> json: ], >> json: "output files": [ >> json: [ >> json: "MAOD-00000.root", >> json: "mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_13553.root" >> json: ] >> json: ], >> json: "prologue": null, >> json: "pset": "merge_cfg.py", >> json: "want summary": true >> json: } >>> using sync CE T3_US_NotreDame @ Thu Mar 4 21:23:48 2021 >>> config file fragment @ Thu Mar 4 21:23:50 2021 >> pset: >> pset: import FWCore.ParameterSet.Config as cms >> pset: process.Timing = cms.Service("Timing", >> pset: useJobReport = cms.untracked.bool(True), >> pset: summaryOnly = cms.untracked.bool(True)) >> pset: >> pset: process.maxEvents = cms.untracked.PSet(input = cms.untracked.int32(-1)) >> pset: >> pset: import os >> pset: _, major, minor, _ = os.environ["CMSSW_VERSION"].split('_', 3) >> pset: if int(major) >= 7 and int(minor) >= 4: >> pset: xrdstats = cms.Service("XrdAdaptor::XrdStatisticsService", cms.untracked.PSet(reportToFJR = cms.untracked.bool(True))) >> pset: process.add_(xrdstats) >> pset: >> pset: for prod in process.producers.values(): >> pset: if prod.hasParameter('nEvents') and prod.type_() == 'ExternalLHEProducer': >> pset: prod.nEvents = cms.untracked.uint32(-1) >> pset: >> pset: process.source.fileNames = cms.untracked.vstring(['root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_11834.root', 'root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_13160.root', 'root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12972.root', 'root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_13071.root', 'root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12703.root', 'root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12459.root']) >> pset: if hasattr(process, 'options'): >> pset: process.options.wantSummary = cms.untracked.bool(True) >> pset: else: >> pset: process.options = cms.untracked.PSet(wantSummary = cms.untracked.bool(True)) >>> executing 'cmsRun -j report.xml merge_cfg_mod.py outputFile=MAOD-00000.root' @ Thu Mar 4 21:23:50 2021 >> using /disk/vc3-root/tmp/worker-230547-13670/t.13553/cctools-temp-t.13553.79WTvE/tmpZVuQnC to store command output >> cmd: 04-Mar-2021 21:23:58 EST Initiating request to open file root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_11834.root >> cmd: 04-Mar-2021 21:24:09 EST Successfully opened file root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_11834.root >> cmd: Begin processing the 1st record. Run 1, Event 16, LumiSection 365 on stream 0 at 04-Mar-2021 21:24:32.540 EST >> cmd: 04-Mar-2021 21:24:42 EST Closed file root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_11834.root >> cmd: 04-Mar-2021 21:24:42 EST Initiating request to open file root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_13160.root >> cmd: 04-Mar-2021 21:24:44 EST Successfully opened file root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_13160.root >> cmd: 04-Mar-2021 21:25:03 EST Closed file root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_13160.root >> cmd: 04-Mar-2021 21:25:03 EST Initiating request to open file root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12972.root >> cmd: 04-Mar-2021 21:25:16 EST Successfully opened file root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12972.root >> cmd: Begin processing the 1001st record. Run 1, Event 142, LumiSection 350 on stream 0 at 04-Mar-2021 21:25:38.865 EST >> cmd: 04-Mar-2021 21:25:40 EST Closed file root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12972.root >> cmd: 04-Mar-2021 21:25:40 EST Initiating request to open file root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_13071.root >> cmd: 04-Mar-2021 21:25:42 EST Successfully opened file root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_13071.root >> cmd: 04-Mar-2021 21:26:07 EST Closed file root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_13071.root >> cmd: 04-Mar-2021 21:26:07 EST Initiating request to open file root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12703.root >> cmd: 04-Mar-2021 21:26:09 EST Successfully opened file root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12703.root >> cmd: [2021-03-04 21:26:10.484983 -0500][Error ][File ] [0xff69cb00@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12703.root] Fatal file state error. Message kXR_read (handle: 0x00000000, offset: 46138761, size: 372) returned with [ERROR] Server responded with an error: [3005] Unable to read /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12703.root; unknown error 255 >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 04-Mar-2021 21:26:10 EST pre-events >> cmd: XrdRequestManager::handle(name='root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12703.root) failure when reading from primeradiant02.crc.nd.edu:1096 (site T3_US_NotreDame); failed with error '[ERROR] Server responded with an error: [3005] Unable to read /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12703.root; unknown error 255 >> cmd: ' (errno=3005, code=400). >> cmd: %MSG >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 04-Mar-2021 21:26:10 EST pre-events >> cmd: Request failure when reading from primeradiant02.crc.nd.edu:1096 (site T3_US_NotreDame) >> cmd: %MSG >> cmd: %MSG-w XrdAdaptor: (NoModuleName) 04-Mar-2021 21:26:10 EST pre-events >> cmd: Data is now served from instead of previous T3_US_NotreDame >> cmd: %MSG >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 04-Mar-2021 21:26:10 EST pre-events >> cmd: Caught a CMSSW exception when running connection recovery. >> cmd: %MSG >> cmd: 04-Mar-2021 21:26:10 EST Closed file root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12703.root >> cmd: ----- Begin Fatal Exception 04-Mar-2021 21:26:10 EST----------------------- >> cmd: An exception of category 'FileOpenError' occurred while >> cmd: [0] Calling InputSource::readFile_ >> cmd: [1] XrdAdaptor::ClientRequest::HandleResponse() failure while running connection recovery >> cmd: [2] Handling XrdAdaptor::RequestManager::requestFailure() >> cmd: [3] In XrdAdaptor::RequestManager::OpenHandler::HandleResponseWithHosts() >> cmd: Exception Message: >> cmd: XrdCl::File::Open(name='root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12703.root', flags=0x10, permissions=0660) => error '[ERROR] Server responded with an error: [3011] No servers are available to read the file. >> cmd: ' (errno=3011, code=400) >> cmd: Additional Info: >> cmd: [a] Original error: '[ERROR] Server responded with an error: [3005] Unable to read /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v4/mAOD_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/MAOD-00000_12703.root; unknown error 255 >> cmd: ' (errno=3005, code=400, source=primeradiant02.crc.nd.edu:1096 (site T3_US_NotreDame)). >> cmd: [b] Original failed source is primeradiant02.crc.nd.edu:1096 (site T3_US_NotreDame) >> cmd: [c] Disabled source: primeradiant02.crc.nd.edu:1096 >> cmd: ----- End Fatal Exception ------------------------------------------------- >> cmd: %MSG-w XrdFileWarning: (NoModuleName) 04-Mar-2021 21:26:10 EST pre-events >> cmd: Source delayed close failed with error '[ERROR] Server responded with an error: [3005] Unable to close file ; unknown error 255 >> cmd: ' (errno=3005, code=400, server=primeradiant02.crc.nd.edu:1096, site=T3_US_NotreDame) >> cmd: %MSG >> cmd: >> cmd: TrigReport ---------- Event Summary ------------ >> cmd: TrigReport Events total = 1496 passed = 1496 failed = 0 >> cmd: >> cmd: TrigReport ---------- Path Summary ------------ >> cmd: TrigReport Trig Bit# Executed Passed Failed Error Name >> cmd: >> cmd: TrigReport -------End-Path Summary ------------ >> cmd: TrigReport Trig Bit# Executed Passed Failed Error Name >> cmd: TrigReport 0 0 1496 1496 0 0 end >> cmd: >> cmd: TrigReport ------ Modules in End-Path: end ------------ >> cmd: TrigReport Trig Bit# Visited Passed Failed Error Name >> cmd: TrigReport 0 0 1496 1496 0 0 out >> cmd: >> cmd: TrigReport ---------- Module Summary ------------ >> cmd: TrigReport Visited Executed Passed Failed Error Name >> cmd: TrigReport 1496 1496 1496 0 0 end >> cmd: TrigReport 1496 1496 1496 0 0 out >> cmd: >> cmd: TimeReport ---------- Event Summary ---[sec]---- >> cmd: TimeReport event loop CPU/event = 0.018032 >> cmd: TimeReport event loop Real/event = 0.081625 >> cmd: TimeReport sum Streams Real/event = 0.021729 >> cmd: TimeReport efficiency CPU/Real/thread = 0.220913 >> cmd: >> cmd: TimeReport ---------- Path Summary ---[Real sec]---- >> cmd: TimeReport per event per exec Name >> cmd: TimeReport per event per exec Name >> cmd: >> cmd: TimeReport -------End-Path Summary ---[Real sec]---- >> cmd: TimeReport per event per exec Name >> cmd: TimeReport 0.021556 0.021556 end >> cmd: TimeReport per event per exec Name >> cmd: >> cmd: TimeReport ------ Modules in End-Path: end ---[Real sec]---- >> cmd: TimeReport per event per visit Name >> cmd: TimeReport 0.000157 0.000157 out >> cmd: TimeReport per event per visit Name >> cmd: >> cmd: TimeReport ---------- Module Summary ---[Real sec]---- >> cmd: TimeReport per event per exec per visit Name >> cmd: TimeReport 0.000007 0.000007 0.000007 end >> cmd: TimeReport 0.000157 0.000157 0.000157 out >> cmd: TimeReport per event per exec per visit Name >> cmd: >> cmd: T---Report end! >> cmd: >> cmd: TimeReport> Time report complete in 142.552 seconds >> cmd: Time Summary: >> cmd: - Min event: 0.010061 >> cmd: - Max event: 2.08522 >> cmd: - Avg event: 0.0215629 >> cmd: - Total loop: 119.175 >> cmd: - Total init: 20.4281 >> cmd: - Total job: 142.552 >> cmd: - EventSetup Lock: 0 >> cmd: - EventSetup Get: 0 >> cmd: Event Throughput: 12.553 ev/s >> cmd: CPU Summary: >> cmd: - Total loop: 56.9039 >> cmd: - Total init: 9.03483 >> cmd: - Total extra: 0 >> cmd: - Total job: 69.4764 >> cmd: Processing Summary: >> cmd: - Number of Events: 1496 >> cmd: - Number of Global Begin Lumi Calls: 11 >> cmd: - Number of Global Begin Run Calls: 11 >> cmd: >> cmd: >> cmd: ============================================= >> cmd: >> cmd: MessageLogger Summary >> cmd: >> cmd: type category sev module subroutine count total >> cmd: ---- -------------------- -- ---------------- ---------------- ----- ----- >> cmd: 1 XrdAdaptor -w (NoModuleName) 1 1 >> cmd: 2 XrdAdaptorInternal -w (NoModuleName) 3 3 >> cmd: 3 XrdFileWarning -w (NoModuleName) 1 1 >> cmd: 4 TimeReport -e AfterModEndJob 1 1 >> cmd: 5 Fatal Exception -s AfterFile 1 1 >> cmd: 6 fileAction -s AfterFile 1 1 >> cmd: 7 fileAction -s file_close 4 4 >> cmd: 8 fileAction -s file_open 10 10 >> cmd: >> cmd: type category Examples: run/evt run/evt run/evt >> cmd: ---- -------------------- ---------------- ---------------- ---------------- >> cmd: 1 XrdAdaptor pre-events >> cmd: 2 XrdAdaptorInternal pre-events pre-events pre-events >> cmd: 3 XrdFileWarning pre-events >> cmd: 4 TimeReport PostGlobalEndRun >> cmd: 5 Fatal Exception PostProcessEvent >> cmd: 6 fileAction PostProcessEvent >> cmd: 7 fileAction PostProcessEvent PostProcessEvent PostProcessEvent >> cmd: 8 fileAction pre-events pre-events PostProcessEvent >> cmd: >> cmd: Severity # Occurrences Total Occurrences >> cmd: -------- ------------- ----------------- >> cmd: Warning 5 5 >> cmd: Error 1 1 >> cmd: System 16 16 >> cmd: >> cmd: dropped waiting message count 0 >>> executable returned with exit code 84. @ Thu Mar 4 21:26:13 2021 >> trace: Traceback (most recent call last): >> trace: File "task.py", line 268, in wrapper >> trace: result = fct(data, *args, **kwargs) >> trace: File "task.py", line 1052, in run_command >> trace: raise subprocess.CalledProcessError(p.returncode, cmd) >> trace: CalledProcessError: Command '[u'cmsRun', '-j', 'report.xml', u'merge_cfg_mod.py', 'outputFile=MAOD-00000.root']' returned non-zero exit status 84 >>>>> call to 'run_command' failed, exiting with exit code 185 @ Thu Mar 4 21:26:14 2021 Thu Mar 4 21:23:48 2021: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Thu Mar 4 21:23:48 2021: ApMon[WARNING]: Not sending parameters since no destination is defined. Thu Mar 4 21:23:48 2021: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. Thu Mar 4 21:26:13 2021: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Thu Mar 4 21:26:14 2021: ApMon[WARNING]: Not sending parameters since no destination is defined. Thu Mar 4 21:26:14 2021: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. >> Execution time -1614911006 >> Exiting with code 185 >> Reporting ExeExitCode 8020 >> Reporting StageOutSE >> Reporting StageOutExitCode 0 Thu Mar 4 21:26:14 2021: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Thu Mar 4 21:26:15 2021: ApMon[WARNING]: Not sending parameters since no destination is defined. Thu Mar 4 21:26:15 2021: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. ==== working directory after execution @ Thu Mar 4 21:26:15 EST 2021 ==== == dir: total 164284 == dir: -rwxr-xr-x 2 kmohrman campus 1580 Mar 4 21:22 0001_1834_report.json == dir: -rwxr-xr-x 2 kmohrman campus 1578 Mar 4 21:22 0001_2459_report.json == dir: -rwxr-xr-x 2 kmohrman campus 1582 Mar 4 21:22 0001_2703_report.json == dir: -rwxr-xr-x 2 kmohrman campus 1582 Mar 4 21:22 0001_2972_report.json == dir: -rwxr-xr-x 2 kmohrman campus 1582 Mar 4 21:22 0001_3071_report.json == dir: -rwxr-xr-x 2 kmohrman campus 1364 Mar 4 21:22 0001_3160_report.json == dir: drwxr-xr-x 18 kmohrman campus 215 Mar 4 21:23 CMSSW_10_6_20 == dir: -rw-r--r-- 1 kmohrman campus 167220590 Mar 4 21:26 MAOD-00000.root == dir: drwxr-xr-x 2 kmohrman campus 71 Mar 4 21:22 bin == dir: -rwxr-xr-x 4 kmohrman campus 627272 Mar 4 20:15 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 Mar 4 21:22 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 Mar 4 21:26 cctools-temp-t.13553.79WTvE == dir: -rw------- 1 kmohrman campus 51 Mar 4 21:23 cvmfschecksum.cms-ib.cern.ch == dir: -rw------- 1 kmohrman campus 51 Mar 4 21:23 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 Mar 4 21:23 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 Mar 4 21:22 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 Mar 4 21:22 librmonitor_helper.so.lpBOl8 == dir: -rw-r--r-- 2 kmohrman campus 868 Mar 4 21:22 merge_cfg.py == dir: -rw-r--r-- 1 kmohrman campus 3118 Mar 4 21:23 merge_cfg_mod.py == dir: -rw-r--r-- 2 kmohrman campus 808 Mar 4 21:22 merge_reports.py == dir: -rw-r--r-- 2 kmohrman campus 3006 Mar 4 21:22 parameters.json == dir: -rw------- 2 kmohrman campus 9921 Mar 4 21:22 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 Mar 4 21:22 python == dir: -rw-r--r-- 1 kmohrman campus 2280 Mar 4 21:26 report.json == dir: -rw-r--r-- 4 kmohrman campus 570 Mar 4 20:15 report.json.in == dir: -rw-r--r-- 1 kmohrman campus 69789 Mar 4 21:26 report.xml == dir: -rw-r--r-- 1 kmohrman campus 5585 Mar 4 21:26 report.xml.gz == dir: -rw-r--r-- 2 kmohrman campus 549 Mar 4 21:11 sandbox-CMSSW_10_6_20-slc7_amd64_gcc700.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 37 Mar 4 21:22 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 Mar 4 21:23 t_wrapper_ready == dir: -rw-r--r-- 1 kmohrman campus 11 Mar 4 21:23 t_wrapper_start == dir: -rwxr-xr-x 4 kmohrman campus 47217 Mar 4 20:15 task.py == dir: -rwxr-xr-x 4 kmohrman campus 5986 Mar 4 20:15 wrapper.sh === wrapper done @ Thu Mar 4 21:26:15 EST 2021 === final return status = 185 @ Thu Mar 4 21:26:15 EST 2021