==== wrapper started @ Mon Mar 8 13:20:30 EST 2021 ==== == startup: hostname: proteus1.crc.nd.edu == startup: kernel: Linux proteus1.crc.nd.edu 3.10.0-1160.el7.x86_64 #1 SMP Tue Aug 18 14:50:17 EDT 2020 x86_64 x86_64 x86_64 GNU/Linux ==== tracing google @ Mon Mar 8 13:20:35 EST 2021 ==== wrapper.sh: line 20: traceroute: command not found ==== environment at startup @ Mon Mar 8 13:20:40 EST 2021 ==== == env: VC3_VERSION_SED=4.2 == env: CCTOOLS_RESOURCE_PROCESS_START=1615227640083049 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: VC3_ROOT_GZIP=/usr/ == env: SHELL=/bin/sh == env: TERM=xterm-256color == env: MAKEFLAGS=-j4 == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-19097/t.4427/cctools-temp-t.4427.K1sOGv == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-19097/t.4427/librmonitor_helper.so.EZKi5G == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: USER=kmohrman == env: TEMP=/disk/vc3-root/tmp/worker-230547-19097/t.4427/cctools-temp-t.4427.K1sOGv == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: LD_LIBRARY_PATH=/.singularity.d/libs == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_ROOT_MAKE=/usr/ == env: VC3_DISTFILES=/disk/vc3-distfiles == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-19097/cache/tmp == env: VC3_VERSION_TAR=1.26 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-fdH5vq == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: VC3_VERSION_GZIP=1.5 == env: VC3_ENV_TAG_GLOBAL=18846 == env: PATH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-fdH5vq == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PWD=/disk/vc3-root/tmp/worker-230547-19097/t.4427 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_FULL_SED=4.2.2 == env: VC3_VERSION_WHICH=2.20 == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-19097 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_ROOT_SED=/usr/ == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: CXX=g++ == env: SHLVL=3 == env: HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_MAKE=3.82 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: DISK=6000 == env: MEMORY=7800 == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: TMP=/disk/vc3-root/tmp/worker-230547-19097/t.4427/cctools-temp-t.4427.K1sOGv == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_VERSION_PKG_CONFIG=0.27 == env: VC3_ROOT_TAR=/usr/ == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-fdH5vq.wrapper == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: CC=gcc == env: CORES=6 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CCTOOLS_RESOURCE_MONITOR_INFO=1024 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_ALL_postLHE_crc.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=15722 == env: _=/usr/bin/env ==== cpu info @ Mon Mar 8 13:20:45 EST 2021 ==== == cpu: processor : 0 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1600.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 0 == cpu: cpu cores : 6 == cpu: apicid : 0 == cpu: initial apicid : 0 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.67 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 1 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1733.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 1 == cpu: cpu cores : 6 == cpu: apicid : 2 == cpu: initial apicid : 2 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.67 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 2 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1600.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 2 == cpu: cpu cores : 6 == cpu: apicid : 4 == cpu: initial apicid : 4 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.67 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 3 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1600.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 8 == cpu: cpu cores : 6 == cpu: apicid : 16 == cpu: initial apicid : 16 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.67 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 4 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1600.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 9 == cpu: cpu cores : 6 == cpu: apicid : 18 == cpu: initial apicid : 18 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.67 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 5 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1600.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 10 == cpu: cpu cores : 6 == cpu: apicid : 20 == cpu: initial apicid : 20 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.67 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 6 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1600.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 0 == cpu: cpu cores : 6 == cpu: apicid : 32 == cpu: initial apicid : 32 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.19 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 7 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2000.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 1 == cpu: cpu cores : 6 == cpu: apicid : 34 == cpu: initial apicid : 34 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.19 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 8 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1600.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 2 == cpu: cpu cores : 6 == cpu: apicid : 36 == cpu: initial apicid : 36 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.19 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 9 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1600.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 8 == cpu: cpu cores : 6 == cpu: apicid : 48 == cpu: initial apicid : 48 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.19 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 10 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1733.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 9 == cpu: cpu cores : 6 == cpu: apicid : 50 == cpu: initial apicid : 50 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.19 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 11 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2668.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 10 == cpu: cpu cores : 6 == cpu: apicid : 52 == cpu: initial apicid : 52 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.19 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: === using CVMFS proxy: http://eddie.crc.nd.edu:3128 @ Mon Mar 8 13:21:10 EST 2021 === using Frontier proxy: http://eddie.crc.nd.edu:3128 @ Mon Mar 8 13:21:10 EST 2021 === parrot helper: /disk/vc3-root/tmp/worker-230547-19097/t.4427/lib/libparrot_helper.so @ Mon Mar 8 13:21:15 EST 2021 ==== content of /disk/vc3-root/tmp/worker-230547-19097/cache/tmp @ Mon Mar 8 13:21:15 EST 2021 ==== == cache: total 0 === OSG certificate location: /cvmfs/oasis.opensciencegrid.org/mis/certificates @ Mon Mar 8 13:21:20 EST 2021 === testing parrot usage @ Mon Mar 8 13:21:20 EST 2021 === parrot OK @ Mon Mar 8 13:21:25 EST 2021 === starting parrot to access CMSSW... @ Mon Mar 8 13:21:25 EST 2021 ==== wrapper started @ Mon Mar 8 13:21:25 EST 2021 ==== == startup: hostname: proteus1.crc.nd.edu == startup: kernel: Linux proteus1.crc.nd.edu 3.10.0-1160.el7.x86_64 #1 SMP Tue Aug 18 14:50:17 EDT 2020 x86_64 x86_64 x86_64 GNU/Linux ==== tracing google @ Mon Mar 8 13:21:25 EST 2021 ==== wrapper.sh: line 20: traceroute: command not found ==== environment at startup @ Mon Mar 8 13:21:25 EST 2021 ==== == env: VC3_VERSION_SED=4.2 == env: CCTOOLS_RESOURCE_PROCESS_START=1615227685636527 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/usr/ == env: LOBSTER_GFAL_COPY= == env: MAKEFLAGS=-j4 == env: PARROT_HELPER=/disk/vc3-root/tmp/worker-230547-19097/t.4427/lib/libparrot_helper.so == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-19097/t.4427/cctools-temp-t.4427.K1sOGv == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-19097/t.4427/librmonitor_helper.so.EZKi5G == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: LD_LIBRARY_PATH=/.singularity.d/libs:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-19097/t.4427/cctools-temp-t.4427.K1sOGv == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/usr/ == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-fdH5vq == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-19097/cache/tmp == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: PARROT_CVMFS_REPO= == env: VC3_VERSION_GZIP=1.5 == env: PATH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ENV_TAG_GLOBAL=18846 == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-fdH5vq == env: PWD=/disk/vc3-root/tmp/worker-230547-19097/t.4427 == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_WHICH=2.20 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: LOBSTER_LCG_CP= == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-19097 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/usr/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: CXX=g++ == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: DISK=6000 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-19097/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-19097/cache/tmp/cvmfs == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=7800 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TMP=/disk/vc3-root/tmp/worker-230547-19097/t.4427/cctools-temp-t.4427.K1sOGv == env: PYTHONPATH=python: == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_ROOT_TAR=/usr/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-fdH5vq.wrapper == env: CC=gcc == env: CCTOOLS_RESOURCE_MONITOR_INFO=1024 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=6 == env: PARROT_DEBUG_FLAGS= == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_ALL_postLHE_crc.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=15722 == env: _=/usr/bin/env ==== cpu info @ Mon Mar 8 13:21:25 EST 2021 ==== == cpu: processor : 0 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1733.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 0 == cpu: cpu cores : 6 == cpu: apicid : 0 == cpu: initial apicid : 0 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.67 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 1 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1733.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 1 == cpu: cpu cores : 6 == cpu: apicid : 2 == cpu: initial apicid : 2 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.67 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 2 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1733.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 2 == cpu: cpu cores : 6 == cpu: apicid : 4 == cpu: initial apicid : 4 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.67 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 3 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2000.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 8 == cpu: cpu cores : 6 == cpu: apicid : 16 == cpu: initial apicid : 16 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.67 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 4 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2133.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 9 == cpu: cpu cores : 6 == cpu: apicid : 18 == cpu: initial apicid : 18 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.67 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 5 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1867.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 10 == cpu: cpu cores : 6 == cpu: apicid : 20 == cpu: initial apicid : 20 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.67 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 6 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2400.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 0 == cpu: cpu cores : 6 == cpu: apicid : 32 == cpu: initial apicid : 32 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.19 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 7 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1867.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 1 == cpu: cpu cores : 6 == cpu: apicid : 34 == cpu: initial apicid : 34 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.19 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 8 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1733.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 2 == cpu: cpu cores : 6 == cpu: apicid : 36 == cpu: initial apicid : 36 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.19 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 9 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1600.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 8 == cpu: cpu cores : 6 == cpu: apicid : 48 == cpu: initial apicid : 48 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.19 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 10 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1733.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 9 == cpu: cpu cores : 6 == cpu: apicid : 50 == cpu: initial apicid : 50 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.19 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 11 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU X5650 @ 2.67GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1600.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 10 == cpu: cpu cores : 6 == cpu: apicid : 52 == cpu: initial apicid : 52 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5333.19 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: === using parrot @ Mon Mar 8 13:21:26 EST 2021 === sourcing CMS setup @ Mon Mar 8 13:21:26 EST 2021 LibCvmfs version 2.4, revision 25 === sourcing OSG setup @ Mon Mar 8 13:21:29 EST 2021 ==== environment after sourcing startup scripts @ Mon Mar 8 13:21:29 EST 2021 ==== == env: VC3_VERSION_SED=4.2 == env: MANPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/man:/cvmfs/cms.cern.ch/share/man: == env: CCTOOLS_RESOURCE_PROCESS_START=1615227689522836 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: GFAL_PLUGIN_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/gfal2-plugins/ == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/usr/ == env: LOBSTER_GFAL_COPY=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin/gfal-copy == env: VOMS_USERCONF=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/vomses == env: MAKEFLAGS=-j4 == env: GLOBUS_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-19097/t.4427/cctools-temp-t.4427.K1sOGv == env: PERL5LIB=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5 == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: CVSROOT=:gserver:cmssw.cvs.cern.ch:/local/reps/CMSSW == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-19097/t.4427/librmonitor_helper.so.EZKi5G == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: X509_CERT_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/certificates == env: SCRAM_ARCH=slc7_amd64_gcc820 == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: LD_LIBRARY_PATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/dcap:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/lcgdm:/.singularity.d/libs:lib:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-19097/t.4427/cctools-temp-t.4427.K1sOGv == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/usr/ == env: OSG_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-fdH5vq == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-19097/cache/tmp == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: SITECONFIG_PATH=/cvmfs/cms.cern.ch/SITECONF/local == env: PARROT_CVMFS_REPO= == env: VC3_VERSION_GZIP=1.5 == env: PATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/sbin:/cvmfs/cms.cern.ch/common:/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ENV_TAG_GLOBAL=18846 == env: CMS_PATH=/cvmfs/cms.cern.ch == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-fdH5vq == env: PWD=/disk/vc3-root/tmp/worker-230547-19097/t.4427 == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_WHICH=2.20 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: X509_VOMS_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/vomsdir == env: LOBSTER_LCG_CP= == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-19097 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/usr/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: CXX=g++ == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: DISK=6000 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-19097/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-19097/cache/tmp/cvmfs == env: GFAL_CONFIG_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/gfal2.d/ == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=7800 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TMP=/disk/vc3-root/tmp/worker-230547-19097/t.4427/cctools-temp-t.4427.K1sOGv == env: PYTHONPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib/python2.7/site-packages:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/python2.7/site-packages:python:python: == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_ROOT_TAR=/usr/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-fdH5vq.wrapper == env: CC=gcc == env: CCTOOLS_RESOURCE_MONITOR_INFO=1024 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=6 == env: PARROT_DEBUG_FLAGS= == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_ALL_postLHE_crc.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=15722 == env: _=/usr/bin/env ==== proxy information @ Mon Mar 8 13:21:29 EST 2021 ==== == proxy: subject : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman/CN=1808231461 == proxy: issuer : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman == proxy: identity : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman == proxy: type : RFC compliant proxy == proxy: strength : 1024 bits == proxy: path : proxy == proxy: timeleft : 68:24:34 ==== working directory at startup @ Mon Mar 8 13:21:30 EST 2021 ==== == dir: total 4692 == dir: -rw-r--r-- 3 kmohrman campus 3932158 Mar 8 13:20 UL17_DIGI_cfg.py == dir: drwxr-xr-x 2 kmohrman campus 71 Mar 8 13:20 bin == dir: -rwxr-xr-x 3 kmohrman campus 627272 Mar 8 13:20 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 Mar 8 13:20 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 Mar 8 13:20 cctools-temp-t.4427.K1sOGv == dir: -rw------- 1 kmohrman campus 51 Mar 8 13:21 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 Mar 8 13:21 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 Mar 8 13:20 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 Mar 8 13:20 librmonitor_helper.so.EZKi5G == dir: -rw-r--r-- 2 kmohrman campus 2325 Mar 8 13:20 parameters.json == dir: -rw------- 2 kmohrman campus 9921 Mar 8 13:20 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 Mar 8 13:20 python == dir: -rw-r--r-- 3 kmohrman campus 570 Mar 8 13:20 report.json.in == dir: -rw-r--r-- 3 kmohrman campus 593 Mar 8 13:20 sandbox-CMSSW_10_6_17_patch1-slc7_amd64_gcc700.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 37 Mar 8 13:20 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 Mar 8 13:21 t_wrapper_start == dir: -rwxr-xr-x 3 kmohrman campus 47217 Mar 8 13:20 task.py == dir: -rwxr-xr-x 3 kmohrman campus 5986 Mar 8 13:20 wrapper.sh === creating new release CMSSW_10_6_17_patch1 for scram arch slc7_amd64_gcc700 @ Mon Mar 8 13:21:30 EST 2021 WARNING: In non-interactive mode release checks e.g. deprecated releases, production architectures are disabled. === unpacking sandbox-CMSSW_10_6_17_patch1-slc7_amd64_gcc700.tar.bz2 @ Mon Mar 8 13:21:37 EST 2021 ==== machine load @ Mon Mar 8 13:21:41 EST 2021 ==== top: unknown option 'M' Usage: top -hv | -bcHiOSs -d secs -n max -u|U user -p pid(s) -o field -w [cols] ==== environment before execution @ Mon Mar 8 13:21:41 EST 2021 ==== == env: G4LEVELGAMMADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4PhotonEvaporation/5.2/data/PhotonEvaporation5.2 == env: UTM_XSD_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj == env: SRT_G4LEVELGAMMADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4PhotonEvaporation/5.2/data/PhotonEvaporation5.2 == env: VC3_VERSION_SED=4.2 == env: CMSSW_RELEASE_BASE=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1 == env: SCRAMRT_SET=CMSSW:CMSSW_10_6_17_patch1:slc7_amd64_gcc700:V2_2_9_pre12:SRT_ == env: MANPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/man:/cvmfs/cms.cern.ch/share/man: == env: CCTOOLS_RESOURCE_PROCESS_START=1615227701355454 == env: CMSSW_FWLITE_INCLUDE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include == env: SRT_GCC_RUNTIME_ASAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: ROOT_INCLUDE_PATH=/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/include/slc7_amd64_gcc700/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/include/LCG:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mctester/1.25.0a-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dd4hep/v01-10x-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtDesigner:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauolapp/1.1.5-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/charybdis/1.003-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include/SHERPA-MC:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtOpenGL:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtGui:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwig/6.521-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt3Support:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lwtnn/2.4-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4/10.4.3-pafccj2/include/Geant4:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/classlib/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cgal/4.2-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tkonlinesw/4.2.0-1_gcc7-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/starlight/r193-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtCore:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtXml:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mcdb/1.0.3-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libungif/4.1.4-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libtiff/4.0.3-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/highfive/2.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libpng/1.6.16-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pcre/8.37-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/include/xrootd/private:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/vdt/0.4.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/toprex/4.23-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tbb/2019_U3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauola/27.121.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sigcpp/2.6.2-pafccj/include/sigc++-2.0:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sqlite/3.22.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/protobuf/3.5.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pacparser/1.3.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/oracle/12.1.0.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/py2-numpy/1.16.2-nmpfii2/c-api/core/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/meschach/1.2.pCMS1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libuuid/2.22.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libunwind/1.2.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libhepml/0.2.1-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ktjet/1.06-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jimmy/4.2-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jemalloc/5.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hls/2019.08/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj10:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hector/1.3.4_patch1-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libjpeg-turbo/2.0.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/giflib/4.2.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gsl/2.2.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gdbm/1.10-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/freetype/2.5.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftw3/3.3.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftjet/1.5.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/expat/2.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dpm/1.8.0.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vecgeom/v00.05.00-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xerces-c/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xz/5.2.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dcap/2.47.8-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libxml2/2.9.1-pafccj/include/libxml2:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/curl/7.59.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cppunit/1.40.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openssl/1.0.2d-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia6/426-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/photos/215.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/zlib-x86_64/1.2.11-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/bz2lib/1.0.6-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/include/python2.7:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tinyxml2/6.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ittnotify/16.06.18-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj/include:/usr/local/include:/usr/include == env: INTEL_LICENSE_FILE=28518@lxlicen01.cern.ch,28518@lxlicen02.cern.ch,28518@lxlicen03.cern.ch == env: SRT_TEXMFHOME_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/share/Rivet/texmf == env: SRT_GEANT4_PARFULLCMS_CONFIG_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-parfullcms/2014.01.27-pafccj2/share/ParFullCMS == env: GFAL_PLUGIN_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/gfal2-plugins/ == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/usr/ == env: LOBSTER_GFAL_COPY=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin/gfal-copy == env: PDFPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/share == env: CMSSW_FULL_RELEASE_BASE=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17 == env: SRT_TNS_ADMIN_SCRAMRTDEL=/etc == env: VOMS_USERCONF=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/vomses == env: MAKEFLAGS=-j4 == env: ROOT_GCC_TOOLCHAIN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: GLOBUS_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-19097/t.4427/cctools-temp-t.4427.K1sOGv == env: G4FORCENUMBEROFTHREADS=max == env: OPENBLAS_NUM_THREADS=1 == env: SRT_PDFPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/share == env: PERL5LIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5 == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: CMSSW_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms == env: LHAPDF_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/share/LHAPDF == env: CVSROOT=:gserver:cmssw.cvs.cern.ch:/local/reps/CMSSW == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-19097/t.4427/librmonitor_helper.so.EZKi5G == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: CMSSW_GIT_HASH=CMSSW_10_6_17_patch1 == env: SRT_G4ABLADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ABLA/3.0/data/G4ABLA3.0 == env: QTDIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2 == env: SRT_SCONS_LIB_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/scons/3.0.1-pafccj/lib == env: OLDPWD=/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1 == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: G4NEUTRONXSDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NEUTRONXS/1.4/data/G4NEUTRONXS1.4 == env: QTINC=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include == env: X509_CERT_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/certificates == env: SCRAM_ARCH=slc7_amd64_gcc700 == env: GIT_SSL_CAINFO=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/ssl/certs/ca-bundle.crt == env: SRT_CMS_OPENLOOPS_PREFIX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openloops/2.1.0-pafccj2 == env: SRT_GIT_EXEC_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/libexec/git-core == env: SRT_THEPEGPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj/share/ThePEG == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: ROOT_TTREECACHE_SIZE=0 == env: EVTGENDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/evtgen/1.6.0-pafccj5/share == env: SRT_INTEL_LICENSE_FILE_SCRAMRTDEL=28518@lxlicen01.cern.ch,28518@lxlicen02.cern.ch,28518@lxlicen03.cern.ch == env: SRT_ROOT_INCLUDE_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/include/slc7_amd64_gcc700/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/include/LCG:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mctester/1.25.0a-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dd4hep/v01-10x-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtDesigner:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauolapp/1.1.5-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/charybdis/1.003-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include/SHERPA-MC:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtOpenGL:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtGui:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwig/6.521-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt3Support:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lwtnn/2.4-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4/10.4.3-pafccj2/include/Geant4:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/classlib/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cgal/4.2-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tkonlinesw/4.2.0-1_gcc7-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/starlight/r193-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtCore:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtXml:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mcdb/1.0.3-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libungif/4.1.4-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libtiff/4.0.3-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/highfive/2.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libpng/1.6.16-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pcre/8.37-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/include/xrootd/private:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/vdt/0.4.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/toprex/4.23-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tbb/2019_U3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauola/27.121.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sigcpp/2.6.2-pafccj/include/sigc++-2.0:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sqlite/3.22.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/protobuf/3.5.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pacparser/1.3.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/oracle/12.1.0.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/py2-numpy/1.16.2-nmpfii2/c-api/core/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/meschach/1.2.pCMS1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libuuid/2.22.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libunwind/1.2.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libhepml/0.2.1-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ktjet/1.06-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jimmy/4.2-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jemalloc/5.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hls/2019.08/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj10:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hector/1.3.4_patch1-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libjpeg-turbo/2.0.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/giflib/4.2.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gsl/2.2.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gdbm/1.10-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/freetype/2.5.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftw3/3.3.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftjet/1.5.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/expat/2.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dpm/1.8.0.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vecgeom/v00.05.00-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xerces-c/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xz/5.2.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dcap/2.47.8-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libxml2/2.9.1-pafccj/include/libxml2:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/curl/7.59.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cppunit/1.40.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openssl/1.0.2d-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia6/426-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/photos/215.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/zlib-x86_64/1.2.11-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/bz2lib/1.0.6-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/include/python2.7:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tinyxml2/6.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ittnotify/16.06.18-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj/include:/usr/local/include:/usr/include == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: G4LEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4EMLOW/7.3/data/G4EMLOW7.3 == env: SRT_VINCIADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vincia/2.2.04-pafccj5/share/Vincia/xmldoc == env: SRT_ROOT_TTREECACHE_PREFILL_SCRAMRTDEL=0 == env: OPAL_PREFIX=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openmpi/2.1.5-pafccj == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: ROOT_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj10:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: SHERPA_INCLUDE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include/SHERPA-MC == env: SRT_LHAPDF_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/share/LHAPDF == env: SRT_PYTHON27PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1/python:/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch-tool-conf/CMSSW_10_6_17/lib/python2.7/site-packages == env: LD_LIBRARY_PATH=/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1/biglib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/biglib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/biglib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cuda/10.1.105-pafccj2/drivers:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/dcap:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/lcgdm:/.singularity.d/libs:lib:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-19097/t.4427/cctools-temp-t.4427.K1sOGv == env: SRT_CMSSW_RELEASE_BASE_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1 == env: SRT_RIVET_ANALYSIS_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/lib == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: SRT_PERL5LIB_SCRAMRT=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/perl5 == env: SRT_CMSSW_VERSION_SCRAMRTDEL=CMSSW_10_6_17_patch1 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/usr/ == env: GCC_RUNTIME_LSAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: SCRAM_CXX11_ABI=1 == env: VALGRIND_LIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/lib/valgrind == env: SRT_CMSSW_GIT_HASH_SCRAMRTDEL=CMSSW_10_6_17_patch1 == env: SRT_ROOTSYS_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/ == env: OSG_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-fdH5vq == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-19097/cache/tmp == env: G4NEUTRONHPDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NDL/4.5/data/G4NDL4.5 == env: GEANT4_PARFULLCMS_CONFIG_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-parfullcms/2014.01.27-pafccj2/share/ParFullCMS == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: CSC_TRACK_FINDER_DATA_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/CSCTrackFinderEmulation/1.2-pafccj/data/ == env: SRT_QTINC_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: G4ENSDFSTATEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ENSDFSTATE/2.2/data/G4ENSDFSTATE2.2 == env: G4RADIOACTIVEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4RadioactiveDecay/5.2/data/RadioactiveDecay5.2 == env: ROOFITSYS=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/ == env: SRT_ROOFITSYS_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/ == env: SRT_G4RADIOACTIVEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4RadioactiveDecay/5.2/data/RadioactiveDecay5.2 == env: SRT_G4ENSDFSTATEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ENSDFSTATE/2.2/data/G4ENSDFSTATE2.2 == env: SRT_CLHEP_PARAM_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2 == env: G4ABLADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ABLA/3.0/data/G4ABLA3.0 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: SRT_SHERPA_INCLUDE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include/SHERPA-MC == env: SRT_G4FORCENUMBEROFTHREADS_SCRAMRTDEL=max == env: SRT_WORKER_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/blackhat/0.9.9-pafccj/share/blackhat/datafiles/ == env: SITECONFIG_PATH=/cvmfs/cms.cern.ch/SITECONF/local == env: PARROT_CVMFS_REPO= == env: VC3_VERSION_GZIP=1.5 == env: GCC_RUNTIME_TSAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libtsan.so == env: TNS_ADMIN=/etc == env: SRT_HEPPDT_PARAM_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj == env: PATH=/cvmfs/cms.cern.ch/share/overrides/bin:/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1/bin/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/sbin:/cvmfs/cms.cern.ch/common:/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ENV_TAG_GLOBAL=18846 == env: THEPEGPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj/share/ThePEG == env: SRT_CMSSW_SEARCH_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1/poison:/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1/src:/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/data:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/poison:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/data == env: SRT_GIT_SSL_CAINFO_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/ssl/certs/ca-bundle.crt == env: SRT_GCC_RUNTIME_LSAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: CMS_PATH=/cvmfs/cms.cern.ch == env: VC3_ROOT=/disk/vc3-root == env: SRT_UTM_XSD_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj == env: SRT_PATH_SCRAMRT=/cvmfs/cms.cern.ch/share/overrides/bin:/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1/bin/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/bin == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-fdH5vq == env: RIVET_ANALYSIS_PATH=/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/lib == env: SRT_LOCALRT_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1 == env: SRT_CMSSW_BASE_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1 == env: PWD=/disk/vc3-root/tmp/worker-230547-19097/t.4427 == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: PYTHON_VALGRIND_SUPP=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/share/valgrind/valgrind-python.supp == env: SRT_OPAL_PREFIX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openmpi/2.1.5-pafccj == env: VC3_VERSION_WHICH=2.20 == env: GCC_RUNTIME_UBSAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libubsan.so == env: LANG=C == env: SRT_QTDIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: SRT_G4NEUTRONHPDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NDL/4.5/data/G4NDL4.5 == env: X509_VOMS_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/vomsdir == env: LOBSTER_LCG_CP= == env: SRT_SHERPA_SHARE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/share/SHERPA-MC == env: SRT_GCC_RUNTIME_TSAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libtsan.so == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-19097 == env: CASCADE_PDFPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/share == env: SRT_ROOT_GCC_TOOLCHAIN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: SRT_CASCADE_PDFPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/share == env: WORKER_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/blackhat/0.9.9-pafccj/share/blackhat/datafiles/ == env: GIT_TEMPLATE_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/git-core/templates == env: G4SAIDXSDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4SAIDDATA/1.1/data/G4SAIDDATA1.1 == env: MLAS_DYNAMIC_CPU_ARCH=0 == env: SRT_CMSSW_FULL_RELEASE_BASE_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: PYTHON27PATH=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1/python:/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch-tool-conf/CMSSW_10_6_17/lib/python2.7/site-packages == env: SRT_CMSSW_FWLITE_INCLUDE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/usr/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: ROOTSYS=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/ == env: SRT_PYTHIA8DATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/share/Pythia8/xmldoc == env: SRT_HERWIGPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj/share/Herwig == env: CXX=g++ == env: SRT_QTLIB_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/lib == env: SRT_PYTHON3PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1/python:/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch-tool-conf/CMSSW_10_6_17/lib/python3.6/site-packages == env: SHERPA_LIBRARY_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/lib/SHERPA-MC == env: SRT_PYTHON_VALGRIND_SUPP_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/share/valgrind/valgrind-python.supp == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: CMSSW_SEARCH_PATH=/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1/poison:/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1/src:/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/data:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/poison:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/data == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: GENEVA_DATA_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geneva/1.0-RC3-pafccj8/share/Geneva == env: DISK=6000 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-19097/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-19097/cache/tmp/cvmfs == env: GOSAMCONTRIB_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: ROOT_TTREECACHE_PREFILL=0 == env: GENREFLEX=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/bin/genreflex == env: VINCIADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vincia/2.2.04-pafccj5/share/Vincia/xmldoc == env: SRT_G4LEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4EMLOW/7.3/data/G4EMLOW7.3 == env: SRT_GENREFLEX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/bin/genreflex == env: SRT_GOSAMCONTRIB_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: SRT_ROOT_TTREECACHE_SIZE_SCRAMRTDEL=0 == env: SRT_EVTGENDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/evtgen/1.6.0-pafccj5/share == env: SRT_GENEVA_DATA_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geneva/1.0-RC3-pafccj8/share/Geneva == env: GFAL_CONFIG_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/gfal2.d/ == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=7800 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: SRT_CMSSW_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms == env: HEPPDT_PARAM_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj == env: SRT_LD_LIBRARY_PATH_SCRAMRT=/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1/biglib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/biglib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/biglib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cuda/10.1.105-pafccj2/drivers == env: TMP=/disk/vc3-root/tmp/worker-230547-19097/t.4427/cctools-temp-t.4427.K1sOGv == env: PYTHONPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib/python2.7/site-packages:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/python2.7/site-packages:python:python: == env: PYTHON3PATH=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1/python:/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch-tool-conf/CMSSW_10_6_17/lib/python3.6/site-packages == env: QTLIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/lib == env: SCONS_LIB_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/scons/3.0.1-pafccj/lib == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: COMPILER_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: FRONTIER_CLIENT=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/ == env: SRT_G4NEUTRONXSDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NEUTRONXS/1.4/data/G4NEUTRONXS1.4 == env: SRT_SHERPA_LIBRARY_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/lib/SHERPA-MC == env: VC3_ROOT_TAR=/usr/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CLHEP_PARAM_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2 == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-fdH5vq.wrapper == env: PYTHIA8DATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/share/Pythia8/xmldoc == env: HERWIGPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj/share/Herwig == env: SRT_FRONTIER_CLIENT_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/ == env: SRT_COMPILER_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: SRT_CSC_TRACK_FINDER_DATA_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/CSCTrackFinderEmulation/1.2-pafccj/data/ == env: GCC_RUNTIME_ASAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: SRT_ROOT_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj10:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: CC=gcc == env: TEXMFHOME=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/share/Rivet/texmf == env: SRT_MLAS_DYNAMIC_CPU_ARCH_SCRAMRTDEL=0 == env: SRT_OPENBLAS_NUM_THREADS_SCRAMRTDEL=1 == env: SRT_GIT_TEMPLATE_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/git-core/templates == env: SRT_G4SAIDXSDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4SAIDDATA/1.1/data/G4SAIDDATA1.1 == env: CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: SRT_GCC_RUNTIME_UBSAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libubsan.so == env: SRT_LANG_SCRAMRTDEL=C == env: CCTOOLS_RESOURCE_MONITOR_INFO=1024 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=6 == env: PARROT_DEBUG_FLAGS= == env: SHERPA_SHARE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/share/SHERPA-MC == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: CMS_OPENLOOPS_PREFIX=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openloops/2.1.0-pafccj2 == env: GIT_EXEC_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/libexec/git-core == env: LOCALRT=/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1 == env: CMSSW_BASE=/disk/vc3-root/tmp/worker-230547-19097/t.4427/CMSSW_10_6_17_patch1 == env: SRT_SCRAM_CXX11_ABI_SCRAMRTDEL=1 == env: SRT_VALGRIND_LIB_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/lib/valgrind == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_ALL_postLHE_crc.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=15722 == env: _=/usr/bin/env === wrapper ready @ Mon Mar 8 13:21:43 EST 2021 ==== working directory before execution @ Mon Mar 8 13:21:43 EST 2021 ==== == dir: total 4700 == dir: drwxr-xr-x 18 kmohrman campus 215 Mar 8 13:21 CMSSW_10_6_17_patch1 == dir: -rw-r--r-- 3 kmohrman campus 3932158 Mar 8 13:20 UL17_DIGI_cfg.py == dir: drwxr-xr-x 2 kmohrman campus 71 Mar 8 13:20 bin == dir: -rwxr-xr-x 3 kmohrman campus 627272 Mar 8 13:20 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 Mar 8 13:20 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 Mar 8 13:20 cctools-temp-t.4427.K1sOGv == dir: -rw------- 1 kmohrman campus 51 Mar 8 13:21 cvmfschecksum.cms-ib.cern.ch == dir: -rw------- 1 kmohrman campus 51 Mar 8 13:21 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 Mar 8 13:21 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 Mar 8 13:20 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 Mar 8 13:20 librmonitor_helper.so.EZKi5G == dir: -rw-r--r-- 2 kmohrman campus 2325 Mar 8 13:20 parameters.json == dir: -rw------- 2 kmohrman campus 9921 Mar 8 13:20 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 Mar 8 13:20 python == dir: -rw-r--r-- 3 kmohrman campus 570 Mar 8 13:20 report.json.in == dir: -rw-r--r-- 3 kmohrman campus 593 Mar 8 13:20 sandbox-CMSSW_10_6_17_patch1-slc7_amd64_gcc700.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 37 Mar 8 13:20 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 Mar 8 13:21 t_wrapper_ready == dir: -rw-r--r-- 1 kmohrman campus 11 Mar 8 13:21 t_wrapper_start == dir: -rwxr-xr-x 3 kmohrman campus 47217 Mar 8 13:20 task.py == dir: -rwxr-xr-x 3 kmohrman campus 5986 Mar 8 13:20 wrapper.sh >>> data is {u'files': {u'info': {}, u'output_info': {}, u'skipped': []}, u'cpu_time': 0, u'exe_exit_code': 0, u'events_written': 0, u'output_size': 0, u'task_exit_code': 0, u'output_storage_element': u'', u'cache': {u'start_size': 0, u'type': 2, u'end_size': 0}, u'stageout_exit_code': 0, u'output_bare_size': 0, u'transfers': defaultdict(, {}), u'task_timing': {u'wrapper_ready': 0, u'wrapper_start': 0, u'prologue_end': 0, u'epilogue_end': 0, u'stage_out_end': 0, u'stage_in_end': 0, u'processing_end': 0}, u'events_per_run': 0} @ Mon Mar 8 13:21:57 2021 >>> Trying hdfs client access method @ Mon Mar 8 13:21:57 2021 >>> executing 'timeout 300 hdfs dfs -fs hdfs://eddie.crc.nd.edu:19000 -get /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/sim_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/SIM-00000_2360.root SIM-00000_2360.root' @ Mon Mar 8 13:21:57 2021 >> using /disk/vc3-root/tmp/worker-230547-19097/t.4427/cctools-temp-t.4427.K1sOGv/tmp7KajsM to store command output >> cmd: timeout: failed to run command 'hdfs': No such file or directory >>>>> Unable to copy input with hdfs client @ Mon Mar 8 13:21:57 2021 >>> Trying xrootd access method @ Mon Mar 8 13:21:57 2021 >>> executing 'env XRD_LOGLEVEL=Debug timeout 300 xrdfs deepthought.crc.nd.edu stat /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/sim_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/SIM-00000_2360.root' @ Mon Mar 8 13:21:57 2021 >> using /disk/vc3-root/tmp/worker-230547-19097/t.4427/cctools-temp-t.4427.K1sOGv/tmp9WmJY5 to store command output >> cmd: [2021-03-08 13:21:58.019684 -0500][Warning][Utility ] Unable to process global config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-08 13:21:58.021101 -0500][Debug ][Utility ] Unable to process user config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-08 13:21:58.021322 -0500][Debug ][PlugInMgr ] Initializing plug-in manager... >> cmd: [2021-03-08 13:21:58.021397 -0500][Debug ][PlugInMgr ] No default plug-in, loading plug-in configs... >> cmd: [2021-03-08 13:21:58.021505 -0500][Debug ][PlugInMgr ] Processing plug-in definitions in /etc/xrootd/client.plugins.d... >> cmd: [2021-03-08 13:21:58.021696 -0500][Debug ][PlugInMgr ] Unable to process directory /etc/xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-08 13:21:58.022203 -0500][Debug ][PlugInMgr ] Processing plug-in definitions in /tmp/runos_singularity_home-156111327175073305228293973577920660602/.xrootd/client.plugins.d... >> cmd: [2021-03-08 13:21:58.022346 -0500][Debug ][PlugInMgr ] Unable to process directory /tmp/runos_singularity_home-156111327175073305228293973577920660602/.xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-08 13:21:58.022608 -0500][Debug ][App ] Executing: stat /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/sim_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/SIM-00000_2360.root >> cmd: [2021-03-08 13:21:58.022750 -0500][Debug ][Poller ] Available pollers: built-in >> cmd: [2021-03-08 13:21:58.022816 -0500][Debug ][Poller ] Attempting to create a poller according to preference: built-in >> cmd: [2021-03-08 13:21:58.022882 -0500][Debug ][Poller ] Creating poller: built-in >> cmd: [2021-03-08 13:21:58.022953 -0500][Debug ][Poller ] Creating and starting the built-in poller... >> cmd: [2021-03-08 13:21:58.023501 -0500][Debug ][Poller ] Using 1 poller threads >> cmd: [2021-03-08 13:21:58.023586 -0500][Debug ][TaskMgr ] Starting the task manager... >> cmd: [2021-03-08 13:21:58.023781 -0500][Debug ][TaskMgr ] Task manager started >> cmd: [2021-03-08 13:21:58.023852 -0500][Debug ][JobMgr ] Starting the job manager... >> cmd: [2021-03-08 13:21:58.024307 -0500][Debug ][JobMgr ] Job manager started, 3 workers >> cmd: [2021-03-08 13:21:58.024403 -0500][Debug ][TaskMgr ] Registering task: "FileTimer task" to be run at: [2021-03-08 13:21:58 -0500] >> cmd: [2021-03-08 13:21:58.024524 -0500][Debug ][PostMaster ] Creating new channel to: deepthought.crc.nd.edu:1094 1 stream(s) >> cmd: [2021-03-08 13:21:58.024622 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-03-08 13:21:58.026391 -0500][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" to be run at: [2021-03-08 13:22:13 -0500] >> cmd: [2021-03-08 13:21:58.027981 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-03-08 13:21:58.028229 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-03-08 13:21:58.028396 -0500][Debug ][Poller ] Adding socket 0x158aa60 to the poller >> cmd: [2021-03-08 13:21:58.028844 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2021-03-08 13:21:58.029012 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-03-08 13:21:58.029766 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Got the server hand shake response (type: manager [], protocol version 400) >> cmd: [2021-03-08 13:21:58.030050 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] kXR_protocol successful (type: manager [], protocol version 400) >> cmd: [2021-03-08 13:21:58.034320 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=proteus1.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-03-08 13:21:58.034846 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Logged in, session: b96b0000a30d0000d1040000b36c0000 >> cmd: [2021-03-08 13:21:58.034966 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream 0 connected. >> cmd: [2021-03-08 13:21:58.035037 -0500][Debug ][Utility ] Monitor library name not set. No monitoring >> cmd: [2021-03-08 13:21:58.035926 -0500][Debug ][PostMaster ] Creating new channel to: primeradiant04.crc.nd.edu:1096 1 stream(s) >> cmd: [2021-03-08 13:21:58.036017 -0500][Debug ][PostMaster ] [primeradiant04.crc.nd.edu:1096 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-03-08 13:21:58.037782 -0500][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: primeradiant04.crc.nd.edu:1096" to be run at: [2021-03-08 13:22:13 -0500] >> cmd: [2021-03-08 13:21:58.039319 -0500][Debug ][PostMaster ] [primeradiant04.crc.nd.edu:1096] Found 1 address(es): [::ffff:149.165.243.12]:1096 >> cmd: [2021-03-08 13:21:58.039643 -0500][Debug ][AsyncSock ] [primeradiant04.crc.nd.edu:1096 #0.0] Attempting connection to [::ffff:149.165.243.12]:1096 >> cmd: [2021-03-08 13:21:58.039769 -0500][Debug ][Poller ] Adding socket 0xa00016a0 to the poller >> cmd: [2021-03-08 13:21:58.039905 -0500][Debug ][AsyncSock ] [primeradiant04.crc.nd.edu:1096 #0.0] Async connection call returned >> cmd: [2021-03-08 13:21:58.040046 -0500][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-03-08 13:21:58.040558 -0500][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Got the server hand shake response (type: server [], protocol version 400) >> cmd: [2021-03-08 13:21:58.040824 -0500][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] kXR_protocol successful (type: server [], protocol version 400) >> cmd: [2021-03-08 13:21:58.044235 -0500][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=proteus1.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-03-08 13:21:58.044722 -0500][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Logged in, session: 2e1c0000a6100000d8010000351d0000 >> cmd: [2021-03-08 13:21:58.044798 -0500][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Authentication is required: &P=gsi,v:10400,c:ssl,ca:ba240aa8.0|f5f0dfc2.0 >> cmd: [2021-03-08 13:21:58.044862 -0500][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Sending authentication data >> cmd: [2021-03-08 13:21:58.053696 -0500][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Trying to authenticate using gsi >> cmd: [2021-03-08 13:21:58.156456 -0500][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Sending more authentication data for gsi >> cmd: [2021-03-08 13:21:58.163342 -0500][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Authenticated with gsi. >> cmd: [2021-03-08 13:21:58.163493 -0500][Debug ][PostMaster ] [primeradiant04.crc.nd.edu:1096 #0] Stream 0 connected. >> cmd: Path: /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/sim_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/SIM-00000_2360.root >> cmd: Id: 0 >> cmd: Size: 128368363 >> cmd: MTime: 2021-03-08 17:53:10 >> cmd: Flags: 24 (Offline|IsReadable) >> cmd: [2021-03-08 13:21:58.193765 -0500][Debug ][JobMgr ] Stopping the job manager... >> cmd: [2021-03-08 13:21:58.195579 -0500][Debug ][JobMgr ] Job manager stopped >> cmd: [2021-03-08 13:21:58.195681 -0500][Debug ][TaskMgr ] Stopping the task manager... >> cmd: [2021-03-08 13:21:58.196023 -0500][Debug ][TaskMgr ] Task manager stopped >> cmd: [2021-03-08 13:21:58.196117 -0500][Debug ][Poller ] Stopping the poller... >> cmd: [2021-03-08 13:21:58.196646 -0500][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" >> cmd: [2021-03-08 13:21:58.196737 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-03-08 13:21:58.196818 -0500][Debug ][Poller ] <[::ffff:10.32.75.147]:44208><--><[::ffff:129.74.85.55]:1094> Removing socket from the poller >> cmd: [2021-03-08 13:21:58.196960 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Destroying stream >> cmd: [2021-03-08 13:21:58.197037 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-03-08 13:21:58.197133 -0500][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: primeradiant04.crc.nd.edu:1096" >> cmd: [2021-03-08 13:21:58.197208 -0500][Debug ][AsyncSock ] [primeradiant04.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2021-03-08 13:21:58.197273 -0500][Debug ][Poller ] <[::ffff:10.32.75.147]:59958><--><[::ffff:149.165.243.12]:1096> Removing socket from the poller >> cmd: [2021-03-08 13:21:58.197382 -0500][Debug ][PostMaster ] [primeradiant04.crc.nd.edu:1096 #0] Destroying stream >> cmd: [2021-03-08 13:21:58.197447 -0500][Debug ][AsyncSock ] [primeradiant04.crc.nd.edu:1096 #0.0] Closing the socket >>> will stream using xrootd instead of copying @ Mon Mar 8 13:21:58 2021 >>> modified input files @ Mon Mar 8 13:21:58 2021 >> input: root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/sim_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/SIM-00000_2360.root >>> updated parameters are @ Mon Mar 8 13:21:58 2021 >> json: { >> json: "accelerate stage-in": 3, >> json: "arguments": [], >> json: "cores": 6, >> json: "default ce": "T3_US_NotreDame", >> json: "default host": "earth.crc.nd.edu", >> json: "default se": "T3_US_NotreDame", >> json: "disable streaming": false, >> json: "epilogue": null, >> json: "executable": "cmsRun", >> json: "file map": { >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/sim_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/SIM-00000_2360.root": "sim_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/SIM-00000_2360.root" >> json: }, >> json: "gridpack": false, >> json: "input": [ >> json: "hdfs://eddie.crc.nd.edu:19000/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5", >> json: "file:///hadoop/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/" >> json: ], >> json: "mask": { >> json: "events": -1, >> json: "files": [ >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/sim_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/SIM-00000_2360.root" >> json: ], >> json: "lumis": { >> json: "1": [ >> json: [ >> json: 450, >> json: 450 >> json: ] >> json: ] >> json: } >> json: }, >> json: "monitoring": { >> json: "monitorid": null, >> json: "syncid": null, >> json: "taskid": "lobster_kmohrman_EFT_ALL_postLHE_crc_20210308_1114_7bcb2e355aba475a" >> json: }, >> json: "output": [ >> json: "hdfs://eddie.crc.nd.edu:19000/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5", >> json: "file:///hadoop/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/" >> json: ], >> json: "output files": [ >> json: [ >> json: "DIGI-00000.root", >> json: "digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/DIGI-00000_4427.root" >> json: ] >> json: ], >> json: "prologue": null, >> json: "pset": "UL17_DIGI_cfg.py", >> json: "want summary": true >> json: } >>> using sync CE T3_US_NotreDame @ Mon Mar 8 13:21:58 2021 >>> config file fragment @ Mon Mar 8 13:22:00 2021 >> pset: >> pset: import FWCore.ParameterSet.Config as cms >> pset: process.Timing = cms.Service("Timing", >> pset: useJobReport = cms.untracked.bool(True), >> pset: summaryOnly = cms.untracked.bool(True)) >> pset: >> pset: process.maxEvents = cms.untracked.PSet(input = cms.untracked.int32(-1)) >> pset: >> pset: import os >> pset: _, major, minor, _ = os.environ["CMSSW_VERSION"].split('_', 3) >> pset: if int(major) >= 7 and int(minor) >= 4: >> pset: xrdstats = cms.Service("XrdAdaptor::XrdStatisticsService", cms.untracked.PSet(reportToFJR = cms.untracked.bool(True))) >> pset: process.add_(xrdstats) >> pset: >> pset: for prod in process.producers.values(): >> pset: if prod.hasParameter('nEvents') and prod.type_() == 'ExternalLHEProducer': >> pset: prod.nEvents = cms.untracked.uint32(-1) >> pset: >> pset: process.source.fileNames = cms.untracked.vstring(['root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/sim_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/SIM-00000_2360.root']) >> pset: process.source.lumisToProcess = cms.untracked.VLuminosityBlockRange(['1:450']) >> pset: if hasattr(process, 'options'): >> pset: process.options.wantSummary = cms.untracked.bool(True) >> pset: else: >> pset: process.options = cms.untracked.PSet(wantSummary = cms.untracked.bool(True)) >> pset: >> pset: if hasattr(process, 'options'): >> pset: process.options.numberOfThreads = cms.untracked.uint32(6) >> pset: process.options.numberOfStreams = cms.untracked.uint32(0) >> pset: else: >> pset: process.options = cms.untracked.PSet( >> pset: numberOfThreads = cms.untracked.uint32(6), >> pset: numberOfStreams = cms.untracked.uint32(0) >> pset: ) >>> executing 'cmsRun -j report.xml UL17_DIGI_cfg_mod.py' @ Mon Mar 8 13:22:00 2021 >> using /disk/vc3-root/tmp/worker-230547-19097/t.4427/cctools-temp-t.4427.K1sOGv/tmp1zy3N7 to store command output >> cmd: %MSG-i ThreadStreamSetup: (NoModuleName) 08-Mar-2021 13:22:21 EST pre-events >> cmd: setting # threads 6 >> cmd: setting # streams 6 >> cmd: %MSG >> cmd: 08-Mar-2021 13:22:31 EST Initiating request to open file root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/sim_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/SIM-00000_2360.root >> cmd: 08-Mar-2021 13:22:37 EST Successfully opened file root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/sim_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/SIM-00000_2360.root >> cmd: 08-Mar-2021 13:22:41 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210007/3ACC3184-AAA8-DA48-A28C-4B301490E69C.root >> cmd: 08-Mar-2021 13:22:50 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210007/3ACC3184-AAA8-DA48-A28C-4B301490E69C.root >> cmd: 08-Mar-2021 13:23:09 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210004/F75C44CD-C63E-E04F-A54E-D5FF04FD3ECB.root >> cmd: 08-Mar-2021 13:23:17 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210004/F75C44CD-C63E-E04F-A54E-D5FF04FD3ECB.root >> cmd: 08-Mar-2021 13:23:41 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210007/0A607D43-72C0-F846-AE6E-A5B6D5EA34BB.root >> cmd: 08-Mar-2021 13:23:49 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210007/0A607D43-72C0-F846-AE6E-A5B6D5EA34BB.root >> cmd: [2021-03-08 13:23:53.275195 -0500][Error ][AsyncSock ] [primeradiant06.crc.nd.edu:1094 #0.0] Socket error while handshaking: [ERROR] Socket timeout >> cmd: [2021-03-08 13:23:53.276594 -0500][Error ][PostMaster ] [primeradiant06.crc.nd.edu:1094 #0] elapsed = 45, pConnectionWindow = 31 seconds. >> cmd: 08-Mar-2021 13:23:59 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210018/9D69A5E4-1764-DB42-882D-FB6983534196.root >> cmd: 08-Mar-2021 13:24:07 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210018/9D69A5E4-1764-DB42-882D-FB6983534196.root >> cmd: 08-Mar-2021 13:24:12 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/230000/227E1585-8F17-0941-BAD4-730455C5D665.root >> cmd: [2021-03-08 13:24:38.089221 -0500][Error ][AsyncSock ] [primeradiant06.crc.nd.edu:1094 #0.0] Socket error while handshaking: [ERROR] Socket timeout >> cmd: [2021-03-08 13:24:38.090348 -0500][Error ][PostMaster ] [primeradiant06.crc.nd.edu:1094 #0] elapsed = 45, pConnectionWindow = 31 seconds. >> cmd: [2021-03-08 13:24:38.090666 -0500][Error ][PostMaster ] [primeradiant06.crc.nd.edu:1094 #0] Unable to recover: [ERROR] Socket timeout. >> cmd: [2021-03-08 13:24:38.090940 -0500][Error ][XRootD ] [primeradiant06.crc.nd.edu:1094] Impossible to send message kXR_open (file: /store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210007/3ACC3184-AAA8-DA48-A28C-4B301490E69C.root?tried=primeradiant05.crc.nd.edu, mode: 0660, flags: kXR_open_read kXR_async kXR_retstat ). Trying to recover. >> cmd: [2021-03-08 13:24:38.091441 -0500][Error ][XRootD ] [primeradiant06.crc.nd.edu:1094] Impossible to send message kXR_open (file: /store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/230000/227E1585-8F17-0941-BAD4-730455C5D665.root, mode: 0460, flags: kXR_open_read kXR_async kXR_retstat ). Trying to recover. >> cmd: 08-Mar-2021 13:24:40 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/230000/227E1585-8F17-0941-BAD4-730455C5D665.root >> cmd: 08-Mar-2021 13:25:24 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210006/AA92D4FD-B34C-C74A-B078-5FA2FCC04CF2.root >> cmd: %MSG-w XrdAdaptor: PreMixingModule:mixData@ctor 08-Mar-2021 13:25:33 EST pre-events >> cmd: Data is served from T3_US_NotreDame instead of original site crc.nd.edu >> cmd: %MSG >> cmd: 08-Mar-2021 13:25:33 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210006/AA92D4FD-B34C-C74A-B078-5FA2FCC04CF2.root >> cmd: Begin processing the 1st record. Run 1, Event 2, LumiSection 450 on stream 1 at 08-Mar-2021 13:25:47.976 EST >> cmd: Begin processing the 2nd record. Run 1, Event 14, LumiSection 450 on stream 5 at 08-Mar-2021 13:25:47.977 EST >> cmd: Begin processing the 3rd record. Run 1, Event 5, LumiSection 450 on stream 3 at 08-Mar-2021 13:25:47.979 EST >> cmd: Begin processing the 4th record. Run 1, Event 15, LumiSection 450 on stream 4 at 08-Mar-2021 13:25:47.981 EST >> cmd: Begin processing the 5th record. Run 1, Event 13, LumiSection 450 on stream 2 at 08-Mar-2021 13:25:47.985 EST >> cmd: Begin processing the 6th record. Run 1, Event 39, LumiSection 450 on stream 0 at 08-Mar-2021 13:25:47.986 EST >> cmd: 08-Mar-2021 13:28:09 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210004/F75C44CD-C63E-E04F-A54E-D5FF04FD3ECB.root >> cmd: 08-Mar-2021 13:28:09 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/230000/227E1585-8F17-0941-BAD4-730455C5D665.root >> cmd: 08-Mar-2021 13:28:09 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210007/1F5F717D-7A9A-864A-9603-BE57E21771C2.root >> cmd: 08-Mar-2021 13:28:09 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210017/B9FFB326-5625-3E4D-A594-4649EABB6BD4.root >> cmd: 08-Mar-2021 13:28:18 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210017/B9FFB326-5625-3E4D-A594-4649EABB6BD4.root >> cmd: 08-Mar-2021 13:28:18 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210007/3ACC3184-AAA8-DA48-A28C-4B301490E69C.root >> cmd: 08-Mar-2021 13:28:18 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210006/AA92D4FD-B34C-C74A-B078-5FA2FCC04CF2.root >> cmd: 08-Mar-2021 13:28:18 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210018/9D69A5E4-1764-DB42-882D-FB6983534196.root >> cmd: 08-Mar-2021 13:28:18 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210007/0A607D43-72C0-F846-AE6E-A5B6D5EA34BB.root >> cmd: 08-Mar-2021 13:28:25 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210011/153B171A-6A22-E044-9AB8-C135927BECA4.root >> cmd: 08-Mar-2021 13:28:25 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210014/13C8396B-069F-E441-B63C-D0FC97D2CFDD.root >> cmd: 08-Mar-2021 13:28:25 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/20001/31D9BC08-3620-994A-B8B7-2BBA4682A341.root >> cmd: 08-Mar-2021 13:28:25 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210007/1F5F717D-7A9A-864A-9603-BE57E21771C2.root >> cmd: 08-Mar-2021 13:28:25 EST Initiating request to open file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210016/2BB09B54-6887-4F4A-AAA2-B2EC4DE80AF7.root >> cmd: 08-Mar-2021 13:28:34 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210014/13C8396B-069F-E441-B63C-D0FC97D2CFDD.root >> cmd: 08-Mar-2021 13:28:43 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210011/153B171A-6A22-E044-9AB8-C135927BECA4.root >> cmd: 08-Mar-2021 13:28:50 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210016/2BB09B54-6887-4F4A-AAA2-B2EC4DE80AF7.root >> cmd: 08-Mar-2021 13:28:59 EST Successfully opened file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/20001/31D9BC08-3620-994A-B8B7-2BBA4682A341.root >> cmd: Begin processing the 7th record. Run 1, Event 22, LumiSection 450 on stream 2 at 08-Mar-2021 13:29:49.260 EST >> cmd: Begin processing the 8th record. Run 1, Event 18, LumiSection 450 on stream 3 at 08-Mar-2021 13:29:49.798 EST >> cmd: Begin processing the 9th record. Run 1, Event 32, LumiSection 450 on stream 2 at 08-Mar-2021 13:29:52.629 EST >> cmd: Begin processing the 10th record. Run 1, Event 54, LumiSection 450 on stream 3 at 08-Mar-2021 13:29:54.101 EST >> cmd: Begin processing the 11th record. Run 1, Event 26, LumiSection 450 on stream 2 at 08-Mar-2021 13:29:56.176 EST >> cmd: Begin processing the 12th record. Run 1, Event 44, LumiSection 450 on stream 3 at 08-Mar-2021 13:29:56.638 EST >> cmd: Begin processing the 13th record. Run 1, Event 38, LumiSection 450 on stream 3 at 08-Mar-2021 13:29:59.551 EST >> cmd: Begin processing the 14th record. Run 1, Event 61, LumiSection 450 on stream 2 at 08-Mar-2021 13:30:00.335 EST >> cmd: Begin processing the 15th record. Run 1, Event 84, LumiSection 450 on stream 3 at 08-Mar-2021 13:30:03.776 EST >> cmd: Begin processing the 16th record. Run 1, Event 58, LumiSection 450 on stream 2 at 08-Mar-2021 13:30:04.309 EST >> cmd: Begin processing the 17th record. Run 1, Event 51, LumiSection 450 on stream 3 at 08-Mar-2021 13:30:07.010 EST >> cmd: Begin processing the 18th record. Run 1, Event 52, LumiSection 450 on stream 2 at 08-Mar-2021 13:30:07.590 EST >> cmd: Begin processing the 19th record. Run 1, Event 81, LumiSection 450 on stream 4 at 08-Mar-2021 13:30:09.551 EST >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: Begin processing the 20th record. Run 1, Event 90, LumiSection 450 on stream 2 at 08-Mar-2021 13:30:10.442 EST >> cmd: Begin processing the 21st record. Run 1, Event 87, LumiSection 450 on stream 1 at 08-Mar-2021 13:30:10.997 EST >> cmd: Begin processing the 22nd record. Run 1, Event 86, LumiSection 450 on stream 3 at 08-Mar-2021 13:30:11.875 EST >> cmd: Begin processing the 23rd record. Run 1, Event 96, LumiSection 450 on stream 0 at 08-Mar-2021 13:30:12.260 EST >> cmd: Begin processing the 24th record. Run 1, Event 100, LumiSection 450 on stream 5 at 08-Mar-2021 13:30:12.511 EST >> cmd: Begin processing the 25th record. Run 1, Event 104, LumiSection 450 on stream 4 at 08-Mar-2021 13:30:12.755 EST >> cmd: Begin processing the 26th record. Run 1, Event 123, LumiSection 450 on stream 2 at 08-Mar-2021 13:30:14.138 EST >> cmd: Begin processing the 27th record. Run 1, Event 95, LumiSection 450 on stream 1 at 08-Mar-2021 13:30:14.371 EST >> cmd: Begin processing the 28th record. Run 1, Event 128, LumiSection 450 on stream 0 at 08-Mar-2021 13:30:15.111 EST >> cmd: Begin processing the 29th record. Run 1, Event 113, LumiSection 450 on stream 3 at 08-Mar-2021 13:30:15.209 EST >> cmd: Begin processing the 30th record. Run 1, Event 124, LumiSection 450 on stream 5 at 08-Mar-2021 13:30:15.853 EST >> cmd: Begin processing the 31st record. Run 1, Event 110, LumiSection 450 on stream 2 at 08-Mar-2021 13:30:16.725 EST >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: Begin processing the 32nd record. Run 1, Event 138, LumiSection 450 on stream 4 at 08-Mar-2021 13:30:17.761 EST >> cmd: Begin processing the 33rd record. Run 1, Event 131, LumiSection 450 on stream 1 at 08-Mar-2021 13:30:18.040 EST >> cmd: Begin processing the 34th record. Run 1, Event 136, LumiSection 450 on stream 3 at 08-Mar-2021 13:30:18.187 EST >> cmd: Begin processing the 35th record. Run 1, Event 129, LumiSection 450 on stream 0 at 08-Mar-2021 13:30:18.670 EST >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: Begin processing the 36th record. Run 1, Event 146, LumiSection 450 on stream 5 at 08-Mar-2021 13:30:20.090 EST >> cmd: Begin processing the 37th record. Run 1, Event 150, LumiSection 450 on stream 3 at 08-Mar-2021 13:30:20.464 EST >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: Begin processing the 38th record. Run 1, Event 154, LumiSection 450 on stream 4 at 08-Mar-2021 13:30:21.125 EST >> cmd: Begin processing the 39th record. Run 1, Event 141, LumiSection 450 on stream 2 at 08-Mar-2021 13:30:21.391 EST >> cmd: Begin processing the 40th record. Run 1, Event 163, LumiSection 450 on stream 0 at 08-Mar-2021 13:30:21.685 EST >> cmd: Begin processing the 41st record. Run 1, Event 151, LumiSection 450 on stream 1 at 08-Mar-2021 13:30:22.168 EST >> cmd: Begin processing the 42nd record. Run 1, Event 164, LumiSection 450 on stream 5 at 08-Mar-2021 13:30:22.865 EST >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: Begin processing the 43rd record. Run 1, Event 159, LumiSection 450 on stream 3 at 08-Mar-2021 13:30:24.054 EST >> cmd: Begin processing the 44th record. Run 1, Event 169, LumiSection 450 on stream 4 at 08-Mar-2021 13:30:24.268 EST >> cmd: Begin processing the 45th record. Run 1, Event 165, LumiSection 450 on stream 0 at 08-Mar-2021 13:30:26.279 EST >> cmd: Begin processing the 46th record. Run 1, Event 183, LumiSection 450 on stream 5 at 08-Mar-2021 13:30:26.909 EST >> cmd: Begin processing the 47th record. Run 1, Event 182, LumiSection 450 on stream 1 at 08-Mar-2021 13:30:27.200 EST >> cmd: Begin processing the 48th record. Run 1, Event 168, LumiSection 450 on stream 4 at 08-Mar-2021 13:30:27.465 EST >> cmd: Begin processing the 49th record. Run 1, Event 189, LumiSection 450 on stream 3 at 08-Mar-2021 13:30:27.987 EST >> cmd: Begin processing the 50th record. Run 1, Event 192, LumiSection 450 on stream 0 at 08-Mar-2021 13:30:29.431 EST >> cmd: Begin processing the 51st record. Run 1, Event 207, LumiSection 450 on stream 5 at 08-Mar-2021 13:30:30.280 EST >> cmd: Begin processing the 52nd record. Run 1, Event 186, LumiSection 450 on stream 2 at 08-Mar-2021 13:30:30.814 EST >> cmd: Begin processing the 53rd record. Run 1, Event 204, LumiSection 450 on stream 1 at 08-Mar-2021 13:30:31.078 EST >> cmd: Begin processing the 54th record. Run 1, Event 214, LumiSection 450 on stream 4 at 08-Mar-2021 13:30:31.508 EST >> cmd: Begin processing the 55th record. Run 1, Event 210, LumiSection 450 on stream 3 at 08-Mar-2021 13:30:32.261 EST >> cmd: Begin processing the 56th record. Run 1, Event 215, LumiSection 450 on stream 0 at 08-Mar-2021 13:30:33.197 EST >> cmd: Begin processing the 57th record. Run 1, Event 211, LumiSection 450 on stream 5 at 08-Mar-2021 13:30:33.216 EST >> cmd: Begin processing the 58th record. Run 1, Event 199, LumiSection 450 on stream 1 at 08-Mar-2021 13:30:33.717 EST >> cmd: Begin processing the 59th record. Run 1, Event 218, LumiSection 450 on stream 2 at 08-Mar-2021 13:30:34.518 EST >> cmd: Begin processing the 60th record. Run 1, Event 229, LumiSection 450 on stream 4 at 08-Mar-2021 13:30:35.090 EST >> cmd: Begin processing the 61st record. Run 1, Event 241, LumiSection 450 on stream 3 at 08-Mar-2021 13:30:36.856 EST >> cmd: Begin processing the 62nd record. Run 1, Event 234, LumiSection 450 on stream 5 at 08-Mar-2021 13:30:37.146 EST >> cmd: Begin processing the 63rd record. Run 1, Event 223, LumiSection 450 on stream 0 at 08-Mar-2021 13:30:37.308 EST >> cmd: Begin processing the 64th record. Run 1, Event 233, LumiSection 450 on stream 1 at 08-Mar-2021 13:30:37.861 EST >> cmd: Begin processing the 65th record. Run 1, Event 242, LumiSection 450 on stream 2 at 08-Mar-2021 13:30:38.287 EST >> cmd: Begin processing the 66th record. Run 1, Event 245, LumiSection 450 on stream 4 at 08-Mar-2021 13:30:39.346 EST >> cmd: Begin processing the 67th record. Run 1, Event 239, LumiSection 450 on stream 3 at 08-Mar-2021 13:30:39.621 EST >> cmd: Begin processing the 68th record. Run 1, Event 244, LumiSection 450 on stream 0 at 08-Mar-2021 13:30:40.442 EST >> cmd: Begin processing the 69th record. Run 1, Event 247, LumiSection 450 on stream 1 at 08-Mar-2021 13:30:40.906 EST >> cmd: Begin processing the 70th record. Run 1, Event 250, LumiSection 450 on stream 2 at 08-Mar-2021 13:30:41.005 EST >> cmd: Begin processing the 71st record. Run 1, Event 257, LumiSection 450 on stream 5 at 08-Mar-2021 13:30:42.307 EST >> cmd: Begin processing the 72nd record. Run 1, Event 259, LumiSection 450 on stream 4 at 08-Mar-2021 13:30:42.786 EST >> cmd: Begin processing the 73rd record. Run 1, Event 266, LumiSection 450 on stream 0 at 08-Mar-2021 13:30:43.567 EST >> cmd: Begin processing the 74th record. Run 1, Event 261, LumiSection 450 on stream 1 at 08-Mar-2021 13:30:44.936 EST >> cmd: Begin processing the 75th record. Run 1, Event 264, LumiSection 450 on stream 2 at 08-Mar-2021 13:30:44.937 EST >> cmd: Begin processing the 76th record. Run 1, Event 273, LumiSection 450 on stream 3 at 08-Mar-2021 13:30:45.135 EST >> cmd: Begin processing the 77th record. Run 1, Event 274, LumiSection 450 on stream 4 at 08-Mar-2021 13:30:45.166 EST >> cmd: Begin processing the 78th record. Run 1, Event 271, LumiSection 450 on stream 5 at 08-Mar-2021 13:30:45.762 EST >> cmd: Begin processing the 79th record. Run 1, Event 290, LumiSection 450 on stream 4 at 08-Mar-2021 13:30:47.408 EST >> cmd: Begin processing the 80th record. Run 1, Event 275, LumiSection 450 on stream 0 at 08-Mar-2021 13:30:47.988 EST >> cmd: Begin processing the 81st record. Run 1, Event 291, LumiSection 450 on stream 1 at 08-Mar-2021 13:30:48.319 EST >> cmd: Begin processing the 82nd record. Run 1, Event 292, LumiSection 450 on stream 3 at 08-Mar-2021 13:30:48.893 EST >> cmd: Begin processing the 83rd record. Run 1, Event 287, LumiSection 450 on stream 2 at 08-Mar-2021 13:30:49.376 EST >> cmd: Begin processing the 84th record. Run 1, Event 298, LumiSection 450 on stream 5 at 08-Mar-2021 13:30:49.536 EST >> cmd: Begin processing the 85th record. Run 1, Event 278, LumiSection 450 on stream 4 at 08-Mar-2021 13:30:50.689 EST >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: Begin processing the 86th record. Run 1, Event 303, LumiSection 450 on stream 1 at 08-Mar-2021 13:30:51.725 EST >> cmd: Begin processing the 87th record. Run 1, Event 295, LumiSection 450 on stream 0 at 08-Mar-2021 13:30:52.014 EST >> cmd: Begin processing the 88th record. Run 1, Event 301, LumiSection 450 on stream 2 at 08-Mar-2021 13:30:52.282 EST >> cmd: Begin processing the 89th record. Run 1, Event 306, LumiSection 450 on stream 5 at 08-Mar-2021 13:30:52.547 EST >> cmd: Begin processing the 90th record. Run 1, Event 312, LumiSection 450 on stream 3 at 08-Mar-2021 13:30:53.276 EST >> cmd: Begin processing the 91st record. Run 1, Event 300, LumiSection 450 on stream 4 at 08-Mar-2021 13:30:54.746 EST >> cmd: Begin processing the 92nd record. Run 1, Event 307, LumiSection 450 on stream 1 at 08-Mar-2021 13:30:54.980 EST >> cmd: Begin processing the 93rd record. Run 1, Event 315, LumiSection 450 on stream 2 at 08-Mar-2021 13:30:55.093 EST >> cmd: Begin processing the 94th record. Run 1, Event 318, LumiSection 450 on stream 0 at 08-Mar-2021 13:30:55.589 EST >> cmd: Begin processing the 95th record. Run 1, Event 330, LumiSection 450 on stream 5 at 08-Mar-2021 13:30:56.620 EST >> cmd: Begin processing the 96th record. Run 1, Event 324, LumiSection 450 on stream 3 at 08-Mar-2021 13:30:57.535 EST >> cmd: Begin processing the 97th record. Run 1, Event 332, LumiSection 450 on stream 4 at 08-Mar-2021 13:30:58.040 EST >> cmd: Begin processing the 98th record. Run 1, Event 320, LumiSection 450 on stream 1 at 08-Mar-2021 13:30:59.439 EST >> cmd: Begin processing the 99th record. Run 1, Event 335, LumiSection 450 on stream 2 at 08-Mar-2021 13:30:59.440 EST >> cmd: Begin processing the 100th record. Run 1, Event 339, LumiSection 450 on stream 0 at 08-Mar-2021 13:30:59.441 EST >> cmd: Begin processing the 101st record. Run 1, Event 370, LumiSection 450 on stream 5 at 08-Mar-2021 13:30:59.637 EST >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: DTTSPhi::addTracoT: preview not present in TRACO trigger or its code=0 trigger not added! >> cmd: Begin processing the 102nd record. Run 1, Event 355, LumiSection 450 on stream 3 at 08-Mar-2021 13:31:00.871 EST >> cmd: Begin processing the 103rd record. Run 1, Event 377, LumiSection 450 on stream 4 at 08-Mar-2021 13:31:01.595 EST >> cmd: Begin processing the 104th record. Run 1, Event 348, LumiSection 450 on stream 0 at 08-Mar-2021 13:31:02.650 EST >> cmd: Begin processing the 105th record. Run 1, Event 391, LumiSection 450 on stream 2 at 08-Mar-2021 13:31:02.651 EST >> cmd: Begin processing the 106th record. Run 1, Event 362, LumiSection 450 on stream 5 at 08-Mar-2021 13:31:03.333 EST >> cmd: Begin processing the 107th record. Run 1, Event 392, LumiSection 450 on stream 3 at 08-Mar-2021 13:31:04.160 EST >> cmd: Begin processing the 108th record. Run 1, Event 394, LumiSection 450 on stream 4 at 08-Mar-2021 13:31:04.655 EST >> cmd: Begin processing the 109th record. Run 1, Event 369, LumiSection 450 on stream 1 at 08-Mar-2021 13:31:06.002 EST >> cmd: Begin processing the 110th record. Run 1, Event 397, LumiSection 450 on stream 0 at 08-Mar-2021 13:31:06.544 EST >> cmd: Begin processing the 111th record. Run 1, Event 398, LumiSection 450 on stream 5 at 08-Mar-2021 13:31:07.964 EST >> cmd: Begin processing the 112th record. Run 1, Event 399, LumiSection 450 on stream 3 at 08-Mar-2021 13:31:08.368 EST >> cmd: Begin processing the 113th record. Run 1, Event 406, LumiSection 450 on stream 4 at 08-Mar-2021 13:31:08.403 EST >> cmd: Begin processing the 114th record. Run 1, Event 407, LumiSection 450 on stream 2 at 08-Mar-2021 13:31:08.987 EST >> cmd: Begin processing the 115th record. Run 1, Event 410, LumiSection 450 on stream 1 at 08-Mar-2021 13:31:09.294 EST >> cmd: Begin processing the 116th record. Run 1, Event 404, LumiSection 450 on stream 0 at 08-Mar-2021 13:31:10.769 EST >> cmd: Begin processing the 117th record. Run 1, Event 420, LumiSection 450 on stream 3 at 08-Mar-2021 13:31:10.848 EST >> cmd: Begin processing the 118th record. Run 1, Event 411, LumiSection 450 on stream 5 at 08-Mar-2021 13:31:11.308 EST >> cmd: Begin processing the 119th record. Run 1, Event 421, LumiSection 450 on stream 4 at 08-Mar-2021 13:31:11.679 EST >> cmd: Begin processing the 120th record. Run 1, Event 428, LumiSection 450 on stream 2 at 08-Mar-2021 13:31:12.064 EST >> cmd: Begin processing the 121st record. Run 1, Event 414, LumiSection 450 on stream 1 at 08-Mar-2021 13:31:12.727 EST >> cmd: Begin processing the 122nd record. Run 1, Event 433, LumiSection 450 on stream 5 at 08-Mar-2021 13:31:14.376 EST >> cmd: Begin processing the 123rd record. Run 1, Event 436, LumiSection 450 on stream 3 at 08-Mar-2021 13:31:14.628 EST >> cmd: Begin processing the 124th record. Run 1, Event 425, LumiSection 450 on stream 0 at 08-Mar-2021 13:31:14.911 EST >> cmd: Begin processing the 125th record. Run 1, Event 452, LumiSection 450 on stream 2 at 08-Mar-2021 13:31:14.938 EST >> cmd: Begin processing the 126th record. Run 1, Event 450, LumiSection 450 on stream 4 at 08-Mar-2021 13:31:16.537 EST >> cmd: Begin processing the 127th record. Run 1, Event 451, LumiSection 450 on stream 1 at 08-Mar-2021 13:31:16.655 EST >> cmd: Begin processing the 128th record. Run 1, Event 455, LumiSection 450 on stream 3 at 08-Mar-2021 13:31:17.590 EST >> cmd: Begin processing the 129th record. Run 1, Event 439, LumiSection 450 on stream 2 at 08-Mar-2021 13:31:17.660 EST >> cmd: Begin processing the 130th record. Run 1, Event 483, LumiSection 450 on stream 0 at 08-Mar-2021 13:31:18.246 EST >> cmd: Begin processing the 131st record. Run 1, Event 481, LumiSection 450 on stream 5 at 08-Mar-2021 13:31:18.678 EST >> cmd: Begin processing the 132nd record. Run 1, Event 461, LumiSection 450 on stream 1 at 08-Mar-2021 13:31:19.751 EST >> cmd: Begin processing the 133rd record. Run 1, Event 494, LumiSection 450 on stream 4 at 08-Mar-2021 13:31:20.526 EST >> cmd: Begin processing the 134th record. Run 1, Event 484, LumiSection 450 on stream 3 at 08-Mar-2021 13:31:20.806 EST >> cmd: Begin processing the 135th record. Run 1, Event 474, LumiSection 450 on stream 0 at 08-Mar-2021 13:31:21.059 EST >> cmd: 08-Mar-2021 13:31:24 EST Closed file root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/sim_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/SIM-00000_2360.root >> cmd: 08-Mar-2021 13:31:25 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210016/2BB09B54-6887-4F4A-AAA2-B2EC4DE80AF7.root >> cmd: 08-Mar-2021 13:31:25 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210017/B9FFB326-5625-3E4D-A594-4649EABB6BD4.root >> cmd: 08-Mar-2021 13:31:26 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210014/13C8396B-069F-E441-B63C-D0FC97D2CFDD.root >> cmd: 08-Mar-2021 13:31:26 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/20001/31D9BC08-3620-994A-B8B7-2BBA4682A341.root >> cmd: 08-Mar-2021 13:31:26 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210007/1F5F717D-7A9A-864A-9603-BE57E21771C2.root >> cmd: 08-Mar-2021 13:31:26 EST Closed file root://ndcms.crc.nd.edu//store/mc/RunIISummer20ULPrePremix/Neutrino_E-10_gun/PREMIX/UL17_106X_mc2017_realistic_v6-v3/210011/153B171A-6A22-E044-9AB8-C135927BECA4.root >> cmd: >> cmd: TrigReport ---------- Event Summary ------------ >> cmd: TrigReport Events total = 135 passed = 135 failed = 0 >> cmd: >> cmd: TrigReport ---------- Path Summary ------------ >> cmd: TrigReport Trig Bit# Executed Passed Failed Error Name >> cmd: >> cmd: TrigReport -------End-Path Summary ------------ >> cmd: TrigReport Trig Bit# Executed Passed Failed Error Name >> cmd: TrigReport 0 1 135 135 0 0 PREMIXRAWoutput_step >> cmd: >> cmd: TrigReport ------ Modules in End-Path: PREMIXRAWoutput_step ------------ >> cmd: TrigReport Trig Bit# Visited Passed Failed Error Name >> cmd: TrigReport 0 0 135 135 0 0 PREMIXRAWoutput >> cmd: >> cmd: TrigReport ---------- Module Summary ------------ >> cmd: TrigReport Visited Executed Passed Failed Error Name >> cmd: TrigReport 540 135 135 0 0 DMEcalDigis >> cmd: TrigReport 135 135 135 0 0 DMEcalPreshowerDigis >> cmd: TrigReport 135 135 135 0 0 DMEcalTriggerPrimitiveDigis >> cmd: TrigReport 675 135 135 0 0 DMHcalDigis >> cmd: TrigReport 0 0 0 0 0 DMHcalTTPDigis >> cmd: TrigReport 135 135 135 0 0 DMHcalTriggerPrimitiveDigis >> cmd: TrigReport 135 135 135 0 0 L1simulation_step >> cmd: TrigReport 0 0 0 0 0 MEtoEDMConverter >> cmd: TrigReport 135 135 135 0 0 PREMIXRAWoutput >> cmd: TrigReport 135 135 135 0 0 PREMIXRAWoutput_step >> cmd: TrigReport 135 135 135 0 0 SiStripDigiToRaw >> cmd: TrigReport 135 135 135 0 0 TriggerResults >> cmd: TrigReport 270 135 135 0 0 addPileupInfo >> cmd: TrigReport 135 135 135 0 0 ak4GenJets >> cmd: TrigReport 135 135 135 0 0 ak4GenJetsNoNu >> cmd: TrigReport 135 135 135 0 0 ak8GenJets >> cmd: TrigReport 135 135 135 0 0 ak8GenJetsNoNu >> cmd: TrigReport 135 135 135 0 0 bmtfStage2Raw >> cmd: TrigReport 135 135 135 0 0 caloLayer1RawFed1354 >> cmd: TrigReport 135 135 135 0 0 caloLayer1RawFed1356 >> cmd: TrigReport 135 135 135 0 0 caloLayer1RawFed1358 >> cmd: TrigReport 135 135 135 0 0 caloStage2Raw >> cmd: TrigReport 135 135 135 0 0 cscpacker >> cmd: TrigReport 135 135 135 0 0 datamixing_step >> cmd: TrigReport 135 135 135 0 0 digi2raw_step >> cmd: TrigReport 135 135 135 0 0 digitisation_step >> cmd: TrigReport 135 135 135 0 0 dtpacker >> cmd: TrigReport 135 135 135 0 0 ecalPacker >> cmd: TrigReport 135 135 135 0 0 endjob_step >> cmd: TrigReport 135 135 135 0 0 esDigiToRaw >> cmd: TrigReport 135 135 135 0 0 gemPacker >> cmd: TrigReport 135 135 135 0 0 genCandidatesForMET >> cmd: TrigReport 135 135 135 0 0 genMetCalo >> cmd: TrigReport 135 135 135 0 0 genMetTrue >> cmd: TrigReport 540 135 135 0 0 genParticles >> cmd: TrigReport 135 135 135 0 0 genParticlesForJets >> cmd: TrigReport 135 135 135 0 0 genParticlesForJetsNoNu >> cmd: TrigReport 135 135 135 0 0 genParticlesForMETAllVisible >> cmd: TrigReport 135 135 135 0 0 generatorSmeared >> cmd: TrigReport 135 135 135 0 0 gmtStage2Raw >> cmd: TrigReport 135 135 135 0 0 gtStage2Raw >> cmd: TrigReport 135 135 135 0 0 hcalRawDataVME >> cmd: TrigReport 135 135 135 0 0 hcalRawDatauHTR >> cmd: TrigReport 1485 135 135 0 0 mix >> cmd: TrigReport 3240 135 135 0 0 mixData >> cmd: TrigReport 0 0 0 0 0 omtfStage2Raw >> cmd: TrigReport 135 135 135 0 0 randomEngineStateProducer >> cmd: TrigReport 135 135 135 0 0 rawDataCollector >> cmd: TrigReport 135 135 135 0 0 rpcpacker >> cmd: TrigReport 135 135 135 0 0 siPixelRawData >> cmd: TrigReport 135 135 135 0 0 simBmtfDigis >> cmd: TrigReport 540 135 135 0 0 simCaloStage2Digis >> cmd: TrigReport 270 135 135 0 0 simCaloStage2Layer1Digis >> cmd: TrigReport 405 135 135 0 0 simCscTriggerPrimitiveDigis >> cmd: TrigReport 270 135 135 0 0 simDtTriggerPrimitiveDigis >> cmd: TrigReport 135 135 135 0 0 simEmtfDigis >> cmd: TrigReport 135 135 135 0 0 simGmtCaloSumDigis >> cmd: TrigReport 810 135 135 0 0 simGmtStage2Digis >> cmd: TrigReport 135 135 135 0 0 simGtExtFakeStage2Digis >> cmd: TrigReport 135 135 135 0 0 simGtStage2Digis >> cmd: TrigReport 0 0 0 0 0 simHcalTriggerPrimitiveDigis >> cmd: TrigReport 675 135 135 0 0 simMuonCSCDigis >> cmd: TrigReport 270 135 135 0 0 simMuonDTDigis >> cmd: TrigReport 270 135 135 0 0 simMuonGEMDigis >> cmd: TrigReport 0 0 0 0 0 simMuonGEMPadDigiClusters >> cmd: TrigReport 135 135 135 0 0 simMuonGEMPadDigis >> cmd: TrigReport 270 135 135 0 0 simMuonRPCDigis >> cmd: TrigReport 135 135 135 0 0 simOmtfDigis >> cmd: TrigReport 270 135 135 0 0 simTwinMuxDigis >> cmd: >> cmd: TimeReport ---------- Event Summary ---[sec]---- >> cmd: TimeReport event loop CPU/event = 0.308648 >> cmd: TimeReport event loop Real/event = 2.579174 >> cmd: TimeReport sum Streams Real/event = 14.844369 >> cmd: TimeReport efficiency CPU/Real/thread = 0.019945 >> cmd: >> cmd: TimeReport ---------- Path Summary ---[Real sec]---- >> cmd: TimeReport per event per exec Name >> cmd: TimeReport 0.000000 0.000000 digitisation_step >> cmd: TimeReport 0.000000 0.000000 datamixing_step >> cmd: TimeReport 0.000000 0.000000 L1simulation_step >> cmd: TimeReport 0.000000 0.000000 digi2raw_step >> cmd: TimeReport per event per exec Name >> cmd: >> cmd: TimeReport -------End-Path Summary ---[Real sec]---- >> cmd: TimeReport per event per exec Name >> cmd: TimeReport 0.000000 0.000000 endjob_step >> cmd: TimeReport 14.841514 14.841514 PREMIXRAWoutput_step >> cmd: TimeReport per event per exec Name >> cmd: >> cmd: TimeReport ---------- Modules in Path: digitisation_step ---[Real sec]---- >> cmd: TimeReport per event per visit Name >> cmd: >> cmd: TimeReport ---------- Modules in Path: datamixing_step ---[Real sec]---- >> cmd: TimeReport per event per visit Name >> cmd: >> cmd: TimeReport ---------- Modules in Path: L1simulation_step ---[Real sec]---- >> cmd: TimeReport per event per visit Name >> cmd: >> cmd: TimeReport ---------- Modules in Path: digi2raw_step ---[Real sec]---- >> cmd: TimeReport per event per visit Name >> cmd: TimeReport per event per visit Name >> cmd: >> cmd: TimeReport ------ Modules in End-Path: endjob_step ---[Real sec]---- >> cmd: TimeReport per event per visit Name >> cmd: >> cmd: TimeReport ------ Modules in End-Path: PREMIXRAWoutput_step ---[Real sec]---- >> cmd: TimeReport per event per visit Name >> cmd: TimeReport 0.499614 0.499614 PREMIXRAWoutput >> cmd: TimeReport per event per visit Name >> cmd: >> cmd: TimeReport ---------- Module Summary ---[Real sec]---- >> cmd: TimeReport per event per exec per visit Name >> cmd: TimeReport 0.014291 0.014291 0.014291 DMEcalDigis >> cmd: TimeReport 0.003284 0.003284 0.003284 DMEcalPreshowerDigis >> cmd: TimeReport 0.048745 0.048745 0.048745 DMEcalTriggerPrimitiveDigis >> cmd: TimeReport 0.000953 0.000953 0.000953 DMHcalDigis >> cmd: TimeReport 0.000000 0.000000 0.000000 DMHcalTTPDigis >> cmd: TimeReport 0.013818 0.013818 0.013818 DMHcalTriggerPrimitiveDigis >> cmd: TimeReport 0.000002 0.000002 0.000002 L1simulation_step >> cmd: TimeReport 0.000000 0.000000 0.000000 MEtoEDMConverter >> cmd: TimeReport 0.499614 0.499614 0.499614 PREMIXRAWoutput >> cmd: TimeReport 0.000014 0.000014 0.000014 PREMIXRAWoutput_step >> cmd: TimeReport 0.042415 0.042415 0.042415 SiStripDigiToRaw >> cmd: TimeReport 0.000003 0.000003 0.000003 TriggerResults >> cmd: TimeReport 0.000058 0.000058 0.000058 addPileupInfo >> cmd: TimeReport 0.000959 0.000959 0.000959 ak4GenJets >> cmd: TimeReport 0.000857 0.000857 0.000857 ak4GenJetsNoNu >> cmd: TimeReport 0.001011 0.001011 0.001011 ak8GenJets >> cmd: TimeReport 0.000982 0.000982 0.000982 ak8GenJetsNoNu >> cmd: TimeReport 0.001876 0.001876 0.001876 bmtfStage2Raw >> cmd: TimeReport 0.000820 0.000820 0.000820 caloLayer1RawFed1354 >> cmd: TimeReport 0.000728 0.000728 0.000728 caloLayer1RawFed1356 >> cmd: TimeReport 0.000746 0.000746 0.000746 caloLayer1RawFed1358 >> cmd: TimeReport 0.000237 0.000237 0.000237 caloStage2Raw >> cmd: TimeReport 0.053373 0.053373 0.053373 cscpacker >> cmd: TimeReport 0.000002 0.000002 0.000002 datamixing_step >> cmd: TimeReport 0.000001 0.000001 0.000001 digi2raw_step >> cmd: TimeReport 0.000010 0.000010 0.000010 digitisation_step >> cmd: TimeReport 0.000563 0.000563 0.000563 dtpacker >> cmd: TimeReport 0.013202 0.013202 0.013202 ecalPacker >> cmd: TimeReport 0.000002 0.000002 0.000002 endjob_step >> cmd: TimeReport 0.003247 0.003247 0.003247 esDigiToRaw >> cmd: TimeReport 0.000501 0.000501 0.000501 gemPacker >> cmd: TimeReport 0.000583 0.000583 0.000583 genCandidatesForMET >> cmd: TimeReport 0.000124 0.000124 0.000124 genMetCalo >> cmd: TimeReport 0.000121 0.000121 0.000121 genMetTrue >> cmd: TimeReport 0.033636 0.033636 0.033636 genParticles >> cmd: TimeReport 0.000519 0.000519 0.000519 genParticlesForJets >> cmd: TimeReport 0.000417 0.000417 0.000417 genParticlesForJetsNoNu >> cmd: TimeReport 0.000417 0.000417 0.000417 genParticlesForMETAllVisible >> cmd: TimeReport 0.000005 0.000005 0.000005 generatorSmeared >> cmd: TimeReport 0.000189 0.000189 0.000189 gmtStage2Raw >> cmd: TimeReport 0.000331 0.000331 0.000331 gtStage2Raw >> cmd: TimeReport 0.000569 0.000569 0.000569 hcalRawDataVME >> cmd: TimeReport 0.004845 0.004845 0.004845 hcalRawDatauHTR >> cmd: TimeReport 4.573173 4.573173 4.573173 mix >> cmd: TimeReport 8.644347 8.644347 8.644347 mixData >> cmd: TimeReport 0.000000 0.000000 0.000000 omtfStage2Raw >> cmd: TimeReport 0.000017 0.000017 0.000017 randomEngineStateProducer >> cmd: TimeReport 0.003100 0.003100 0.003100 rawDataCollector >> cmd: TimeReport 0.006695 0.006695 0.006695 rpcpacker >> cmd: TimeReport 0.043418 0.043418 0.043418 siPixelRawData >> cmd: TimeReport 0.074803 0.074803 0.074803 simBmtfDigis >> cmd: TimeReport 0.007838 0.007838 0.007838 simCaloStage2Digis >> cmd: TimeReport 0.002559 0.002559 0.002559 simCaloStage2Layer1Digis >> cmd: TimeReport 0.021498 0.021498 0.021498 simCscTriggerPrimitiveDigis >> cmd: TimeReport 0.010040 0.010040 0.010040 simDtTriggerPrimitiveDigis >> cmd: TimeReport 0.017563 0.017563 0.017563 simEmtfDigis >> cmd: TimeReport 0.003894 0.003894 0.003894 simGmtCaloSumDigis >> cmd: TimeReport 0.000762 0.000762 0.000762 simGmtStage2Digis >> cmd: TimeReport 0.001031 0.001031 0.001031 simGtExtFakeStage2Digis >> cmd: TimeReport 0.006606 0.006606 0.006606 simGtStage2Digis >> cmd: TimeReport 0.000000 0.000000 0.000000 simHcalTriggerPrimitiveDigis >> cmd: TimeReport 0.207007 0.207007 0.207007 simMuonCSCDigis >> cmd: TimeReport 0.000547 0.000547 0.000547 simMuonDTDigis >> cmd: TimeReport 0.000116 0.000116 0.000116 simMuonGEMDigis >> cmd: TimeReport 0.000000 0.000000 0.000000 simMuonGEMPadDigiClusters >> cmd: TimeReport 0.000012 0.000012 0.000012 simMuonGEMPadDigis >> cmd: TimeReport 0.108688 0.108688 0.108688 simMuonRPCDigis >> cmd: TimeReport 0.007119 0.007119 0.007119 simOmtfDigis >> cmd: TimeReport 0.001006 0.001006 0.001006 simTwinMuxDigis >> cmd: TimeReport per event per exec per visit Name >> cmd: >> cmd: T---Report end! >> cmd: >> cmd: TimeReport> Time report complete in 564.755 seconds >> cmd: Time Summary: >> cmd: - Min event: 2.23598 >> cmd: - Max event: 264.522 >> cmd: - Avg event: 14.8416 >> cmd: - Total loop: 346.264 >> cmd: - Total init: 216.482 >> cmd: - Total job: 564.755 >> cmd: - EventSetup Lock: 255.525 >> cmd: - EventSetup Get: 61.1961 >> cmd: Event Throughput: 0.389876 ev/s >> cmd: CPU Summary: >> cmd: - Total loop: 1057.77 >> cmd: - Total init: 20.016 >> cmd: - Total extra: 0 >> cmd: - Total job: 1078.43 >> cmd: Processing Summary: >> cmd: - Number of Events: 135 >> cmd: - Number of Global Begin Lumi Calls: 1 >> cmd: - Number of Global Begin Run Calls: 1 >> cmd: >> cmd: >> cmd: ============================================= >> cmd: >> cmd: MessageLogger Summary >> cmd: >> cmd: type category sev module subroutine count total >> cmd: ---- -------------------- -- ---------------- ---------------- ----- ----- >> cmd: 1 XrdAdaptor -w PreMixingModule: 1 1 >> cmd: 2 TimeReport -e AfterModEndJob 1 1 >> cmd: 3 fileAction -s PreMixingModule: 18 18 >> cmd: 4 fileAction -s PreMixingModule: 12 12 >> cmd: 5 fileAction -s PreMixingModule: 6 6 >> cmd: 6 fileAction -s file_close 1 1 >> cmd: 7 fileAction -s file_open 2 2 >> cmd: >> cmd: type category Examples: run/evt run/evt run/evt >> cmd: ---- -------------------- ---------------- ---------------- ---------------- >> cmd: 1 XrdAdaptor pre-events >> cmd: 2 TimeReport PostGlobalEndRun >> cmd: 3 fileAction 1/2 1/15 1/5 >> cmd: 4 fileAction pre-events pre-events pre-events >> cmd: 5 fileAction PostGlobalEndRun PostGlobalEndRun PostGlobalEndRun >> cmd: 6 fileAction PostGlobalEndRun >> cmd: 7 fileAction pre-events pre-events >> cmd: >> cmd: Severity # Occurrences Total Occurrences >> cmd: -------- ------------- ----------------- >> cmd: Warning 1 1 >> cmd: Error 1 1 >> cmd: System 39 39 >> cmd: >> cmd: dropped waiting message count 0 >>> executable returned with exit code 0. @ Mon Mar 8 13:31:28 2021 >>> executing 'timeout 300 hdfs dfs -fs hdfs://eddie.crc.nd.edu:19000 -put DIGI-00000.root /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/DIGI-00000_4427.root' @ Mon Mar 8 13:31:40 2021 >> using /disk/vc3-root/tmp/worker-230547-19097/t.4427/cctools-temp-t.4427.K1sOGv/tmpsOPsjo to store command output >> cmd: timeout: failed to run command 'hdfs': No such file or directory >>> Checking output file transfer. @ Mon Mar 8 13:31:40 2021 >>> executing 'env XRD_LOGLEVEL=Debug xrdcp DIGI-00000.root root://deepthought.crc.nd.edu//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/DIGI-00000_4427.root' @ Mon Mar 8 13:31:40 2021 >> using /disk/vc3-root/tmp/worker-230547-19097/t.4427/cctools-temp-t.4427.K1sOGv/tmpOTcf4_ to store command output >> cmd: [2021-03-08 13:31:41.218761 -0500][Warning][Utility ] Unable to process global config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-08 13:31:41.219906 -0500][Debug ][Utility ] Unable to process user config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-08 13:31:41.220095 -0500][Debug ][PlugInMgr ] Initializing plug-in manager... >> cmd: [2021-03-08 13:31:41.220152 -0500][Debug ][PlugInMgr ] No default plug-in, loading plug-in configs... >> cmd: [2021-03-08 13:31:41.220203 -0500][Debug ][PlugInMgr ] Processing plug-in definitions in /etc/xrootd/client.plugins.d... >> cmd: [2021-03-08 13:31:41.220310 -0500][Debug ][PlugInMgr ] Unable to process directory /etc/xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-08 13:31:41.220684 -0500][Debug ][PlugInMgr ] Processing plug-in definitions in /tmp/runos_singularity_home-156111327175073305228293973577920660602/.xrootd/client.plugins.d... >> cmd: [2021-03-08 13:31:41.220801 -0500][Debug ][PlugInMgr ] Unable to process directory /tmp/runos_singularity_home-156111327175073305228293973577920660602/.xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-03-08 13:31:41.221119 -0500][Debug ][Poller ] Available pollers: built-in >> cmd: [2021-03-08 13:31:41.221178 -0500][Debug ][Poller ] Attempting to create a poller according to preference: built-in >> cmd: [2021-03-08 13:31:41.221228 -0500][Debug ][Poller ] Creating poller: built-in >> cmd: [2021-03-08 13:31:41.221283 -0500][Debug ][Poller ] Creating and starting the built-in poller... >> cmd: [2021-03-08 13:31:41.221680 -0500][Debug ][Poller ] Using 1 poller threads >> cmd: [2021-03-08 13:31:41.221753 -0500][Debug ][TaskMgr ] Starting the task manager... >> cmd: [2021-03-08 13:31:41.221922 -0500][Debug ][TaskMgr ] Task manager started >> cmd: [2021-03-08 13:31:41.221983 -0500][Debug ][JobMgr ] Starting the job manager... >> cmd: [2021-03-08 13:31:41.222309 -0500][Debug ][JobMgr ] Job manager started, 3 workers >> cmd: [2021-03-08 13:31:41.222374 -0500][Debug ][TaskMgr ] Registering task: "FileTimer task" to be run at: [2021-03-08 13:31:41 -0500] >> cmd: [2021-03-08 13:31:41.222469 -0500][Debug ][PostMaster ] Creating new channel to: deepthought.crc.nd.edu:1094 1 stream(s) >> cmd: [2021-03-08 13:31:41.222546 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-03-08 13:31:41.223537 -0500][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" to be run at: [2021-03-08 13:31:56 -0500] >> cmd: [2021-03-08 13:31:41.224536 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-03-08 13:31:41.224698 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-03-08 13:31:41.224806 -0500][Debug ][Poller ] Adding socket 0x1836180 to the poller >> cmd: [2021-03-08 13:31:41.225128 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2021-03-08 13:31:41.225248 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-03-08 13:31:41.225831 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Got the server hand shake response (type: manager [], protocol version 400) >> cmd: [2021-03-08 13:31:41.226030 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] kXR_protocol successful (type: manager [], protocol version 400) >> cmd: [2021-03-08 13:31:41.228908 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdcp&xrd.info=&xrd.hostname=proteus1.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-03-08 13:31:41.229288 -0500][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Logged in, session: 05780000a30d0000a2020000ff780000 >> cmd: [2021-03-08 13:31:41.229383 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream 0 connected. >> cmd: [2021-03-08 13:31:41.229441 -0500][Debug ][Utility ] Monitor library name not set. No monitoring >> cmd: [2021-03-08 13:31:41.688472 -0500][Debug ][TaskMgr ] Registering task: "WaitTask for: 0x0x1831170" to be run at: [2021-03-08 13:31:46 -0500] >> cmd: [2021-03-08 13:31:46.224786 -0500][Debug ][TaskMgr ] Done with task: "WaitTask for: 0x0x1831170" >> cmd: [2021-03-08 13:31:46.225933 -0500][Debug ][XRootD ] [deepthought.crc.nd.edu:1094] Handling error while processing kXR_stat (path: /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/DIGI-00000_4427.root, flags: none): [ERROR] Error response: No such file or directory. >> cmd: [2021-03-08 13:31:46.226247 -0500][Debug ][Utility ] CopyProcess: 2 jobs to prepare >> cmd: [2021-03-08 13:31:46.227095 -0500][Debug ][XRootD ] [deepthought.crc.nd.edu:1094] Handling error while processing kXR_stat (path: /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/DIGI-00000_4427.root, flags: none): [ERROR] Error response: No such file or directory. >> cmd: [2021-03-08 13:31:46.227257 -0500][Debug ][Utility ] Creating a classic copy job, from file://localhost/disk/vc3-root/tmp/worker-230547-19097/t.4427/DIGI-00000.root to root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/DIGI-00000_4427.root >> cmd: [2021-03-08 13:31:46.227412 -0500][Debug ][Utility ] Opening file://localhost/disk/vc3-root/tmp/worker-230547-19097/t.4427/DIGI-00000.root for reading >> cmd: [2021-03-08 13:31:46.227498 -0500][Debug ][File ] [0x1836640@file://localhost/disk/vc3-root/tmp/worker-230547-19097/t.4427/DIGI-00000.root] Sending an open command >> cmd: [2021-03-08 13:31:46.227991 -0500][Debug ][File ] [0x1836640@file://localhost/disk/vc3-root/tmp/worker-230547-19097/t.4427/DIGI-00000.root] Open has returned with status [SUCCESS] >> cmd: [2021-03-08 13:31:46.228047 -0500][Debug ][File ] [0x1836640@file://localhost/disk/vc3-root/tmp/worker-230547-19097/t.4427/DIGI-00000.root] successfully opened at localhost, handle: 0x15, session id: 1 >> cmd: [2021-03-08 13:31:46.228181 -0500][Debug ][Utility ] Opening root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/DIGI-00000_4427.root?oss.asize=316698250 for writing >> cmd: [2021-03-08 13:31:46.228261 -0500][Debug ][File ] [0x1837e40@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/DIGI-00000_4427.root?oss.asize=316698250] Sending an open command >> cmd: [2021-03-08 13:31:46.229041 -0500][Debug ][PostMaster ] Creating new channel to: primeradiant04.crc.nd.edu:1096 1 stream(s) >> cmd: [2021-03-08 13:31:46.229114 -0500][Debug ][PostMaster ] [primeradiant04.crc.nd.edu:1096 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-03-08 13:31:46.230891 -0500][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: primeradiant04.crc.nd.edu:1096" to be run at: [2021-03-08 13:32:01 -0500] >> cmd: [2021-03-08 13:31:46.231825 -0500][Debug ][PostMaster ] [primeradiant04.crc.nd.edu:1096] Found 1 address(es): [::ffff:149.165.243.12]:1096 >> cmd: [2021-03-08 13:31:46.231961 -0500][Debug ][AsyncSock ] [primeradiant04.crc.nd.edu:1096 #0.0] Attempting connection to [::ffff:149.165.243.12]:1096 >> cmd: [2021-03-08 13:31:46.232061 -0500][Debug ][Poller ] Adding socket 0xb00018a0 to the poller >> cmd: [2021-03-08 13:31:46.232189 -0500][Debug ][AsyncSock ] [primeradiant04.crc.nd.edu:1096 #0.0] Async connection call returned >> cmd: [2021-03-08 13:31:46.232345 -0500][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-03-08 13:31:46.232732 -0500][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Got the server hand shake response (type: server [], protocol version 400) >> cmd: [2021-03-08 13:31:46.232907 -0500][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] kXR_protocol successful (type: server [], protocol version 400) >> cmd: [2021-03-08 13:31:46.235444 -0500][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdcp&xrd.info=&xrd.hostname=proteus1.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-03-08 13:31:46.235770 -0500][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Logged in, session: 241e0000a6100000de0000003c1f0000 >> cmd: [2021-03-08 13:31:46.235819 -0500][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Authentication is required: &P=gsi,v:10400,c:ssl,ca:ba240aa8.0|f5f0dfc2.0 >> cmd: [2021-03-08 13:31:46.235866 -0500][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Sending authentication data >> cmd: [2021-03-08 13:31:46.241928 -0500][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Trying to authenticate using gsi >> cmd: [2021-03-08 13:31:46.323469 -0500][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Sending more authentication data for gsi >> cmd: [2021-03-08 13:31:46.329862 -0500][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Authenticated with gsi. >> cmd: [2021-03-08 13:31:46.329987 -0500][Debug ][PostMaster ] [primeradiant04.crc.nd.edu:1096 #0] Stream 0 connected. >> cmd: [2021-03-08 13:32:46.484915 -0500][Debug ][AsyncSock ] [primeradiant04.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2021-03-08 13:32:46.485279 -0500][Debug ][Poller ] <[::ffff:10.32.75.147]:60406><--><[::ffff:149.165.243.12]:1096> Removing socket from the poller >> cmd: [2021-03-08 13:32:46.485983 -0500][Debug ][PostMaster ] [primeradiant04.crc.nd.edu:1096 #0] Recovering error for stream #0: [ERROR] Socket error. >> cmd: [2021-03-08 13:32:46.486145 -0500][Debug ][PostMaster ] [primeradiant04.crc.nd.edu:1096 #0] Reporting disconnection to queued message handlers. >> cmd: [2021-03-08 13:32:46.486299 -0500][Debug ][XRootD ] [primeradiant04.crc.nd.edu:1096] Handling error while processing kXR_open (file: /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/DIGI-00000_4427.root?oss.asize=316698250, mode: 0644, flags: kXR_new kXR_open_updt kXR_async kXR_retstat ): [ERROR] Socket error. >> cmd: [2021-03-08 13:32:46.488380 -0500][Debug ][XRootD ] [deepthought.crc.nd.edu:1094] Handling error while processing kXR_open (file: /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/DIGI-00000_4427.root?oss.asize=316698250&tried=primeradiant04.crc.nd.edu, mode: 0644, flags: kXR_new kXR_open_updt kXR_async kXR_retstat ): [ERROR] Error response: No such file or directory. >> cmd: [2021-03-08 13:32:46.488538 -0500][Debug ][File ] [0x1837e40@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/DIGI-00000_4427.root?oss.asize=316698250] Open has returned with status [ERROR] Server responded with an error: [3011] Unable to create new file; file already exists. >> cmd: [2021-03-08 13:32:46.488653 -0500][Debug ][File ] [0x1837e40@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/DIGI-00000_4427.root?oss.asize=316698250] Error while opening at deepthought.crc.nd.edu:1094: [ERROR] Server responded with an error: [3011] Unable to create new file; file already exists. >> cmd: [2021-03-08 13:32:46.489046 -0500][Debug ][File ] [0x1836640@file://localhost/disk/vc3-root/tmp/worker-230547-19097/t.4427/DIGI-00000.root] Sending a close command for handle 0x15 to localhost >> cmd: [2021-03-08 13:32:46.489476 -0500][Debug ][File ] [0x1836640@file://localhost/disk/vc3-root/tmp/worker-230547-19097/t.4427/DIGI-00000.root] Close returned from localhost with: [SUCCESS] >> cmd: [0B/0B][100%][==================================================][0B/s] >> cmd: Run: [ERROR] Server responded with an error: [3011] Unable to create new file; file already exists. >> cmd: >> cmd: [2021-03-08 13:32:46.545336 -0500][Debug ][JobMgr ] Stopping the job manager... >> cmd: [2021-03-08 13:32:46.549380 -0500][Debug ][JobMgr ] Job manager stopped >> cmd: [2021-03-08 13:32:46.549571 -0500][Debug ][TaskMgr ] Stopping the task manager... >> cmd: [2021-03-08 13:32:46.550337 -0500][Debug ][TaskMgr ] Task manager stopped >> cmd: [2021-03-08 13:32:46.550445 -0500][Debug ][Poller ] Stopping the poller... >> cmd: [2021-03-08 13:32:46.550931 -0500][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" >> cmd: [2021-03-08 13:32:46.551012 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-03-08 13:32:46.551087 -0500][Debug ][Poller ] <[::ffff:10.32.75.147]:44656><--><[::ffff:129.74.85.55]:1094> Removing socket from the poller >> cmd: [2021-03-08 13:32:46.551198 -0500][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Destroying stream >> cmd: [2021-03-08 13:32:46.551256 -0500][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-03-08 13:32:46.551314 -0500][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: primeradiant04.crc.nd.edu:1096" >> cmd: [2021-03-08 13:32:46.551425 -0500][Debug ][AsyncSock ] [primeradiant04.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2021-03-08 13:32:46.551497 -0500][Debug ][PostMaster ] [primeradiant04.crc.nd.edu:1096 #0] Destroying stream >> cmd: [2021-03-08 13:32:46.551568 -0500][Debug ][AsyncSock ] [primeradiant04.crc.nd.edu:1096 #0.0] Closing the socket >>> Checking output file transfer. @ Mon Mar 8 13:32:46 2021 >>> executing '/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin/gfal-copy -f file:///disk/vc3-root/tmp/worker-230547-19097/t.4427/DIGI-00000.root gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/DIGI-00000_4427.root' @ Mon Mar 8 13:32:46 2021 >> using /disk/vc3-root/tmp/worker-230547-19097/t.4427/cctools-temp-t.4427.K1sOGv/tmpETpvbY to store command output >> cmd: Copying 316698250 bytes file:///disk/vc3-root/tmp/worker-230547-19097/t.4427/DIGI-00000.root => gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/DIGI-00000_4427.root >>> Checking output file transfer. @ Mon Mar 8 13:32:57 2021 >>> executing 'timeout 300 hdfs dfs -fs hdfs://eddie.crc.nd.edu:19000 -stat "Size: %b" /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/DIGI-00000_4427.root' @ Mon Mar 8 13:32:57 2021 >> using /disk/vc3-root/tmp/worker-230547-19097/t.4427/cctools-temp-t.4427.K1sOGv/tmp2OyHOR to store command output >> cmd: timeout: failed to run command 'hdfs': No such file or directory >>>>> checking output for DIGI-00000.root failed: timeout: failed to run command 'hdfs': No such file or directory @ Mon Mar 8 13:32:57 2021 >>> executing 'timeout 300 xrdfs deepthought.crc.nd.edu stat /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/DIGI-00000_4427.root' @ Mon Mar 8 13:32:57 2021 >> using /disk/vc3-root/tmp/worker-230547-19097/t.4427/cctools-temp-t.4427.K1sOGv/tmpJuHTbn to store command output >> cmd: Path: /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/DIGI-00000_4427.root >> cmd: Id: 0 >> cmd: Size: 316698250 >> cmd: MTime: 2021-03-08 18:32:57 >> cmd: Flags: 24 (Offline|IsReadable) >>> File transfer successful! @ Mon Mar 8 13:33:04 2021 >>> Checking output files... @ Mon Mar 8 13:33:04 2021 >>> Checking DIGI-00000.root => digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/DIGI-00000_4427.root @ Mon Mar 8 13:33:04 2021 >>> executing 'timeout 300 hdfs dfs -fs hdfs://eddie.crc.nd.edu:19000 -stat "Size: %b" /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/DIGI-00000_4427.root' @ Mon Mar 8 13:33:04 2021 >> using /disk/vc3-root/tmp/worker-230547-19097/t.4427/cctools-temp-t.4427.K1sOGv/tmpUEIcQ5 to store command output >> cmd: timeout: failed to run command 'hdfs': No such file or directory >>>>> checking output for DIGI-00000.root failed: timeout: failed to run command 'hdfs': No such file or directory @ Mon Mar 8 13:33:04 2021 >>> executing 'timeout 300 xrdfs deepthought.crc.nd.edu stat /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/DIGI-00000_4427.root' @ Mon Mar 8 13:33:04 2021 >> using /disk/vc3-root/tmp/worker-230547-19097/t.4427/cctools-temp-t.4427.K1sOGv/tmp57BLYQ to store command output >> cmd: Path: /store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/DIGI-00000_4427.root >> cmd: Id: 0 >> cmd: Size: 0 >> cmd: MTime: 2021-03-08 18:33:04 >> cmd: Flags: 24 (Offline|IsReadable) >>>>> size mismatch after transfer remote size: 0 local size: 316698250 @ Mon Mar 8 13:33:05 2021 >>> executing '/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin/gfal-stat gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/DIGI-00000_4427.root' @ Mon Mar 8 13:33:05 2021 >> using /disk/vc3-root/tmp/worker-230547-19097/t.4427/cctools-temp-t.4427.K1sOGv/tmp5NQY5y to store command output >> cmd: File: 'gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/DIGI-00000_4427.root' >> cmd: Size: 0 regular file >> cmd: Access: (0664/-rw-rw-r--) Uid: 230547 Gid: 0 >> cmd: Access: 1969-12-31 19:00:00.000000 >> cmd: Modify: 2021-03-08 13:33:04.000000 >> cmd: Change: 1969-12-31 19:00:00.000000 >>>>> size mismatch after transfer remote size: 0 local size: 316698250 @ Mon Mar 8 13:33:07 2021 >>> executing '/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin/gfal-stat gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/DIGI-00000_4427.root' @ Mon Mar 8 13:33:07 2021 >> using /disk/vc3-root/tmp/worker-230547-19097/t.4427/cctools-temp-t.4427.K1sOGv/tmpVzWhfQ to store command output >> cmd: File: 'gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/DIGI-00000_4427.root' >> cmd: Size: 0 regular file >> cmd: Access: (0664/-rw-rw-r--) Uid: 230547 Gid: 0 >> cmd: Access: 1969-12-31 19:00:00.000000 >> cmd: Modify: 2021-03-08 13:33:04.000000 >> cmd: Change: 1969-12-31 19:00:00.000000 >>>>> size mismatch after transfer remote size: 0 local size: 316698250 @ Mon Mar 8 13:33:09 2021 >>> executing 'stat /hadoop/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/DIGI-00000_4427.root' @ Mon Mar 8 13:33:09 2021 >> using /disk/vc3-root/tmp/worker-230547-19097/t.4427/cctools-temp-t.4427.K1sOGv/tmpeki2Mh to store command output >> cmd: stat: cannot stat '/hadoop/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/DIGI-00000_4427.root': No such file or directory >>>>> checking output for DIGI-00000.root failed: stat: cannot stat '/hadoop/store/user/kmohrman/postLHE_step/FullR2Studies/ULChecks/ttXJet-tXq_testFullULWFonCRC_ULCheck_UL17/v5/digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/DIGI-00000_4427.root': No such file or directory @ Mon Mar 8 13:33:09 2021 >> trace: Traceback (most recent call last): >> trace: File "task.py", line 268, in wrapper >> trace: result = fct(data, *args, **kwargs) >> trace: File "task.py", line 404, in check_outputs >> trace: raise IOError("could not verify output file '{}'".format(remote)) >> trace: IOError: could not verify output file 'digi_step_ttllNuNuJetNoHiggs_testUpdateGenproddim6TopMay20GST_run2/DIGI-00000_4427.root' >>>>> call to 'check_outputs' failed, exiting with exit code 211 @ Mon Mar 8 13:33:09 2021 Mon Mar 8 13:21:58 2021: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Mon Mar 8 13:21:58 2021: ApMon[WARNING]: Not sending parameters since no destination is defined. Mon Mar 8 13:21:58 2021: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. Mon Mar 8 13:31:28 2021: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Mon Mar 8 13:31:29 2021: ApMon[WARNING]: Not sending parameters since no destination is defined. Mon Mar 8 13:31:29 2021: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. >> Execution time 704 >> Exiting with code 211 >> Reporting ExeExitCode 0 >> Reporting StageOutSE T3_US_NotreDame >> Reporting StageOutExitCode 211 Mon Mar 8 13:33:09 2021: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Mon Mar 8 13:33:10 2021: ApMon[WARNING]: Not sending parameters since no destination is defined. Mon Mar 8 13:33:10 2021: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. ==== working directory after execution @ Mon Mar 8 13:33:10 EST 2021 ==== == dir: total 317896 == dir: drwxr-xr-x 18 kmohrman campus 215 Mar 8 13:21 CMSSW_10_6_17_patch1 == dir: -rw-r--r-- 1 kmohrman campus 316698250 Mar 8 13:31 DIGI-00000.root == dir: -rw-r--r-- 3 kmohrman campus 3932158 Mar 8 13:20 UL17_DIGI_cfg.py == dir: -rw-r--r-- 1 kmohrman campus 3933676 Mar 8 13:22 UL17_DIGI_cfg_mod.py == dir: drwxr-xr-x 2 kmohrman campus 71 Mar 8 13:20 bin == dir: -rwxr-xr-x 3 kmohrman campus 627272 Mar 8 13:20 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 Mar 8 13:20 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 Mar 8 13:33 cctools-temp-t.4427.K1sOGv == dir: -rw------- 1 kmohrman campus 51 Mar 8 13:21 cvmfschecksum.cms-ib.cern.ch == dir: -rw------- 1 kmohrman campus 51 Mar 8 13:21 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 Mar 8 13:21 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 Mar 8 13:20 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 Mar 8 13:20 librmonitor_helper.so.EZKi5G == dir: -rw-r--r-- 2 kmohrman campus 2325 Mar 8 13:20 parameters.json == dir: -rw------- 2 kmohrman campus 9921 Mar 8 13:20 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 Mar 8 13:20 python == dir: -rw-r--r-- 1 kmohrman campus 3572 Mar 8 13:33 report.json == dir: -rw-r--r-- 3 kmohrman campus 570 Mar 8 13:20 report.json.in == dir: -rw-r--r-- 1 kmohrman campus 64850 Mar 8 13:31 report.xml == dir: -rw-r--r-- 1 kmohrman campus 4945 Mar 8 13:33 report.xml.gz == dir: -rw-r--r-- 3 kmohrman campus 593 Mar 8 13:20 sandbox-CMSSW_10_6_17_patch1-slc7_amd64_gcc700.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 37 Mar 8 13:20 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 Mar 8 13:21 t_wrapper_ready == dir: -rw-r--r-- 1 kmohrman campus 11 Mar 8 13:21 t_wrapper_start == dir: -rwxr-xr-x 3 kmohrman campus 47217 Mar 8 13:20 task.py == dir: -rwxr-xr-x 3 kmohrman campus 5986 Mar 8 13:20 wrapper.sh === wrapper done @ Mon Mar 8 13:33:10 EST 2021 === final return status = 211 @ Mon Mar 8 13:33:10 EST 2021