==== wrapper started @ Wed Apr 21 03:04:03 EDT 2021 ==== == startup: hostname: d8civy109.crc.nd.edu == startup: kernel: Linux d8civy109.crc.nd.edu 3.10.0-1160.el7.x86_64 #1 SMP Tue Aug 18 14:50:17 EDT 2020 x86_64 x86_64 x86_64 GNU/Linux ==== tracing google @ Wed Apr 21 03:04:08 EDT 2021 ==== wrapper.sh: line 20: traceroute: command not found ==== environment at startup @ Wed Apr 21 03:04:13 EDT 2021 ==== == env: VC3_VERSION_SED=4.2 == env: CCTOOLS_RESOURCE_PROCESS_START=1618988653457156 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: VC3_ROOT_GZIP=/usr/ == env: SHELL=/bin/sh == env: TERM=xterm-256color == env: MAKEFLAGS=-j4 == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-26533/t.69766/cctools-temp-t.69766.aBSn9d == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-26533/t.69766/librmonitor_helper.so.Gv7XgW == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: USER=kmohrman == env: TEMP=/disk/vc3-root/tmp/worker-230547-26533/t.69766/cctools-temp-t.69766.aBSn9d == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: LD_LIBRARY_PATH=/.singularity.d/libs == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_ROOT_MAKE=/usr/ == env: VC3_DISTFILES=/disk/vc3-distfiles == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-26533/cache/tmp == env: VC3_VERSION_TAR=1.26 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-tNIz3j == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: VC3_VERSION_GZIP=1.5 == env: VC3_ENV_TAG_GLOBAL=26280 == env: PATH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-tNIz3j == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PWD=/disk/vc3-root/tmp/worker-230547-26533/t.69766 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_FULL_SED=4.2.2 == env: VC3_VERSION_WHICH=2.20 == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-26533 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_ROOT_SED=/usr/ == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: CXX=g++ == env: SHLVL=3 == env: HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_MAKE=3.82 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: DISK=3000 == env: MEMORY=3000 == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: TMP=/disk/vc3-root/tmp/worker-230547-26533/t.69766/cctools-temp-t.69766.aBSn9d == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_VERSION_PKG_CONFIG=0.27 == env: VC3_ROOT_TAR=/usr/ == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-tNIz3j.wrapper == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: CC=gcc == env: CORES=6 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CCTOOLS_RESOURCE_MONITOR_INFO=1024 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_CRC_postLHE_crc.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=18551 == env: _=/usr/bin/env ==== cpu info @ Wed Apr 21 03:04:18 EDT 2021 ==== == cpu: processor : 0 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3174.780 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 0 == cpu: cpu cores : 8 == cpu: apicid : 0 == cpu: initial apicid : 0 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.44 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 1 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3077.343 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 1 == cpu: cpu cores : 8 == cpu: apicid : 2 == cpu: initial apicid : 2 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.44 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 2 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3231.750 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 2 == cpu: cpu cores : 8 == cpu: apicid : 4 == cpu: initial apicid : 4 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.44 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 3 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3166.052 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 3 == cpu: cpu cores : 8 == cpu: apicid : 6 == cpu: initial apicid : 6 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.44 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 4 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3069.409 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 4 == cpu: cpu cores : 8 == cpu: apicid : 8 == cpu: initial apicid : 8 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.44 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 5 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3101.464 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 5 == cpu: cpu cores : 8 == cpu: apicid : 10 == cpu: initial apicid : 10 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.44 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 6 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3127.648 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 6 == cpu: cpu cores : 8 == cpu: apicid : 12 == cpu: initial apicid : 12 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.44 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 7 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3060.205 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 7 == cpu: cpu cores : 8 == cpu: apicid : 14 == cpu: initial apicid : 14 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.44 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 8 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3055.603 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 0 == cpu: cpu cores : 8 == cpu: apicid : 32 == cpu: initial apicid : 32 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.05 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 9 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3087.023 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 1 == cpu: cpu cores : 8 == cpu: apicid : 34 == cpu: initial apicid : 34 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.05 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 10 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3099.877 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 2 == cpu: cpu cores : 8 == cpu: apicid : 36 == cpu: initial apicid : 36 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.05 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 11 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3001.330 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 3 == cpu: cpu cores : 8 == cpu: apicid : 38 == cpu: initial apicid : 38 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.05 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 12 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3000.695 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 4 == cpu: cpu cores : 8 == cpu: apicid : 40 == cpu: initial apicid : 40 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.05 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 13 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3000.854 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 5 == cpu: cpu cores : 8 == cpu: apicid : 42 == cpu: initial apicid : 42 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.05 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 14 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3099.877 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 6 == cpu: cpu cores : 8 == cpu: apicid : 44 == cpu: initial apicid : 44 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.05 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 15 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3001.171 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 7 == cpu: cpu cores : 8 == cpu: apicid : 46 == cpu: initial apicid : 46 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.05 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: === using CVMFS proxy: http://eddie.crc.nd.edu:3128 @ Wed Apr 21 03:04:43 EDT 2021 === using Frontier proxy: http://eddie.crc.nd.edu:3128 @ Wed Apr 21 03:04:43 EDT 2021 === parrot helper: /disk/vc3-root/tmp/worker-230547-26533/t.69766/lib/libparrot_helper.so @ Wed Apr 21 03:04:48 EDT 2021 ==== content of /disk/vc3-root/tmp/worker-230547-26533/cache/tmp @ Wed Apr 21 03:04:48 EDT 2021 ==== == cache: total 28 == cache: drwx------ 261 kmohrman campus 8192 Apr 21 03:04 ex_parrot_kmohrman == cache: -rw-r--r-- 1 kmohrman campus 10 Apr 20 18:56 hot_cache == cache: drwxr-x--- 260 kmohrman campus 8192 Apr 20 18:37 cvmfs === OSG certificate location: /cvmfs/oasis.opensciencegrid.org/mis/certificates @ Wed Apr 21 03:04:53 EDT 2021 === testing parrot usage @ Wed Apr 21 03:04:53 EDT 2021 === parrot OK @ Wed Apr 21 03:04:58 EDT 2021 === starting parrot to access CMSSW... @ Wed Apr 21 03:04:58 EDT 2021 ==== wrapper started @ Wed Apr 21 03:04:58 EDT 2021 ==== == startup: hostname: d8civy109.crc.nd.edu == startup: kernel: Linux d8civy109.crc.nd.edu 3.10.0-1160.el7.x86_64 #1 SMP Tue Aug 18 14:50:17 EDT 2020 x86_64 x86_64 x86_64 GNU/Linux ==== tracing google @ Wed Apr 21 03:04:58 EDT 2021 ==== wrapper.sh: line 20: traceroute: command not found ==== environment at startup @ Wed Apr 21 03:04:58 EDT 2021 ==== == env: VC3_VERSION_SED=4.2 == env: CCTOOLS_RESOURCE_PROCESS_START=1618988698890054 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/usr/ == env: LOBSTER_GFAL_COPY= == env: MAKEFLAGS=-j4 == env: PARROT_HELPER=/disk/vc3-root/tmp/worker-230547-26533/t.69766/lib/libparrot_helper.so == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-26533/t.69766/cctools-temp-t.69766.aBSn9d == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-26533/t.69766/librmonitor_helper.so.Gv7XgW == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: LD_LIBRARY_PATH=/.singularity.d/libs:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-26533/t.69766/cctools-temp-t.69766.aBSn9d == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/usr/ == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-tNIz3j == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-26533/cache/tmp == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: PARROT_CVMFS_REPO= == env: VC3_VERSION_GZIP=1.5 == env: PATH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ENV_TAG_GLOBAL=26280 == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-tNIz3j == env: PWD=/disk/vc3-root/tmp/worker-230547-26533/t.69766 == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_WHICH=2.20 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: LOBSTER_LCG_CP= == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-26533 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/usr/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: CXX=g++ == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: DISK=3000 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-26533/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-26533/cache/tmp/cvmfs == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=3000 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TMP=/disk/vc3-root/tmp/worker-230547-26533/t.69766/cctools-temp-t.69766.aBSn9d == env: PYTHONPATH=python: == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_ROOT_TAR=/usr/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-tNIz3j.wrapper == env: CC=gcc == env: CCTOOLS_RESOURCE_MONITOR_INFO=1024 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=6 == env: PARROT_DEBUG_FLAGS= == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_CRC_postLHE_crc.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=18551 == env: _=/usr/bin/env ==== cpu info @ Wed Apr 21 03:04:59 EDT 2021 ==== == cpu: processor : 0 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 0 == cpu: cpu cores : 8 == cpu: apicid : 0 == cpu: initial apicid : 0 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.44 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 1 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 1 == cpu: cpu cores : 8 == cpu: apicid : 2 == cpu: initial apicid : 2 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.44 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 2 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 2 == cpu: cpu cores : 8 == cpu: apicid : 4 == cpu: initial apicid : 4 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.44 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 3 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 3 == cpu: cpu cores : 8 == cpu: apicid : 6 == cpu: initial apicid : 6 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.44 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 4 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 4 == cpu: cpu cores : 8 == cpu: apicid : 8 == cpu: initial apicid : 8 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.44 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 5 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 5 == cpu: cpu cores : 8 == cpu: apicid : 10 == cpu: initial apicid : 10 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.44 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 6 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 6 == cpu: cpu cores : 8 == cpu: apicid : 12 == cpu: initial apicid : 12 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.44 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 7 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3000.061 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 7 == cpu: cpu cores : 8 == cpu: apicid : 14 == cpu: initial apicid : 14 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.44 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 8 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 0 == cpu: cpu cores : 8 == cpu: apicid : 32 == cpu: initial apicid : 32 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.05 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 9 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 1 == cpu: cpu cores : 8 == cpu: apicid : 34 == cpu: initial apicid : 34 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.05 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 10 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 2 == cpu: cpu cores : 8 == cpu: apicid : 36 == cpu: initial apicid : 36 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.05 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 11 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 3 == cpu: cpu cores : 8 == cpu: apicid : 38 == cpu: initial apicid : 38 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.05 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 12 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.267 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 4 == cpu: cpu cores : 8 == cpu: apicid : 40 == cpu: initial apicid : 40 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.05 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 13 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 5 == cpu: cpu cores : 8 == cpu: apicid : 42 == cpu: initial apicid : 42 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.05 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 14 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 6 == cpu: cpu cores : 8 == cpu: apicid : 44 == cpu: initial apicid : 44 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.05 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 15 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2999.902 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 7 == cpu: cpu cores : 8 == cpu: apicid : 46 == cpu: initial apicid : 46 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5193.05 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: === using parrot @ Wed Apr 21 03:04:59 EDT 2021 === sourcing CMS setup @ Wed Apr 21 03:04:59 EDT 2021 LibCvmfs version 2.4, revision 25 === sourcing OSG setup @ Wed Apr 21 03:05:01 EDT 2021 ==== environment after sourcing startup scripts @ Wed Apr 21 03:05:01 EDT 2021 ==== == env: VC3_VERSION_SED=4.2 == env: MANPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/man:/cvmfs/cms.cern.ch/share/man: == env: CCTOOLS_RESOURCE_PROCESS_START=1618988701227771 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: GFAL_PLUGIN_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/gfal2-plugins/ == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/usr/ == env: LOBSTER_GFAL_COPY=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin/gfal-copy == env: VOMS_USERCONF=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/vomses == env: MAKEFLAGS=-j4 == env: GLOBUS_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-26533/t.69766/cctools-temp-t.69766.aBSn9d == env: PERL5LIB=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5 == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: CVSROOT=:gserver:cmssw.cvs.cern.ch:/local/reps/CMSSW == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-26533/t.69766/librmonitor_helper.so.Gv7XgW == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: X509_CERT_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/certificates == env: SCRAM_ARCH=slc7_amd64_gcc820 == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: LD_LIBRARY_PATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/dcap:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/lcgdm:/.singularity.d/libs:lib:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-26533/t.69766/cctools-temp-t.69766.aBSn9d == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/usr/ == env: OSG_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-tNIz3j == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-26533/cache/tmp == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: SITECONFIG_PATH=/cvmfs/cms.cern.ch/SITECONF/local == env: PARROT_CVMFS_REPO= == env: VC3_VERSION_GZIP=1.5 == env: PATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/sbin:/cvmfs/cms.cern.ch/common:/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ENV_TAG_GLOBAL=26280 == env: CMS_PATH=/cvmfs/cms.cern.ch == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-tNIz3j == env: PWD=/disk/vc3-root/tmp/worker-230547-26533/t.69766 == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_WHICH=2.20 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: X509_VOMS_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/vomsdir == env: LOBSTER_LCG_CP= == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-26533 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/usr/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: CXX=g++ == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: DISK=3000 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-26533/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-26533/cache/tmp/cvmfs == env: GFAL_CONFIG_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/gfal2.d/ == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=3000 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TMP=/disk/vc3-root/tmp/worker-230547-26533/t.69766/cctools-temp-t.69766.aBSn9d == env: PYTHONPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib/python2.7/site-packages:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/python2.7/site-packages:python:python: == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_ROOT_TAR=/usr/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-tNIz3j.wrapper == env: CC=gcc == env: CCTOOLS_RESOURCE_MONITOR_INFO=1024 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=6 == env: PARROT_DEBUG_FLAGS= == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_CRC_postLHE_crc.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=18551 == env: _=/usr/bin/env ==== proxy information @ Wed Apr 21 03:05:01 EDT 2021 ==== == proxy: subject : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman/CN=2747579827 == proxy: issuer : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman == proxy: identity : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman == proxy: type : RFC compliant proxy == proxy: strength : 1024 bits == proxy: path : proxy == proxy: timeleft : 151:12:04 ==== working directory at startup @ Wed Apr 21 03:05:01 EDT 2021 ==== == dir: total 856 == dir: -rw-r--r-- 2 kmohrman campus 3805 Apr 20 18:56 UL17_SIM_cfg.py == dir: drwxr-xr-x 2 kmohrman campus 71 Apr 21 03:04 bin == dir: -rwxr-xr-x 3 kmohrman campus 627272 Apr 20 18:36 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 Apr 21 03:04 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 Apr 21 03:04 cctools-temp-t.69766.aBSn9d == dir: -rw------- 1 kmohrman campus 51 Apr 21 03:04 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 Apr 21 03:05 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 Apr 21 03:04 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 Apr 21 03:04 librmonitor_helper.so.Gv7XgW == dir: -rw-r--r-- 2 kmohrman campus 2065 Apr 21 03:04 parameters.json == dir: -rw------- 2 kmohrman campus 9921 Apr 21 03:04 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 Apr 21 03:04 python == dir: -rw-r--r-- 3 kmohrman campus 570 Apr 20 18:36 report.json.in == dir: -rw-r--r-- 3 kmohrman campus 593 Apr 20 18:36 sandbox-CMSSW_10_6_17_patch1-slc7_amd64_gcc700.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 37 Apr 21 03:04 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 Apr 21 03:04 t_wrapper_start == dir: -rwxr-xr-x 3 kmohrman campus 47217 Apr 20 18:36 task.py == dir: -rwxr-xr-x 3 kmohrman campus 5986 Apr 20 18:36 wrapper.sh === creating new release CMSSW_10_6_17_patch1 for scram arch slc7_amd64_gcc700 @ Wed Apr 21 03:05:01 EDT 2021 WARNING: In non-interactive mode release checks e.g. deprecated releases, production architectures are disabled. === unpacking sandbox-CMSSW_10_6_17_patch1-slc7_amd64_gcc700.tar.bz2 @ Wed Apr 21 03:05:04 EDT 2021 ==== machine load @ Wed Apr 21 03:05:07 EDT 2021 ==== top: unknown option 'M' Usage: top -hv | -bcHiOSs -d secs -n max -u|U user -p pid(s) -o field -w [cols] ==== environment before execution @ Wed Apr 21 03:05:07 EDT 2021 ==== == env: G4LEVELGAMMADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4PhotonEvaporation/5.2/data/PhotonEvaporation5.2 == env: UTM_XSD_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj == env: SRT_G4LEVELGAMMADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4PhotonEvaporation/5.2/data/PhotonEvaporation5.2 == env: VC3_VERSION_SED=4.2 == env: CMSSW_RELEASE_BASE=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1 == env: SCRAMRT_SET=CMSSW:CMSSW_10_6_17_patch1:slc7_amd64_gcc700:V2_2_9_pre13:SRT_ == env: MANPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/man:/cvmfs/cms.cern.ch/share/man: == env: CCTOOLS_RESOURCE_PROCESS_START=1618988707241991 == env: CMSSW_FWLITE_INCLUDE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include == env: SRT_GCC_RUNTIME_ASAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: ROOT_INCLUDE_PATH=/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/include/slc7_amd64_gcc700/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/include/LCG:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mctester/1.25.0a-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dd4hep/v01-10x-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtDesigner:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauolapp/1.1.5-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/charybdis/1.003-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include/SHERPA-MC:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtOpenGL:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtGui:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwig/6.521-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt3Support:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lwtnn/2.4-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4/10.4.3-pafccj2/include/Geant4:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/classlib/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cgal/4.2-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tkonlinesw/4.2.0-1_gcc7-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/starlight/r193-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtCore:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtXml:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mcdb/1.0.3-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libungif/4.1.4-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libtiff/4.0.3-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/highfive/2.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libpng/1.6.16-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pcre/8.37-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/include/xrootd/private:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/vdt/0.4.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/toprex/4.23-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tbb/2019_U3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauola/27.121.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sigcpp/2.6.2-pafccj/include/sigc++-2.0:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sqlite/3.22.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/protobuf/3.5.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pacparser/1.3.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/oracle/12.1.0.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/py2-numpy/1.16.2-nmpfii2/c-api/core/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/meschach/1.2.pCMS1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libuuid/2.22.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libunwind/1.2.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libhepml/0.2.1-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ktjet/1.06-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jimmy/4.2-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jemalloc/5.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hls/2019.08/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj10:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hector/1.3.4_patch1-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libjpeg-turbo/2.0.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/giflib/4.2.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gsl/2.2.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gdbm/1.10-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/freetype/2.5.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftw3/3.3.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftjet/1.5.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/expat/2.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dpm/1.8.0.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vecgeom/v00.05.00-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xerces-c/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xz/5.2.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dcap/2.47.8-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libxml2/2.9.1-pafccj/include/libxml2:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/curl/7.59.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cppunit/1.40.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openssl/1.0.2d-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia6/426-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/photos/215.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/zlib-x86_64/1.2.11-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/bz2lib/1.0.6-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/include/python2.7:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tinyxml2/6.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ittnotify/16.06.18-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj/include:/usr/local/include:/usr/include == env: INTEL_LICENSE_FILE=28518@lxlicen01.cern.ch,28518@lxlicen02.cern.ch,28518@lxlicen03.cern.ch == env: SRT_TEXMFHOME_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/share/Rivet/texmf == env: SRT_GEANT4_PARFULLCMS_CONFIG_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-parfullcms/2014.01.27-pafccj2/share/ParFullCMS == env: GFAL_PLUGIN_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/gfal2-plugins/ == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/usr/ == env: LOBSTER_GFAL_COPY=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin/gfal-copy == env: PDFPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/share == env: CMSSW_FULL_RELEASE_BASE=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17 == env: SRT_TNS_ADMIN_SCRAMRTDEL=/etc == env: VOMS_USERCONF=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/vomses == env: MAKEFLAGS=-j4 == env: ROOT_GCC_TOOLCHAIN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: GLOBUS_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-26533/t.69766/cctools-temp-t.69766.aBSn9d == env: G4FORCENUMBEROFTHREADS=max == env: OPENBLAS_NUM_THREADS=1 == env: SRT_PDFPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/share == env: PERL5LIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5 == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: CMSSW_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms == env: LHAPDF_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/share/LHAPDF == env: CVSROOT=:gserver:cmssw.cvs.cern.ch:/local/reps/CMSSW == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-26533/t.69766/librmonitor_helper.so.Gv7XgW == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: CMSSW_GIT_HASH=CMSSW_10_6_17_patch1 == env: SRT_G4ABLADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ABLA/3.0/data/G4ABLA3.0 == env: QTDIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2 == env: SRT_SCONS_LIB_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/scons/3.0.1-pafccj/lib == env: OLDPWD=/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1 == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: G4NEUTRONXSDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NEUTRONXS/1.4/data/G4NEUTRONXS1.4 == env: QTINC=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include == env: X509_CERT_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/certificates == env: SCRAM_ARCH=slc7_amd64_gcc700 == env: GIT_SSL_CAINFO=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/ssl/certs/ca-bundle.crt == env: SRT_CMS_OPENLOOPS_PREFIX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openloops/2.1.0-pafccj2 == env: SRT_GIT_EXEC_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/libexec/git-core == env: SRT_THEPEGPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj/share/ThePEG == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: ROOT_TTREECACHE_SIZE=0 == env: EVTGENDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/evtgen/1.6.0-pafccj5/share == env: SRT_INTEL_LICENSE_FILE_SCRAMRTDEL=28518@lxlicen01.cern.ch,28518@lxlicen02.cern.ch,28518@lxlicen03.cern.ch == env: SRT_ROOT_INCLUDE_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/include/slc7_amd64_gcc700/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/include/LCG:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mctester/1.25.0a-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dd4hep/v01-10x-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtDesigner:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauolapp/1.1.5-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/charybdis/1.003-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include/SHERPA-MC:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtOpenGL:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtGui:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwig/6.521-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt3Support:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lwtnn/2.4-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4/10.4.3-pafccj2/include/Geant4:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/classlib/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cgal/4.2-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tkonlinesw/4.2.0-1_gcc7-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/starlight/r193-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtCore:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtXml:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mcdb/1.0.3-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libungif/4.1.4-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libtiff/4.0.3-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/highfive/2.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libpng/1.6.16-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pcre/8.37-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/include/xrootd/private:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/vdt/0.4.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/toprex/4.23-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tbb/2019_U3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauola/27.121.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sigcpp/2.6.2-pafccj/include/sigc++-2.0:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sqlite/3.22.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/protobuf/3.5.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pacparser/1.3.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/oracle/12.1.0.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/py2-numpy/1.16.2-nmpfii2/c-api/core/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/meschach/1.2.pCMS1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libuuid/2.22.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libunwind/1.2.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libhepml/0.2.1-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ktjet/1.06-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jimmy/4.2-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jemalloc/5.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hls/2019.08/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj10:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hector/1.3.4_patch1-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libjpeg-turbo/2.0.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/giflib/4.2.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gsl/2.2.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gdbm/1.10-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/freetype/2.5.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftw3/3.3.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftjet/1.5.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/expat/2.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dpm/1.8.0.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vecgeom/v00.05.00-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xerces-c/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xz/5.2.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dcap/2.47.8-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libxml2/2.9.1-pafccj/include/libxml2:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/curl/7.59.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cppunit/1.40.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openssl/1.0.2d-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia6/426-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/photos/215.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/zlib-x86_64/1.2.11-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/bz2lib/1.0.6-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/include/python2.7:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tinyxml2/6.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ittnotify/16.06.18-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj/include:/usr/local/include:/usr/include == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: G4LEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4EMLOW/7.3/data/G4EMLOW7.3 == env: SRT_VINCIADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vincia/2.2.04-pafccj5/share/Vincia/xmldoc == env: SRT_ROOT_TTREECACHE_PREFILL_SCRAMRTDEL=0 == env: OPAL_PREFIX=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openmpi/2.1.5-pafccj == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: ROOT_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj10:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: SHERPA_INCLUDE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include/SHERPA-MC == env: SRT_LHAPDF_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/share/LHAPDF == env: SRT_PYTHON27PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1/python:/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch-tool-conf/CMSSW_10_6_17/lib/python2.7/site-packages == env: LD_LIBRARY_PATH=/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1/biglib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/biglib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/biglib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cuda/10.1.105-pafccj2/drivers:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/dcap:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/lcgdm:/.singularity.d/libs:lib:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-26533/t.69766/cctools-temp-t.69766.aBSn9d == env: SRT_CMSSW_RELEASE_BASE_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1 == env: SRT_RIVET_ANALYSIS_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/lib == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: SRT_PERL5LIB_SCRAMRT=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/perl5 == env: SRT_CMSSW_VERSION_SCRAMRTDEL=CMSSW_10_6_17_patch1 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/usr/ == env: GCC_RUNTIME_LSAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: SCRAM_CXX11_ABI=1 == env: VALGRIND_LIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/lib/valgrind == env: SRT_CMSSW_GIT_HASH_SCRAMRTDEL=CMSSW_10_6_17_patch1 == env: SRT_ROOTSYS_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/ == env: OSG_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-tNIz3j == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-26533/cache/tmp == env: G4NEUTRONHPDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NDL/4.5/data/G4NDL4.5 == env: GEANT4_PARFULLCMS_CONFIG_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-parfullcms/2014.01.27-pafccj2/share/ParFullCMS == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: CSC_TRACK_FINDER_DATA_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/CSCTrackFinderEmulation/1.2-pafccj/data/ == env: SRT_QTINC_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: G4ENSDFSTATEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ENSDFSTATE/2.2/data/G4ENSDFSTATE2.2 == env: G4RADIOACTIVEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4RadioactiveDecay/5.2/data/RadioactiveDecay5.2 == env: ROOFITSYS=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/ == env: SRT_ROOFITSYS_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/ == env: SRT_G4RADIOACTIVEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4RadioactiveDecay/5.2/data/RadioactiveDecay5.2 == env: SRT_G4ENSDFSTATEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ENSDFSTATE/2.2/data/G4ENSDFSTATE2.2 == env: SRT_CLHEP_PARAM_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2 == env: G4ABLADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ABLA/3.0/data/G4ABLA3.0 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: SRT_SHERPA_INCLUDE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include/SHERPA-MC == env: SRT_G4FORCENUMBEROFTHREADS_SCRAMRTDEL=max == env: SRT_WORKER_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/blackhat/0.9.9-pafccj/share/blackhat/datafiles/ == env: SITECONFIG_PATH=/cvmfs/cms.cern.ch/SITECONF/local == env: PARROT_CVMFS_REPO= == env: VC3_VERSION_GZIP=1.5 == env: GCC_RUNTIME_TSAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libtsan.so == env: TNS_ADMIN=/etc == env: SRT_HEPPDT_PARAM_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj == env: PATH=/cvmfs/cms.cern.ch/share/overrides/bin:/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1/bin/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/sbin:/cvmfs/cms.cern.ch/common:/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ENV_TAG_GLOBAL=26280 == env: THEPEGPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj/share/ThePEG == env: SRT_CMSSW_SEARCH_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1/poison:/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1/src:/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/data:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/poison:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/data == env: SRT_GIT_SSL_CAINFO_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/ssl/certs/ca-bundle.crt == env: SRT_GCC_RUNTIME_LSAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: CMS_PATH=/cvmfs/cms.cern.ch == env: VC3_ROOT=/disk/vc3-root == env: SRT_UTM_XSD_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj == env: SRT_PATH_SCRAMRT=/cvmfs/cms.cern.ch/share/overrides/bin:/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1/bin/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/bin == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-tNIz3j == env: RIVET_ANALYSIS_PATH=/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/lib == env: SRT_LOCALRT_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1 == env: SRT_CMSSW_BASE_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1 == env: PWD=/disk/vc3-root/tmp/worker-230547-26533/t.69766 == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: PYTHON_VALGRIND_SUPP=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/share/valgrind/valgrind-python.supp == env: SRT_OPAL_PREFIX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openmpi/2.1.5-pafccj == env: VC3_VERSION_WHICH=2.20 == env: GCC_RUNTIME_UBSAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libubsan.so == env: LANG=C == env: SRT_QTDIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: SRT_G4NEUTRONHPDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NDL/4.5/data/G4NDL4.5 == env: X509_VOMS_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/vomsdir == env: LOBSTER_LCG_CP= == env: SRT_SHERPA_SHARE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/share/SHERPA-MC == env: SRT_GCC_RUNTIME_TSAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libtsan.so == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-26533 == env: CASCADE_PDFPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/share == env: SRT_ROOT_GCC_TOOLCHAIN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: SRT_CASCADE_PDFPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/share == env: WORKER_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/blackhat/0.9.9-pafccj/share/blackhat/datafiles/ == env: GIT_TEMPLATE_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/git-core/templates == env: G4SAIDXSDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4SAIDDATA/1.1/data/G4SAIDDATA1.1 == env: MLAS_DYNAMIC_CPU_ARCH=0 == env: SRT_CMSSW_FULL_RELEASE_BASE_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: PYTHON27PATH=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1/python:/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch-tool-conf/CMSSW_10_6_17/lib/python2.7/site-packages == env: SRT_CMSSW_FWLITE_INCLUDE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/usr/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: ROOTSYS=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/ == env: SRT_PYTHIA8DATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/share/Pythia8/xmldoc == env: SRT_HERWIGPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj/share/Herwig == env: CXX=g++ == env: SRT_QTLIB_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/lib == env: SRT_PYTHON3PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1/python:/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch-tool-conf/CMSSW_10_6_17/lib/python3.6/site-packages == env: SHERPA_LIBRARY_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/lib/SHERPA-MC == env: SRT_PYTHON_VALGRIND_SUPP_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/share/valgrind/valgrind-python.supp == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: CMSSW_SEARCH_PATH=/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1/poison:/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1/src:/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/data:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/poison:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/data == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: GENEVA_DATA_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geneva/1.0-RC3-pafccj8/share/Geneva == env: DISK=3000 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-26533/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-26533/cache/tmp/cvmfs == env: GOSAMCONTRIB_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: ROOT_TTREECACHE_PREFILL=0 == env: GENREFLEX=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/bin/genreflex == env: VINCIADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vincia/2.2.04-pafccj5/share/Vincia/xmldoc == env: SRT_G4LEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4EMLOW/7.3/data/G4EMLOW7.3 == env: SRT_GENREFLEX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/bin/genreflex == env: SRT_GOSAMCONTRIB_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: SRT_ROOT_TTREECACHE_SIZE_SCRAMRTDEL=0 == env: SRT_EVTGENDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/evtgen/1.6.0-pafccj5/share == env: SRT_GENEVA_DATA_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geneva/1.0-RC3-pafccj8/share/Geneva == env: GFAL_CONFIG_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/gfal2.d/ == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=3000 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: SRT_CMSSW_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms == env: HEPPDT_PARAM_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj == env: SRT_LD_LIBRARY_PATH_SCRAMRT=/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1/biglib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/biglib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/biglib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cuda/10.1.105-pafccj2/drivers == env: TMP=/disk/vc3-root/tmp/worker-230547-26533/t.69766/cctools-temp-t.69766.aBSn9d == env: PYTHONPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib/python2.7/site-packages:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/python2.7/site-packages:python:python: == env: PYTHON3PATH=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1/python:/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch-tool-conf/CMSSW_10_6_17/lib/python3.6/site-packages == env: QTLIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/lib == env: SCONS_LIB_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/scons/3.0.1-pafccj/lib == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: COMPILER_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: FRONTIER_CLIENT=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/ == env: SRT_G4NEUTRONXSDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NEUTRONXS/1.4/data/G4NEUTRONXS1.4 == env: SRT_SHERPA_LIBRARY_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/lib/SHERPA-MC == env: VC3_ROOT_TAR=/usr/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CLHEP_PARAM_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2 == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-tNIz3j.wrapper == env: PYTHIA8DATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/share/Pythia8/xmldoc == env: HERWIGPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj/share/Herwig == env: SRT_FRONTIER_CLIENT_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/ == env: SRT_COMPILER_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: SRT_CSC_TRACK_FINDER_DATA_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/CSCTrackFinderEmulation/1.2-pafccj/data/ == env: GCC_RUNTIME_ASAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: SRT_ROOT_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj10:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: CC=gcc == env: TEXMFHOME=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/share/Rivet/texmf == env: SRT_MLAS_DYNAMIC_CPU_ARCH_SCRAMRTDEL=0 == env: SRT_OPENBLAS_NUM_THREADS_SCRAMRTDEL=1 == env: SRT_GIT_TEMPLATE_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/git-core/templates == env: SRT_G4SAIDXSDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4SAIDDATA/1.1/data/G4SAIDDATA1.1 == env: CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: SRT_GCC_RUNTIME_UBSAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libubsan.so == env: SRT_LANG_SCRAMRTDEL=C == env: CCTOOLS_RESOURCE_MONITOR_INFO=1024 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=6 == env: PARROT_DEBUG_FLAGS= == env: SHERPA_SHARE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/share/SHERPA-MC == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: CMS_OPENLOOPS_PREFIX=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openloops/2.1.0-pafccj2 == env: GIT_EXEC_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/libexec/git-core == env: LOCALRT=/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1 == env: CMSSW_BASE=/disk/vc3-root/tmp/worker-230547-26533/t.69766/CMSSW_10_6_17_patch1 == env: SRT_SCRAM_CXX11_ABI_SCRAMRTDEL=1 == env: SRT_VALGRIND_LIB_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/lib/valgrind == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_CRC_postLHE_crc.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=18551 == env: _=/usr/bin/env === wrapper ready @ Wed Apr 21 03:05:09 EDT 2021 ==== working directory before execution @ Wed Apr 21 03:05:09 EDT 2021 ==== == dir: total 864 == dir: drwxr-xr-x 18 kmohrman campus 215 Apr 21 03:05 CMSSW_10_6_17_patch1 == dir: -rw-r--r-- 2 kmohrman campus 3805 Apr 20 18:56 UL17_SIM_cfg.py == dir: drwxr-xr-x 2 kmohrman campus 71 Apr 21 03:04 bin == dir: -rwxr-xr-x 3 kmohrman campus 627272 Apr 20 18:36 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 Apr 21 03:04 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 Apr 21 03:04 cctools-temp-t.69766.aBSn9d == dir: -rw------- 1 kmohrman campus 51 Apr 21 03:05 cvmfschecksum.cms-ib.cern.ch == dir: -rw------- 1 kmohrman campus 51 Apr 21 03:04 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 Apr 21 03:05 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 Apr 21 03:04 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 Apr 21 03:04 librmonitor_helper.so.Gv7XgW == dir: -rw-r--r-- 2 kmohrman campus 2065 Apr 21 03:04 parameters.json == dir: -rw------- 2 kmohrman campus 9921 Apr 21 03:04 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 Apr 21 03:04 python == dir: -rw-r--r-- 3 kmohrman campus 570 Apr 20 18:36 report.json.in == dir: -rw-r--r-- 3 kmohrman campus 593 Apr 20 18:36 sandbox-CMSSW_10_6_17_patch1-slc7_amd64_gcc700.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 37 Apr 21 03:04 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 Apr 21 03:05 t_wrapper_ready == dir: -rw-r--r-- 1 kmohrman campus 11 Apr 21 03:04 t_wrapper_start == dir: -rwxr-xr-x 3 kmohrman campus 47217 Apr 20 18:36 task.py == dir: -rwxr-xr-x 3 kmohrman campus 5986 Apr 20 18:36 wrapper.sh >>> data is {u'files': {u'info': {}, u'output_info': {}, u'skipped': []}, u'cpu_time': 0, u'exe_exit_code': 0, u'events_written': 0, u'output_size': 0, u'task_exit_code': 0, u'output_storage_element': u'', u'cache': {u'start_size': 0, u'type': 2, u'end_size': 0}, u'stageout_exit_code': 0, u'output_bare_size': 0, u'transfers': defaultdict(, {}), u'task_timing': {u'wrapper_ready': 0, u'wrapper_start': 0, u'prologue_end': 0, u'epilogue_end': 0, u'stage_out_end': 0, u'stage_in_end': 0, u'processing_end': 0}, u'events_per_run': 0} @ Wed Apr 21 03:05:16 2021 >>> Trying hdfs client access method @ Wed Apr 21 03:05:16 2021 >>> executing 'timeout 300 hdfs dfs -fs hdfs://eddie.crc.nd.edu:19000 -get /store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/gen_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/GEN-00000_36300.root GEN-00000_36300.root' @ Wed Apr 21 03:05:16 2021 >> using /disk/vc3-root/tmp/worker-230547-26533/t.69766/cctools-temp-t.69766.aBSn9d/tmpqTTQeV to store command output >> cmd: timeout: failed to run command 'hdfs': No such file or directory >>>>> Unable to copy input with hdfs client @ Wed Apr 21 03:05:16 2021 >>> Trying xrootd access method @ Wed Apr 21 03:05:16 2021 >>> executing 'env XRD_LOGLEVEL=Debug timeout 300 xrdfs deepthought.crc.nd.edu stat /store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/gen_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/GEN-00000_36300.root' @ Wed Apr 21 03:05:16 2021 >> using /disk/vc3-root/tmp/worker-230547-26533/t.69766/cctools-temp-t.69766.aBSn9d/tmpwwk_2b to store command output >> cmd: [2021-04-21 03:05:16.383611 -0400][Warning][Utility ] Unable to process global config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-04-21 03:05:16.384726 -0400][Debug ][Utility ] Unable to process user config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-04-21 03:05:16.384900 -0400][Debug ][PlugInMgr ] Initializing plug-in manager... >> cmd: [2021-04-21 03:05:16.384956 -0400][Debug ][PlugInMgr ] No default plug-in, loading plug-in configs... >> cmd: [2021-04-21 03:05:16.385006 -0400][Debug ][PlugInMgr ] Processing plug-in definitions in /etc/xrootd/client.plugins.d... >> cmd: [2021-04-21 03:05:16.385119 -0400][Debug ][PlugInMgr ] Unable to process directory /etc/xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-04-21 03:05:16.385484 -0400][Debug ][PlugInMgr ] Processing plug-in definitions in /tmp/runos_singularity_home-282113084562864413726486454614658604106/.xrootd/client.plugins.d... >> cmd: [2021-04-21 03:05:16.385591 -0400][Debug ][PlugInMgr ] Unable to process directory /tmp/runos_singularity_home-282113084562864413726486454614658604106/.xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-04-21 03:05:16.385773 -0400][Debug ][App ] Executing: stat /store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/gen_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/GEN-00000_36300.root >> cmd: [2021-04-21 03:05:16.385881 -0400][Debug ][Poller ] Available pollers: built-in >> cmd: [2021-04-21 03:05:16.385929 -0400][Debug ][Poller ] Attempting to create a poller according to preference: built-in >> cmd: [2021-04-21 03:05:16.385977 -0400][Debug ][Poller ] Creating poller: built-in >> cmd: [2021-04-21 03:05:16.386036 -0400][Debug ][Poller ] Creating and starting the built-in poller... >> cmd: [2021-04-21 03:05:16.386428 -0400][Debug ][Poller ] Using 1 poller threads >> cmd: [2021-04-21 03:05:16.386492 -0400][Debug ][TaskMgr ] Starting the task manager... >> cmd: [2021-04-21 03:05:16.386685 -0400][Debug ][TaskMgr ] Task manager started >> cmd: [2021-04-21 03:05:16.386762 -0400][Debug ][JobMgr ] Starting the job manager... >> cmd: [2021-04-21 03:05:16.387133 -0400][Debug ][JobMgr ] Job manager started, 3 workers >> cmd: [2021-04-21 03:05:16.387201 -0400][Debug ][TaskMgr ] Registering task: "FileTimer task" to be run at: [2021-04-21 03:05:16 -0400] >> cmd: [2021-04-21 03:05:16.387284 -0400][Debug ][PostMaster ] Creating new channel to: deepthought.crc.nd.edu:1094 1 stream(s) >> cmd: [2021-04-21 03:05:16.387358 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-04-21 03:05:16.388654 -0400][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" to be run at: [2021-04-21 03:05:31 -0400] >> cmd: [2021-04-21 03:05:16.389657 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-04-21 03:05:16.389824 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-04-21 03:05:16.389931 -0400][Debug ][Poller ] Adding socket 0x1c86920 to the poller >> cmd: [2021-04-21 03:05:16.390891 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2021-04-21 03:05:16.391099 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-04-21 03:05:16.391731 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Got the server hand shake response (type: manager [], protocol version 400) >> cmd: [2021-04-21 03:05:16.391984 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] kXR_protocol successful (type: manager [], protocol version 400) >> cmd: [2021-04-21 03:05:16.395606 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=d8civy109.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-04-21 03:05:16.395978 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Logged in, session: a25b01009b0d000036030000a45b0100 >> cmd: [2021-04-21 03:05:16.396065 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream 0 connected. >> cmd: [2021-04-21 03:05:16.396122 -0400][Debug ][Utility ] Monitor library name not set. No monitoring >> cmd: [2021-04-21 03:05:16.397829 -0400][Debug ][PostMaster ] Creating new channel to: primeradiant02.crc.nd.edu:1096 1 stream(s) >> cmd: [2021-04-21 03:05:16.397902 -0400][Debug ][PostMaster ] [primeradiant02.crc.nd.edu:1096 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-04-21 03:05:16.399514 -0400][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: primeradiant02.crc.nd.edu:1096" to be run at: [2021-04-21 03:05:31 -0400] >> cmd: [2021-04-21 03:05:16.400512 -0400][Debug ][PostMaster ] [primeradiant02.crc.nd.edu:1096] Found 1 address(es): [::ffff:149.165.243.6]:1096 >> cmd: [2021-04-21 03:05:16.400671 -0400][Debug ][AsyncSock ] [primeradiant02.crc.nd.edu:1096 #0.0] Attempting connection to [::ffff:149.165.243.6]:1096 >> cmd: [2021-04-21 03:05:16.400766 -0400][Debug ][Poller ] Adding socket 0xa00016a0 to the poller >> cmd: [2021-04-21 03:05:16.400904 -0400][Debug ][AsyncSock ] [primeradiant02.crc.nd.edu:1096 #0.0] Async connection call returned >> cmd: [2021-04-21 03:05:16.401019 -0400][Debug ][XRootDTransport ] [primeradiant02.crc.nd.edu:1096 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-04-21 03:05:16.401419 -0400][Debug ][XRootDTransport ] [primeradiant02.crc.nd.edu:1096 #0.0] Got the server hand shake response (type: server [], protocol version 400) >> cmd: [2021-04-21 03:05:16.401612 -0400][Debug ][XRootDTransport ] [primeradiant02.crc.nd.edu:1096 #0.0] kXR_protocol successful (type: server [], protocol version 400) >> cmd: [2021-04-21 03:05:16.404491 -0400][Debug ][XRootDTransport ] [primeradiant02.crc.nd.edu:1096 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=d8civy109.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-04-21 03:05:16.404861 -0400][Debug ][XRootDTransport ] [primeradiant02.crc.nd.edu:1096 #0.0] Logged in, session: 5e4200009a460000b90000005e420000 >> cmd: [2021-04-21 03:05:16.404917 -0400][Debug ][XRootDTransport ] [primeradiant02.crc.nd.edu:1096 #0.0] Authentication is required: &P=gsi,v:10400,c:ssl,ca:ba240aa8.0|f5f0dfc2.0 >> cmd: [2021-04-21 03:05:16.404969 -0400][Debug ][XRootDTransport ] [primeradiant02.crc.nd.edu:1096 #0.0] Sending authentication data >> cmd: [2021-04-21 03:05:16.413273 -0400][Debug ][XRootDTransport ] [primeradiant02.crc.nd.edu:1096 #0.0] Trying to authenticate using gsi >> cmd: [2021-04-21 03:05:16.482437 -0400][Debug ][XRootDTransport ] [primeradiant02.crc.nd.edu:1096 #0.0] Sending more authentication data for gsi >> cmd: [2021-04-21 03:05:16.487683 -0400][Debug ][XRootDTransport ] [primeradiant02.crc.nd.edu:1096 #0.0] Authenticated with gsi. >> cmd: [2021-04-21 03:05:16.487780 -0400][Debug ][PostMaster ] [primeradiant02.crc.nd.edu:1096 #0] Stream 0 connected. >> cmd: Path: /store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/gen_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/GEN-00000_36300.root >> cmd: Id: 0 >> cmd: Size: 68689422 >> cmd: MTime: 2021-04-21 01:55:26 >> cmd: Flags: 24 (Offline|IsReadable) >> cmd: [2021-04-21 03:05:16.489586 -0400][Debug ][JobMgr ] Stopping the job manager... >> cmd: [2021-04-21 03:05:16.490143 -0400][Debug ][JobMgr ] Job manager stopped >> cmd: [2021-04-21 03:05:16.490206 -0400][Debug ][TaskMgr ] Stopping the task manager... >> cmd: [2021-04-21 03:05:16.490395 -0400][Debug ][TaskMgr ] Task manager stopped >> cmd: [2021-04-21 03:05:16.490450 -0400][Debug ][Poller ] Stopping the poller... >> cmd: [2021-04-21 03:05:16.490756 -0400][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" >> cmd: [2021-04-21 03:05:16.490816 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-04-21 03:05:16.490868 -0400][Debug ][Poller ] <[::ffff:10.32.79.81]:44876><--><[::ffff:129.74.85.55]:1094> Removing socket from the poller >> cmd: [2021-04-21 03:05:16.490958 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Destroying stream >> cmd: [2021-04-21 03:05:16.491011 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-04-21 03:05:16.491074 -0400][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: primeradiant02.crc.nd.edu:1096" >> cmd: [2021-04-21 03:05:16.491124 -0400][Debug ][AsyncSock ] [primeradiant02.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2021-04-21 03:05:16.491173 -0400][Debug ][Poller ] <[::ffff:10.32.79.81]:46448><--><[::ffff:149.165.243.6]:1096> Removing socket from the poller >> cmd: [2021-04-21 03:05:16.491256 -0400][Debug ][PostMaster ] [primeradiant02.crc.nd.edu:1096 #0] Destroying stream >> cmd: [2021-04-21 03:05:16.491306 -0400][Debug ][AsyncSock ] [primeradiant02.crc.nd.edu:1096 #0.0] Closing the socket >>> will stream using xrootd instead of copying @ Wed Apr 21 03:05:16 2021 >>> modified input files @ Wed Apr 21 03:05:16 2021 >> input: root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/gen_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/GEN-00000_36300.root >>> updated parameters are @ Wed Apr 21 03:05:16 2021 >> json: { >> json: "accelerate stage-in": 3, >> json: "arguments": [], >> json: "cores": 6, >> json: "default ce": "T3_US_NotreDame", >> json: "default host": "earth.crc.nd.edu", >> json: "default se": "T3_US_NotreDame", >> json: "disable streaming": false, >> json: "epilogue": null, >> json: "executable": "cmsRun", >> json: "file map": { >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/gen_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/GEN-00000_36300.root": "gen_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/GEN-00000_36300.root" >> json: }, >> json: "gridpack": false, >> json: "input": [ >> json: "hdfs://eddie.crc.nd.edu:19000/store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1", >> json: "file:///hadoop/store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/" >> json: ], >> json: "mask": { >> json: "events": -1, >> json: "files": [ >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/gen_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/GEN-00000_36300.root" >> json: ], >> json: "lumis": { >> json: "1": [ >> json: [ >> json: 3669, >> json: 3669 >> json: ] >> json: ] >> json: } >> json: }, >> json: "monitoring": { >> json: "monitorid": null, >> json: "syncid": null, >> json: "taskid": "lobster_kmohrman_EFT_CRC_postLHE_crc_20210420_1711_38e82fbc2ea33834" >> json: }, >> json: "output": [ >> json: "hdfs://eddie.crc.nd.edu:19000/store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1", >> json: "file:///hadoop/store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/" >> json: ], >> json: "output files": [ >> json: [ >> json: "SIM-00000.root", >> json: "sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root" >> json: ] >> json: ], >> json: "prologue": null, >> json: "pset": "UL17_SIM_cfg.py", >> json: "want summary": true >> json: } >>> using sync CE T3_US_NotreDame @ Wed Apr 21 03:05:16 2021 >>> config file fragment @ Wed Apr 21 03:05:18 2021 >> pset: >> pset: import FWCore.ParameterSet.Config as cms >> pset: process.Timing = cms.Service("Timing", >> pset: useJobReport = cms.untracked.bool(True), >> pset: summaryOnly = cms.untracked.bool(True)) >> pset: >> pset: process.maxEvents = cms.untracked.PSet(input = cms.untracked.int32(-1)) >> pset: >> pset: import os >> pset: _, major, minor, _ = os.environ["CMSSW_VERSION"].split('_', 3) >> pset: if int(major) >= 7 and int(minor) >= 4: >> pset: xrdstats = cms.Service("XrdAdaptor::XrdStatisticsService", cms.untracked.PSet(reportToFJR = cms.untracked.bool(True))) >> pset: process.add_(xrdstats) >> pset: >> pset: for prod in process.producers.values(): >> pset: if prod.hasParameter('nEvents') and prod.type_() == 'ExternalLHEProducer': >> pset: prod.nEvents = cms.untracked.uint32(-1) >> pset: >> pset: process.source.fileNames = cms.untracked.vstring(['root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/gen_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/GEN-00000_36300.root']) >> pset: process.source.lumisToProcess = cms.untracked.VLuminosityBlockRange(['1:3669']) >> pset: if hasattr(process, 'options'): >> pset: process.options.wantSummary = cms.untracked.bool(True) >> pset: else: >> pset: process.options = cms.untracked.PSet(wantSummary = cms.untracked.bool(True)) >> pset: >> pset: if hasattr(process, 'options'): >> pset: process.options.numberOfThreads = cms.untracked.uint32(6) >> pset: process.options.numberOfStreams = cms.untracked.uint32(0) >> pset: else: >> pset: process.options = cms.untracked.PSet( >> pset: numberOfThreads = cms.untracked.uint32(6), >> pset: numberOfStreams = cms.untracked.uint32(0) >> pset: ) >>> executing 'cmsRun -j report.xml UL17_SIM_cfg_mod.py' @ Wed Apr 21 03:05:18 2021 >> using /disk/vc3-root/tmp/worker-230547-26533/t.69766/cctools-temp-t.69766.aBSn9d/tmp2QzBoa to store command output >> cmd: %MSG-i ThreadStreamSetup: (NoModuleName) 21-Apr-2021 03:05:27 EDT pre-events >> cmd: setting # threads 6 >> cmd: setting # streams 6 >> cmd: %MSG >> cmd: 21-Apr-2021 03:05:34 EDT Initiating request to open file root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/gen_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/GEN-00000_36300.root >> cmd: 21-Apr-2021 03:05:38 EDT Successfully opened file root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/gen_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/GEN-00000_36300.root >> cmd: Begin processing the 1st record. Run 1, Event 1, LumiSection 3669 on stream 0 at 21-Apr-2021 03:06:31.013 EDT >> cmd: Begin processing the 2nd record. Run 1, Event 2, LumiSection 3669 on stream 3 at 21-Apr-2021 03:06:31.014 EDT >> cmd: Begin processing the 3rd record. Run 1, Event 3, LumiSection 3669 on stream 5 at 21-Apr-2021 03:06:31.015 EDT >> cmd: Begin processing the 4th record. Run 1, Event 4, LumiSection 3669 on stream 2 at 21-Apr-2021 03:06:31.017 EDT >> cmd: Begin processing the 5th record. Run 1, Event 5, LumiSection 3669 on stream 4 at 21-Apr-2021 03:06:31.018 EDT >> cmd: Begin processing the 6th record. Run 1, Event 6, LumiSection 3669 on stream 1 at 21-Apr-2021 03:06:31.019 EDT >> cmd: Begin processing the 7th record. Run 1, Event 7, LumiSection 3669 on stream 5 at 21-Apr-2021 03:06:51.866 EDT >> cmd: Begin processing the 8th record. Run 1, Event 8, LumiSection 3669 on stream 1 at 21-Apr-2021 03:06:55.645 EDT >> cmd: Begin processing the 9th record. Run 1, Event 9, LumiSection 3669 on stream 4 at 21-Apr-2021 03:07:02.209 EDT >> cmd: Begin processing the 10th record. Run 1, Event 10, LumiSection 3669 on stream 2 at 21-Apr-2021 03:07:02.394 EDT >> cmd: Begin processing the 11th record. Run 1, Event 11, LumiSection 3669 on stream 0 at 21-Apr-2021 03:07:16.978 EDT >> cmd: Begin processing the 12th record. Run 1, Event 12, LumiSection 3669 on stream 1 at 21-Apr-2021 03:07:21.010 EDT >> cmd: Begin processing the 13th record. Run 1, Event 13, LumiSection 3669 on stream 5 at 21-Apr-2021 03:07:27.776 EDT >> cmd: Begin processing the 14th record. Run 1, Event 14, LumiSection 3669 on stream 2 at 21-Apr-2021 03:07:36.475 EDT >> cmd: Begin processing the 15th record. Run 1, Event 15, LumiSection 3669 on stream 3 at 21-Apr-2021 03:07:44.804 EDT >> cmd: Begin processing the 16th record. Run 1, Event 16, LumiSection 3669 on stream 1 at 21-Apr-2021 03:07:54.181 EDT >> cmd: Begin processing the 17th record. Run 1, Event 17, LumiSection 3669 on stream 0 at 21-Apr-2021 03:07:54.598 EDT >> cmd: Begin processing the 18th record. Run 1, Event 18, LumiSection 3669 on stream 4 at 21-Apr-2021 03:07:55.469 EDT >> cmd: Begin processing the 19th record. Run 1, Event 19, LumiSection 3669 on stream 5 at 21-Apr-2021 03:08:00.951 EDT >> cmd: Begin processing the 20th record. Run 1, Event 20, LumiSection 3669 on stream 3 at 21-Apr-2021 03:08:26.356 EDT >> cmd: Begin processing the 21st record. Run 1, Event 21, LumiSection 3669 on stream 2 at 21-Apr-2021 03:08:26.750 EDT >> cmd: Begin processing the 22nd record. Run 1, Event 22, LumiSection 3669 on stream 0 at 21-Apr-2021 03:08:28.481 EDT >> cmd: Begin processing the 23rd record. Run 1, Event 23, LumiSection 3669 on stream 4 at 21-Apr-2021 03:08:31.334 EDT >> cmd: Begin processing the 24th record. Run 1, Event 24, LumiSection 3669 on stream 1 at 21-Apr-2021 03:08:34.314 EDT >> cmd: Begin processing the 25th record. Run 1, Event 25, LumiSection 3669 on stream 5 at 21-Apr-2021 03:08:40.417 EDT >> cmd: Begin processing the 26th record. Run 1, Event 26, LumiSection 3669 on stream 2 at 21-Apr-2021 03:08:43.177 EDT >> cmd: Begin processing the 27th record. Run 1, Event 27, LumiSection 3669 on stream 0 at 21-Apr-2021 03:08:56.042 EDT >> cmd: Begin processing the 28th record. Run 1, Event 28, LumiSection 3669 on stream 1 at 21-Apr-2021 03:09:08.109 EDT >> cmd: Begin processing the 29th record. Run 1, Event 29, LumiSection 3669 on stream 4 at 21-Apr-2021 03:09:08.832 EDT >> cmd: Begin processing the 30th record. Run 1, Event 30, LumiSection 3669 on stream 3 at 21-Apr-2021 03:09:13.804 EDT >> cmd: Begin processing the 31st record. Run 1, Event 31, LumiSection 3669 on stream 5 at 21-Apr-2021 03:09:17.252 EDT >> cmd: Begin processing the 32nd record. Run 1, Event 32, LumiSection 3669 on stream 2 at 21-Apr-2021 03:09:22.697 EDT >> cmd: Begin processing the 33rd record. Run 1, Event 33, LumiSection 3669 on stream 0 at 21-Apr-2021 03:09:28.796 EDT >> cmd: [2021-04-21 03:09:30.881721 -0400][Error ][XRootD ] [primeradiant03.crc.nd.edu:1096] Unable to get the response to request kXR_open (file: /store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/gen_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/GEN-00000_36300.root?tried=primeradiant01.crc.nd.edu, mode: 0660, flags: kXR_open_read kXR_async kXR_retstat ) >> cmd: Begin processing the 34th record. Run 1, Event 34, LumiSection 3669 on stream 3 at 21-Apr-2021 03:09:39.541 EDT >> cmd: Begin processing the 35th record. Run 1, Event 35, LumiSection 3669 on stream 5 at 21-Apr-2021 03:09:47.945 EDT >> cmd: Begin processing the 36th record. Run 1, Event 36, LumiSection 3669 on stream 2 at 21-Apr-2021 03:09:48.187 EDT >> cmd: Begin processing the 37th record. Run 1, Event 37, LumiSection 3669 on stream 4 at 21-Apr-2021 03:09:48.699 EDT >> cmd: Begin processing the 38th record. Run 1, Event 38, LumiSection 3669 on stream 0 at 21-Apr-2021 03:09:59.382 EDT >> cmd: Begin processing the 39th record. Run 1, Event 39, LumiSection 3669 on stream 1 at 21-Apr-2021 03:10:01.999 EDT >> cmd: Begin processing the 40th record. Run 1, Event 40, LumiSection 3669 on stream 4 at 21-Apr-2021 03:10:08.019 EDT >> cmd: Begin processing the 41st record. Run 1, Event 41, LumiSection 3669 on stream 3 at 21-Apr-2021 03:10:13.078 EDT >> cmd: Begin processing the 42nd record. Run 1, Event 42, LumiSection 3669 on stream 5 at 21-Apr-2021 03:10:13.429 EDT >> cmd: Begin processing the 43rd record. Run 1, Event 43, LumiSection 3669 on stream 2 at 21-Apr-2021 03:10:25.581 EDT >> cmd: Begin processing the 44th record. Run 1, Event 44, LumiSection 3669 on stream 3 at 21-Apr-2021 03:10:28.733 EDT >> cmd: Begin processing the 45th record. Run 1, Event 45, LumiSection 3669 on stream 1 at 21-Apr-2021 03:10:30.134 EDT >> cmd: Begin processing the 46th record. Run 1, Event 46, LumiSection 3669 on stream 0 at 21-Apr-2021 03:10:39.232 EDT >> cmd: Begin processing the 47th record. Run 1, Event 47, LumiSection 3669 on stream 4 at 21-Apr-2021 03:10:41.859 EDT >> cmd: Begin processing the 48th record. Run 1, Event 48, LumiSection 3669 on stream 2 at 21-Apr-2021 03:11:01.039 EDT >> cmd: Begin processing the 49th record. Run 1, Event 49, LumiSection 3669 on stream 0 at 21-Apr-2021 03:11:01.366 EDT >> cmd: Begin processing the 50th record. Run 1, Event 50, LumiSection 3669 on stream 5 at 21-Apr-2021 03:11:01.901 EDT >> cmd: Begin processing the 51st record. Run 1, Event 51, LumiSection 3669 on stream 1 at 21-Apr-2021 03:11:19.912 EDT >> cmd: Begin processing the 52nd record. Run 1, Event 52, LumiSection 3669 on stream 4 at 21-Apr-2021 03:11:23.885 EDT >> cmd: Begin processing the 53rd record. Run 1, Event 53, LumiSection 3669 on stream 3 at 21-Apr-2021 03:11:23.917 EDT >> cmd: Begin processing the 54th record. Run 1, Event 54, LumiSection 3669 on stream 2 at 21-Apr-2021 03:11:31.681 EDT >> cmd: Begin processing the 55th record. Run 1, Event 55, LumiSection 3669 on stream 1 at 21-Apr-2021 03:11:39.304 EDT >> cmd: Begin processing the 56th record. Run 1, Event 56, LumiSection 3669 on stream 4 at 21-Apr-2021 03:11:42.247 EDT >> cmd: Begin processing the 57th record. Run 1, Event 57, LumiSection 3669 on stream 0 at 21-Apr-2021 03:11:47.056 EDT >> cmd: Begin processing the 58th record. Run 1, Event 58, LumiSection 3669 on stream 5 at 21-Apr-2021 03:11:48.359 EDT >> cmd: Begin processing the 59th record. Run 1, Event 59, LumiSection 3669 on stream 1 at 21-Apr-2021 03:11:57.889 EDT >> cmd: Begin processing the 60th record. Run 1, Event 60, LumiSection 3669 on stream 3 at 21-Apr-2021 03:12:00.356 EDT >> cmd: Begin processing the 61st record. Run 1, Event 61, LumiSection 3669 on stream 2 at 21-Apr-2021 03:12:02.817 EDT >> cmd: Begin processing the 62nd record. Run 1, Event 62, LumiSection 3669 on stream 5 at 21-Apr-2021 03:12:12.784 EDT >> cmd: Begin processing the 63rd record. Run 1, Event 63, LumiSection 3669 on stream 0 at 21-Apr-2021 03:12:24.471 EDT >> cmd: Begin processing the 64th record. Run 1, Event 64, LumiSection 3669 on stream 1 at 21-Apr-2021 03:12:29.044 EDT >> cmd: Begin processing the 65th record. Run 1, Event 65, LumiSection 3669 on stream 4 at 21-Apr-2021 03:12:30.990 EDT >> cmd: Begin processing the 66th record. Run 1, Event 66, LumiSection 3669 on stream 3 at 21-Apr-2021 03:12:32.584 EDT >> cmd: Begin processing the 67th record. Run 1, Event 67, LumiSection 3669 on stream 2 at 21-Apr-2021 03:12:39.858 EDT >> cmd: Begin processing the 68th record. Run 1, Event 68, LumiSection 3669 on stream 0 at 21-Apr-2021 03:12:49.505 EDT >> cmd: Begin processing the 69th record. Run 1, Event 69, LumiSection 3669 on stream 5 at 21-Apr-2021 03:12:55.756 EDT >> cmd: Begin processing the 70th record. Run 1, Event 70, LumiSection 3669 on stream 4 at 21-Apr-2021 03:13:03.602 EDT >> cmd: Begin processing the 71st record. Run 1, Event 71, LumiSection 3669 on stream 1 at 21-Apr-2021 03:13:03.841 EDT >> cmd: Begin processing the 72nd record. Run 1, Event 72, LumiSection 3669 on stream 3 at 21-Apr-2021 03:13:14.240 EDT >> cmd: Begin processing the 73rd record. Run 1, Event 73, LumiSection 3669 on stream 0 at 21-Apr-2021 03:13:14.267 EDT >> cmd: Begin processing the 74th record. Run 1, Event 74, LumiSection 3669 on stream 5 at 21-Apr-2021 03:13:16.008 EDT >> cmd: Begin processing the 75th record. Run 1, Event 75, LumiSection 3669 on stream 4 at 21-Apr-2021 03:13:27.094 EDT >> cmd: Begin processing the 76th record. Run 1, Event 76, LumiSection 3669 on stream 2 at 21-Apr-2021 03:13:27.134 EDT >> cmd: Begin processing the 77th record. Run 1, Event 77, LumiSection 3669 on stream 0 at 21-Apr-2021 03:13:35.137 EDT >> cmd: Begin processing the 78th record. Run 1, Event 78, LumiSection 3669 on stream 1 at 21-Apr-2021 03:13:42.765 EDT >> cmd: Begin processing the 79th record. Run 1, Event 79, LumiSection 3669 on stream 5 at 21-Apr-2021 03:13:47.602 EDT >> cmd: Begin processing the 80th record. Run 1, Event 80, LumiSection 3669 on stream 2 at 21-Apr-2021 03:13:50.447 EDT >> cmd: Begin processing the 81st record. Run 1, Event 81, LumiSection 3669 on stream 3 at 21-Apr-2021 03:13:56.189 EDT >> cmd: Begin processing the 82nd record. Run 1, Event 82, LumiSection 3669 on stream 0 at 21-Apr-2021 03:14:03.341 EDT >> cmd: Begin processing the 83rd record. Run 1, Event 83, LumiSection 3669 on stream 1 at 21-Apr-2021 03:14:12.810 EDT >> cmd: Begin processing the 84th record. Run 1, Event 84, LumiSection 3669 on stream 5 at 21-Apr-2021 03:14:27.135 EDT >> cmd: Begin processing the 85th record. Run 1, Event 85, LumiSection 3669 on stream 1 at 21-Apr-2021 03:14:37.053 EDT >> cmd: Begin processing the 86th record. Run 1, Event 86, LumiSection 3669 on stream 2 at 21-Apr-2021 03:14:41.791 EDT >> cmd: Begin processing the 87th record. Run 1, Event 87, LumiSection 3669 on stream 3 at 21-Apr-2021 03:14:42.781 EDT >> cmd: Begin processing the 88th record. Run 1, Event 88, LumiSection 3669 on stream 4 at 21-Apr-2021 03:14:45.296 EDT >> cmd: Begin processing the 89th record. Run 1, Event 89, LumiSection 3669 on stream 5 at 21-Apr-2021 03:14:53.546 EDT >> cmd: Begin processing the 90th record. Run 1, Event 90, LumiSection 3669 on stream 0 at 21-Apr-2021 03:15:01.205 EDT >> cmd: Begin processing the 91st record. Run 1, Event 91, LumiSection 3669 on stream 1 at 21-Apr-2021 03:15:09.107 EDT >> cmd: Begin processing the 92nd record. Run 1, Event 92, LumiSection 3669 on stream 2 at 21-Apr-2021 03:15:15.641 EDT >> cmd: Begin processing the 93rd record. Run 1, Event 93, LumiSection 3669 on stream 4 at 21-Apr-2021 03:15:19.416 EDT >> cmd: Begin processing the 94th record. Run 1, Event 94, LumiSection 3669 on stream 3 at 21-Apr-2021 03:15:31.078 EDT >> cmd: Begin processing the 95th record. Run 1, Event 95, LumiSection 3669 on stream 2 at 21-Apr-2021 03:15:34.801 EDT >> cmd: Begin processing the 96th record. Run 1, Event 96, LumiSection 3669 on stream 5 at 21-Apr-2021 03:15:36.096 EDT >> cmd: Begin processing the 97th record. Run 1, Event 97, LumiSection 3669 on stream 1 at 21-Apr-2021 03:15:39.388 EDT >> cmd: Begin processing the 98th record. Run 1, Event 98, LumiSection 3669 on stream 2 at 21-Apr-2021 03:16:13.574 EDT >> cmd: Begin processing the 99th record. Run 1, Event 99, LumiSection 3669 on stream 0 at 21-Apr-2021 03:16:13.614 EDT >> cmd: Begin processing the 100th record. Run 1, Event 100, LumiSection 3669 on stream 1 at 21-Apr-2021 03:16:19.723 EDT >> cmd: Begin processing the 101st record. Run 1, Event 101, LumiSection 3669 on stream 4 at 21-Apr-2021 03:16:19.871 EDT >> cmd: Begin processing the 102nd record. Run 1, Event 102, LumiSection 3669 on stream 5 at 21-Apr-2021 03:16:32.891 EDT >> cmd: Begin processing the 103rd record. Run 1, Event 103, LumiSection 3669 on stream 2 at 21-Apr-2021 03:16:45.402 EDT >> cmd: Begin processing the 104th record. Run 1, Event 104, LumiSection 3669 on stream 3 at 21-Apr-2021 03:16:47.518 EDT >> cmd: Begin processing the 105th record. Run 1, Event 105, LumiSection 3669 on stream 4 at 21-Apr-2021 03:16:51.662 EDT >> cmd: Begin processing the 106th record. Run 1, Event 106, LumiSection 3669 on stream 1 at 21-Apr-2021 03:16:58.151 EDT >> cmd: Begin processing the 107th record. Run 1, Event 107, LumiSection 3669 on stream 0 at 21-Apr-2021 03:17:05.749 EDT >> cmd: Begin processing the 108th record. Run 1, Event 108, LumiSection 3669 on stream 2 at 21-Apr-2021 03:17:12.169 EDT >> cmd: Begin processing the 109th record. Run 1, Event 109, LumiSection 3669 on stream 3 at 21-Apr-2021 03:17:15.090 EDT >> cmd: Begin processing the 110th record. Run 1, Event 110, LumiSection 3669 on stream 5 at 21-Apr-2021 03:17:24.401 EDT >> cmd: Begin processing the 111th record. Run 1, Event 111, LumiSection 3669 on stream 0 at 21-Apr-2021 03:17:30.656 EDT >> cmd: Begin processing the 112th record. Run 1, Event 112, LumiSection 3669 on stream 1 at 21-Apr-2021 03:17:34.387 EDT >> cmd: Begin processing the 113th record. Run 1, Event 113, LumiSection 3669 on stream 4 at 21-Apr-2021 03:17:36.455 EDT >> cmd: Begin processing the 114th record. Run 1, Event 114, LumiSection 3669 on stream 5 at 21-Apr-2021 03:17:44.069 EDT >> cmd: Begin processing the 115th record. Run 1, Event 115, LumiSection 3669 on stream 2 at 21-Apr-2021 03:17:56.388 EDT >> cmd: Begin processing the 116th record. Run 1, Event 116, LumiSection 3669 on stream 3 at 21-Apr-2021 03:18:00.702 EDT >> cmd: Begin processing the 117th record. Run 1, Event 117, LumiSection 3669 on stream 0 at 21-Apr-2021 03:18:03.280 EDT >> cmd: Begin processing the 118th record. Run 1, Event 118, LumiSection 3669 on stream 4 at 21-Apr-2021 03:18:15.308 EDT >> cmd: Begin processing the 119th record. Run 1, Event 119, LumiSection 3669 on stream 1 at 21-Apr-2021 03:18:32.484 EDT >> cmd: Begin processing the 120th record. Run 1, Event 120, LumiSection 3669 on stream 0 at 21-Apr-2021 03:18:32.485 EDT >> cmd: Begin processing the 121st record. Run 1, Event 121, LumiSection 3669 on stream 5 at 21-Apr-2021 03:18:37.413 EDT >> cmd: Begin processing the 122nd record. Run 1, Event 122, LumiSection 3669 on stream 2 at 21-Apr-2021 03:18:39.688 EDT >> cmd: Begin processing the 123rd record. Run 1, Event 123, LumiSection 3669 on stream 3 at 21-Apr-2021 03:18:39.729 EDT >> cmd: Begin processing the 124th record. Run 1, Event 124, LumiSection 3669 on stream 5 at 21-Apr-2021 03:18:56.971 EDT >> cmd: Begin processing the 125th record. Run 1, Event 125, LumiSection 3669 on stream 0 at 21-Apr-2021 03:18:57.664 EDT >> cmd: Begin processing the 126th record. Run 1, Event 126, LumiSection 3669 on stream 4 at 21-Apr-2021 03:19:01.156 EDT >> cmd: Begin processing the 127th record. Run 1, Event 127, LumiSection 3669 on stream 1 at 21-Apr-2021 03:19:24.704 EDT >> cmd: Begin processing the 128th record. Run 1, Event 128, LumiSection 3669 on stream 3 at 21-Apr-2021 03:19:25.302 EDT >> cmd: Begin processing the 129th record. Run 1, Event 129, LumiSection 3669 on stream 2 at 21-Apr-2021 03:19:28.781 EDT >> cmd: Begin processing the 130th record. Run 1, Event 130, LumiSection 3669 on stream 4 at 21-Apr-2021 03:19:30.408 EDT >> cmd: Begin processing the 131st record. Run 1, Event 131, LumiSection 3669 on stream 2 at 21-Apr-2021 03:19:40.579 EDT >> cmd: Begin processing the 132nd record. Run 1, Event 132, LumiSection 3669 on stream 0 at 21-Apr-2021 03:19:50.338 EDT >> cmd: Begin processing the 133rd record. Run 1, Event 133, LumiSection 3669 on stream 4 at 21-Apr-2021 03:20:00.763 EDT >> cmd: Begin processing the 134th record. Run 1, Event 134, LumiSection 3669 on stream 1 at 21-Apr-2021 03:20:03.848 EDT >> cmd: Begin processing the 135th record. Run 1, Event 135, LumiSection 3669 on stream 5 at 21-Apr-2021 03:20:07.720 EDT >> cmd: Begin processing the 136th record. Run 1, Event 136, LumiSection 3669 on stream 3 at 21-Apr-2021 03:20:19.817 EDT >> cmd: Begin processing the 137th record. Run 1, Event 137, LumiSection 3669 on stream 2 at 21-Apr-2021 03:20:22.350 EDT >> cmd: Begin processing the 138th record. Run 1, Event 138, LumiSection 3669 on stream 0 at 21-Apr-2021 03:20:30.684 EDT >> cmd: Begin processing the 139th record. Run 1, Event 139, LumiSection 3669 on stream 4 at 21-Apr-2021 03:20:32.033 EDT >> cmd: Begin processing the 140th record. Run 1, Event 140, LumiSection 3669 on stream 1 at 21-Apr-2021 03:20:38.562 EDT >> cmd: Begin processing the 141st record. Run 1, Event 141, LumiSection 3669 on stream 2 at 21-Apr-2021 03:20:44.196 EDT >> cmd: Begin processing the 142nd record. Run 1, Event 142, LumiSection 3669 on stream 4 at 21-Apr-2021 03:20:51.273 EDT >> cmd: Begin processing the 143rd record. Run 1, Event 143, LumiSection 3669 on stream 5 at 21-Apr-2021 03:20:55.703 EDT >> cmd: Begin processing the 144th record. Run 1, Event 144, LumiSection 3669 on stream 1 at 21-Apr-2021 03:21:01.518 EDT >> cmd: Begin processing the 145th record. Run 1, Event 145, LumiSection 3669 on stream 2 at 21-Apr-2021 03:21:05.543 EDT >> cmd: Begin processing the 146th record. Run 1, Event 146, LumiSection 3669 on stream 0 at 21-Apr-2021 03:21:15.966 EDT >> cmd: Begin processing the 147th record. Run 1, Event 147, LumiSection 3669 on stream 1 at 21-Apr-2021 03:21:22.495 EDT >> cmd: Begin processing the 148th record. Run 1, Event 148, LumiSection 3669 on stream 3 at 21-Apr-2021 03:21:23.131 EDT >> cmd: Begin processing the 149th record. Run 1, Event 149, LumiSection 3669 on stream 5 at 21-Apr-2021 03:21:29.359 EDT >> cmd: Begin processing the 150th record. Run 1, Event 150, LumiSection 3669 on stream 4 at 21-Apr-2021 03:21:32.360 EDT >> cmd: Begin processing the 151st record. Run 1, Event 151, LumiSection 3669 on stream 2 at 21-Apr-2021 03:21:41.675 EDT >> cmd: Begin processing the 152nd record. Run 1, Event 152, LumiSection 3669 on stream 0 at 21-Apr-2021 03:21:47.068 EDT >> cmd: Begin processing the 153rd record. Run 1, Event 153, LumiSection 3669 on stream 4 at 21-Apr-2021 03:21:59.180 EDT >> cmd: Begin processing the 154th record. Run 1, Event 154, LumiSection 3669 on stream 1 at 21-Apr-2021 03:22:00.441 EDT >> cmd: Begin processing the 155th record. Run 1, Event 155, LumiSection 3669 on stream 2 at 21-Apr-2021 03:22:05.413 EDT >> cmd: Begin processing the 156th record. Run 1, Event 156, LumiSection 3669 on stream 3 at 21-Apr-2021 03:22:16.806 EDT >> cmd: Begin processing the 157th record. Run 1, Event 157, LumiSection 3669 on stream 5 at 21-Apr-2021 03:22:23.133 EDT >> cmd: Begin processing the 158th record. Run 1, Event 158, LumiSection 3669 on stream 2 at 21-Apr-2021 03:22:23.147 EDT >> cmd: Begin processing the 159th record. Run 1, Event 159, LumiSection 3669 on stream 4 at 21-Apr-2021 03:22:34.761 EDT >> cmd: Begin processing the 160th record. Run 1, Event 160, LumiSection 3669 on stream 0 at 21-Apr-2021 03:22:38.235 EDT >> cmd: Begin processing the 161st record. Run 1, Event 161, LumiSection 3669 on stream 1 at 21-Apr-2021 03:22:47.121 EDT >> cmd: Begin processing the 162nd record. Run 1, Event 162, LumiSection 3669 on stream 3 at 21-Apr-2021 03:22:53.129 EDT >> cmd: Begin processing the 163rd record. Run 1, Event 163, LumiSection 3669 on stream 2 at 21-Apr-2021 03:22:58.174 EDT >> cmd: Begin processing the 164th record. Run 1, Event 164, LumiSection 3669 on stream 1 at 21-Apr-2021 03:23:03.822 EDT >> cmd: Begin processing the 165th record. Run 1, Event 165, LumiSection 3669 on stream 5 at 21-Apr-2021 03:23:06.310 EDT >> cmd: Begin processing the 166th record. Run 1, Event 166, LumiSection 3669 on stream 4 at 21-Apr-2021 03:23:12.001 EDT >> cmd: Begin processing the 167th record. Run 1, Event 167, LumiSection 3669 on stream 0 at 21-Apr-2021 03:23:19.953 EDT >> cmd: Begin processing the 168th record. Run 1, Event 168, LumiSection 3669 on stream 2 at 21-Apr-2021 03:23:20.553 EDT >> cmd: Begin processing the 169th record. Run 1, Event 169, LumiSection 3669 on stream 5 at 21-Apr-2021 03:23:21.997 EDT >> cmd: Begin processing the 170th record. Run 1, Event 170, LumiSection 3669 on stream 3 at 21-Apr-2021 03:23:30.956 EDT >> cmd: Begin processing the 171st record. Run 1, Event 171, LumiSection 3669 on stream 4 at 21-Apr-2021 03:23:40.324 EDT >> cmd: Begin processing the 172nd record. Run 1, Event 172, LumiSection 3669 on stream 5 at 21-Apr-2021 03:23:41.478 EDT >> cmd: Begin processing the 173rd record. Run 1, Event 173, LumiSection 3669 on stream 2 at 21-Apr-2021 03:24:05.320 EDT >> cmd: Begin processing the 174th record. Run 1, Event 174, LumiSection 3669 on stream 1 at 21-Apr-2021 03:24:11.990 EDT >> cmd: Begin processing the 175th record. Run 1, Event 175, LumiSection 3669 on stream 0 at 21-Apr-2021 03:24:13.572 EDT >> cmd: Begin processing the 176th record. Run 1, Event 176, LumiSection 3669 on stream 3 at 21-Apr-2021 03:24:26.339 EDT >> cmd: Begin processing the 177th record. Run 1, Event 177, LumiSection 3669 on stream 4 at 21-Apr-2021 03:24:28.442 EDT >> cmd: Begin processing the 178th record. Run 1, Event 178, LumiSection 3669 on stream 1 at 21-Apr-2021 03:24:41.431 EDT >> cmd: Begin processing the 179th record. Run 1, Event 179, LumiSection 3669 on stream 5 at 21-Apr-2021 03:24:48.213 EDT >> cmd: Begin processing the 180th record. Run 1, Event 180, LumiSection 3669 on stream 0 at 21-Apr-2021 03:24:57.261 EDT >> cmd: Begin processing the 181st record. Run 1, Event 181, LumiSection 3669 on stream 2 at 21-Apr-2021 03:25:05.217 EDT >> cmd: Begin processing the 182nd record. Run 1, Event 182, LumiSection 3669 on stream 3 at 21-Apr-2021 03:25:09.039 EDT >> cmd: Begin processing the 183rd record. Run 1, Event 183, LumiSection 3669 on stream 4 at 21-Apr-2021 03:25:15.464 EDT >> cmd: Begin processing the 184th record. Run 1, Event 184, LumiSection 3669 on stream 1 at 21-Apr-2021 03:25:18.198 EDT >> cmd: Begin processing the 185th record. Run 1, Event 185, LumiSection 3669 on stream 5 at 21-Apr-2021 03:25:24.252 EDT >> cmd: Begin processing the 186th record. Run 1, Event 186, LumiSection 3669 on stream 0 at 21-Apr-2021 03:25:31.456 EDT >> cmd: Begin processing the 187th record. Run 1, Event 187, LumiSection 3669 on stream 2 at 21-Apr-2021 03:25:33.550 EDT >> cmd: Begin processing the 188th record. Run 1, Event 188, LumiSection 3669 on stream 5 at 21-Apr-2021 03:25:46.024 EDT >> cmd: Begin processing the 189th record. Run 1, Event 189, LumiSection 3669 on stream 1 at 21-Apr-2021 03:25:49.778 EDT >> cmd: Begin processing the 190th record. Run 1, Event 190, LumiSection 3669 on stream 0 at 21-Apr-2021 03:25:55.602 EDT >> cmd: Begin processing the 191st record. Run 1, Event 191, LumiSection 3669 on stream 2 at 21-Apr-2021 03:25:55.615 EDT >> cmd: Begin processing the 192nd record. Run 1, Event 192, LumiSection 3669 on stream 3 at 21-Apr-2021 03:26:03.845 EDT >> cmd: Begin processing the 193rd record. Run 1, Event 193, LumiSection 3669 on stream 5 at 21-Apr-2021 03:26:06.895 EDT >> cmd: Begin processing the 194th record. Run 1, Event 194, LumiSection 3669 on stream 4 at 21-Apr-2021 03:26:19.197 EDT >> cmd: Begin processing the 195th record. Run 1, Event 195, LumiSection 3669 on stream 0 at 21-Apr-2021 03:26:24.066 EDT >> cmd: Begin processing the 196th record. Run 1, Event 196, LumiSection 3669 on stream 3 at 21-Apr-2021 03:26:25.373 EDT >> cmd: Begin processing the 197th record. Run 1, Event 197, LumiSection 3669 on stream 1 at 21-Apr-2021 03:26:33.643 EDT >> cmd: Begin processing the 198th record. Run 1, Event 198, LumiSection 3669 on stream 2 at 21-Apr-2021 03:26:35.306 EDT >> cmd: Begin processing the 199th record. Run 1, Event 199, LumiSection 3669 on stream 5 at 21-Apr-2021 03:26:41.730 EDT >> cmd: Begin processing the 200th record. Run 1, Event 200, LumiSection 3669 on stream 0 at 21-Apr-2021 03:26:44.721 EDT >> cmd: Begin processing the 201st record. Run 1, Event 201, LumiSection 3669 on stream 4 at 21-Apr-2021 03:26:58.141 EDT >> cmd: Begin processing the 202nd record. Run 1, Event 202, LumiSection 3669 on stream 2 at 21-Apr-2021 03:27:00.041 EDT >> cmd: Begin processing the 203rd record. Run 1, Event 203, LumiSection 3669 on stream 0 at 21-Apr-2021 03:27:05.796 EDT >> cmd: Begin processing the 204th record. Run 1, Event 204, LumiSection 3669 on stream 3 at 21-Apr-2021 03:27:06.079 EDT >> cmd: Begin processing the 205th record. Run 1, Event 205, LumiSection 3669 on stream 1 at 21-Apr-2021 03:27:09.556 EDT >> cmd: Begin processing the 206th record. Run 1, Event 206, LumiSection 3669 on stream 4 at 21-Apr-2021 03:27:39.347 EDT >> cmd: Begin processing the 207th record. Run 1, Event 207, LumiSection 3669 on stream 3 at 21-Apr-2021 03:27:49.173 EDT >> cmd: Begin processing the 208th record. Run 1, Event 208, LumiSection 3669 on stream 0 at 21-Apr-2021 03:27:55.542 EDT >> cmd: Begin processing the 209th record. Run 1, Event 209, LumiSection 3669 on stream 1 at 21-Apr-2021 03:27:55.915 EDT >> cmd: Begin processing the 210th record. Run 1, Event 210, LumiSection 3669 on stream 4 at 21-Apr-2021 03:27:58.015 EDT >> cmd: Begin processing the 211th record. Run 1, Event 211, LumiSection 3669 on stream 2 at 21-Apr-2021 03:27:59.576 EDT >> cmd: Begin processing the 212th record. Run 1, Event 212, LumiSection 3669 on stream 3 at 21-Apr-2021 03:28:16.690 EDT >> cmd: Begin processing the 213th record. Run 1, Event 213, LumiSection 3669 on stream 2 at 21-Apr-2021 03:28:25.594 EDT >> cmd: Begin processing the 214th record. Run 1, Event 214, LumiSection 3669 on stream 4 at 21-Apr-2021 03:28:35.111 EDT >> cmd: Begin processing the 215th record. Run 1, Event 215, LumiSection 3669 on stream 5 at 21-Apr-2021 03:28:35.315 EDT >> cmd: Begin processing the 216th record. Run 1, Event 216, LumiSection 3669 on stream 2 at 21-Apr-2021 03:28:42.994 EDT >> cmd: Begin processing the 217th record. Run 1, Event 217, LumiSection 3669 on stream 0 at 21-Apr-2021 03:28:45.696 EDT >> cmd: Begin processing the 218th record. Run 1, Event 218, LumiSection 3669 on stream 1 at 21-Apr-2021 03:28:47.997 EDT >> cmd: Begin processing the 219th record. Run 1, Event 219, LumiSection 3669 on stream 5 at 21-Apr-2021 03:28:58.835 EDT >> cmd: Begin processing the 220th record. Run 1, Event 220, LumiSection 3669 on stream 4 at 21-Apr-2021 03:29:00.976 EDT >> cmd: Begin processing the 221st record. Run 1, Event 221, LumiSection 3669 on stream 3 at 21-Apr-2021 03:29:04.847 EDT >> cmd: Begin processing the 222nd record. Run 1, Event 222, LumiSection 3669 on stream 1 at 21-Apr-2021 03:29:10.568 EDT >> cmd: Begin processing the 223rd record. Run 1, Event 223, LumiSection 3669 on stream 5 at 21-Apr-2021 03:29:20.031 EDT >> cmd: Begin processing the 224th record. Run 1, Event 224, LumiSection 3669 on stream 3 at 21-Apr-2021 03:29:37.996 EDT >> cmd: Begin processing the 225th record. Run 1, Event 225, LumiSection 3669 on stream 0 at 21-Apr-2021 03:29:45.510 EDT >> cmd: Begin processing the 226th record. Run 1, Event 226, LumiSection 3669 on stream 4 at 21-Apr-2021 03:29:54.554 EDT >> cmd: Begin processing the 227th record. Run 1, Event 227, LumiSection 3669 on stream 1 at 21-Apr-2021 03:29:55.687 EDT >> cmd: Begin processing the 228th record. Run 1, Event 228, LumiSection 3669 on stream 2 at 21-Apr-2021 03:30:00.212 EDT >> cmd: Begin processing the 229th record. Run 1, Event 229, LumiSection 3669 on stream 3 at 21-Apr-2021 03:30:12.157 EDT >> cmd: Begin processing the 230th record. Run 1, Event 230, LumiSection 3669 on stream 4 at 21-Apr-2021 03:30:18.961 EDT >> cmd: Begin processing the 231st record. Run 1, Event 231, LumiSection 3669 on stream 5 at 21-Apr-2021 03:30:23.731 EDT >> cmd: Begin processing the 232nd record. Run 1, Event 232, LumiSection 3669 on stream 2 at 21-Apr-2021 03:30:27.232 EDT >> cmd: Begin processing the 233rd record. Run 1, Event 233, LumiSection 3669 on stream 2 at 21-Apr-2021 03:30:39.173 EDT >> cmd: Begin processing the 234th record. Run 1, Event 234, LumiSection 3669 on stream 1 at 21-Apr-2021 03:30:40.454 EDT >> cmd: Begin processing the 235th record. Run 1, Event 235, LumiSection 3669 on stream 3 at 21-Apr-2021 03:30:44.106 EDT >> cmd: Begin processing the 236th record. Run 1, Event 236, LumiSection 3669 on stream 0 at 21-Apr-2021 03:30:54.700 EDT >> cmd: Begin processing the 237th record. Run 1, Event 237, LumiSection 3669 on stream 4 at 21-Apr-2021 03:31:01.783 EDT >> cmd: Begin processing the 238th record. Run 1, Event 238, LumiSection 3669 on stream 5 at 21-Apr-2021 03:31:03.223 EDT >> cmd: Begin processing the 239th record. Run 1, Event 239, LumiSection 3669 on stream 0 at 21-Apr-2021 03:31:16.355 EDT >> cmd: Begin processing the 240th record. Run 1, Event 240, LumiSection 3669 on stream 1 at 21-Apr-2021 03:31:18.202 EDT >> cmd: Begin processing the 241st record. Run 1, Event 241, LumiSection 3669 on stream 2 at 21-Apr-2021 03:31:18.411 EDT >> cmd: Begin processing the 242nd record. Run 1, Event 242, LumiSection 3669 on stream 5 at 21-Apr-2021 03:31:21.681 EDT >> cmd: Begin processing the 243rd record. Run 1, Event 243, LumiSection 3669 on stream 4 at 21-Apr-2021 03:31:27.458 EDT >> cmd: Begin processing the 244th record. Run 1, Event 244, LumiSection 3669 on stream 3 at 21-Apr-2021 03:31:28.208 EDT >> cmd: Begin processing the 245th record. Run 1, Event 245, LumiSection 3669 on stream 0 at 21-Apr-2021 03:31:46.546 EDT >> cmd: Begin processing the 246th record. Run 1, Event 246, LumiSection 3669 on stream 2 at 21-Apr-2021 03:31:46.572 EDT >> cmd: Begin processing the 247th record. Run 1, Event 247, LumiSection 3669 on stream 3 at 21-Apr-2021 03:31:47.669 EDT >> cmd: Begin processing the 248th record. Run 1, Event 248, LumiSection 3669 on stream 1 at 21-Apr-2021 03:32:01.468 EDT >> cmd: Begin processing the 249th record. Run 1, Event 249, LumiSection 3669 on stream 4 at 21-Apr-2021 03:32:17.283 EDT >> cmd: Begin processing the 250th record. Run 1, Event 250, LumiSection 3669 on stream 0 at 21-Apr-2021 03:32:23.156 EDT >> cmd: Begin processing the 251st record. Run 1, Event 251, LumiSection 3669 on stream 5 at 21-Apr-2021 03:32:25.291 EDT >> cmd: Begin processing the 252nd record. Run 1, Event 252, LumiSection 3669 on stream 1 at 21-Apr-2021 03:32:27.583 EDT >> cmd: Begin processing the 253rd record. Run 1, Event 253, LumiSection 3669 on stream 3 at 21-Apr-2021 03:32:45.534 EDT >> cmd: Begin processing the 254th record. Run 1, Event 254, LumiSection 3669 on stream 5 at 21-Apr-2021 03:32:45.551 EDT >> cmd: Begin processing the 255th record. Run 1, Event 255, LumiSection 3669 on stream 4 at 21-Apr-2021 03:32:48.264 EDT >> cmd: Begin processing the 256th record. Run 1, Event 256, LumiSection 3669 on stream 0 at 21-Apr-2021 03:32:53.260 EDT >> cmd: Begin processing the 257th record. Run 1, Event 257, LumiSection 3669 on stream 2 at 21-Apr-2021 03:33:00.663 EDT >> cmd: Begin processing the 258th record. Run 1, Event 258, LumiSection 3669 on stream 5 at 21-Apr-2021 03:33:02.320 EDT >> cmd: Begin processing the 259th record. Run 1, Event 259, LumiSection 3669 on stream 1 at 21-Apr-2021 03:33:09.068 EDT >> cmd: Begin processing the 260th record. Run 1, Event 260, LumiSection 3669 on stream 4 at 21-Apr-2021 03:33:28.227 EDT >> cmd: Begin processing the 261st record. Run 1, Event 261, LumiSection 3669 on stream 0 at 21-Apr-2021 03:33:30.895 EDT >> cmd: Begin processing the 262nd record. Run 1, Event 262, LumiSection 3669 on stream 5 at 21-Apr-2021 03:33:35.065 EDT >> cmd: Begin processing the 263rd record. Run 1, Event 263, LumiSection 3669 on stream 1 at 21-Apr-2021 03:33:36.956 EDT >> cmd: Begin processing the 264th record. Run 1, Event 264, LumiSection 3669 on stream 2 at 21-Apr-2021 03:33:46.510 EDT >> cmd: Begin processing the 265th record. Run 1, Event 265, LumiSection 3669 on stream 3 at 21-Apr-2021 03:33:49.794 EDT >> cmd: Begin processing the 266th record. Run 1, Event 266, LumiSection 3669 on stream 0 at 21-Apr-2021 03:33:59.478 EDT >> cmd: Begin processing the 267th record. Run 1, Event 267, LumiSection 3669 on stream 5 at 21-Apr-2021 03:34:08.667 EDT >> cmd: Begin processing the 268th record. Run 1, Event 268, LumiSection 3669 on stream 1 at 21-Apr-2021 03:34:10.156 EDT >> cmd: Begin processing the 269th record. Run 1, Event 269, LumiSection 3669 on stream 4 at 21-Apr-2021 03:34:11.154 EDT >> cmd: Begin processing the 270th record. Run 1, Event 270, LumiSection 3669 on stream 3 at 21-Apr-2021 03:34:12.700 EDT >> cmd: Begin processing the 271st record. Run 1, Event 271, LumiSection 3669 on stream 2 at 21-Apr-2021 03:34:30.357 EDT >> cmd: Begin processing the 272nd record. Run 1, Event 272, LumiSection 3669 on stream 5 at 21-Apr-2021 03:34:31.311 EDT >> cmd: Begin processing the 273rd record. Run 1, Event 273, LumiSection 3669 on stream 0 at 21-Apr-2021 03:34:41.273 EDT >> cmd: Begin processing the 274th record. Run 1, Event 274, LumiSection 3669 on stream 1 at 21-Apr-2021 03:34:46.889 EDT >> cmd: Begin processing the 275th record. Run 1, Event 275, LumiSection 3669 on stream 4 at 21-Apr-2021 03:34:48.746 EDT >> cmd: Begin processing the 276th record. Run 1, Event 276, LumiSection 3669 on stream 2 at 21-Apr-2021 03:34:59.692 EDT >> cmd: Begin processing the 277th record. Run 1, Event 277, LumiSection 3669 on stream 3 at 21-Apr-2021 03:35:04.004 EDT >> cmd: Begin processing the 278th record. Run 1, Event 278, LumiSection 3669 on stream 1 at 21-Apr-2021 03:35:18.457 EDT >> cmd: Begin processing the 279th record. Run 1, Event 279, LumiSection 3669 on stream 0 at 21-Apr-2021 03:35:20.019 EDT >> cmd: Begin processing the 280th record. Run 1, Event 280, LumiSection 3669 on stream 5 at 21-Apr-2021 03:35:24.307 EDT >> cmd: Begin processing the 281st record. Run 1, Event 281, LumiSection 3669 on stream 4 at 21-Apr-2021 03:35:28.188 EDT >> cmd: Begin processing the 282nd record. Run 1, Event 282, LumiSection 3669 on stream 3 at 21-Apr-2021 03:35:44.248 EDT >> cmd: Begin processing the 283rd record. Run 1, Event 283, LumiSection 3669 on stream 5 at 21-Apr-2021 03:35:44.275 EDT >> cmd: Begin processing the 284th record. Run 1, Event 284, LumiSection 3669 on stream 2 at 21-Apr-2021 03:35:44.697 EDT >> cmd: Begin processing the 285th record. Run 1, Event 285, LumiSection 3669 on stream 1 at 21-Apr-2021 03:35:53.782 EDT >> cmd: Begin processing the 286th record. Run 1, Event 286, LumiSection 3669 on stream 0 at 21-Apr-2021 03:35:58.250 EDT >> cmd: Begin processing the 287th record. Run 1, Event 287, LumiSection 3669 on stream 4 at 21-Apr-2021 03:35:59.506 EDT >> cmd: Begin processing the 288th record. Run 1, Event 288, LumiSection 3669 on stream 2 at 21-Apr-2021 03:36:20.555 EDT >> cmd: Begin processing the 289th record. Run 1, Event 289, LumiSection 3669 on stream 3 at 21-Apr-2021 03:36:22.208 EDT >> cmd: Begin processing the 290th record. Run 1, Event 290, LumiSection 3669 on stream 0 at 21-Apr-2021 03:36:35.088 EDT >> cmd: Begin processing the 291st record. Run 1, Event 291, LumiSection 3669 on stream 5 at 21-Apr-2021 03:36:35.499 EDT >> cmd: Begin processing the 292nd record. Run 1, Event 292, LumiSection 3669 on stream 4 at 21-Apr-2021 03:36:45.135 EDT >> cmd: Begin processing the 293rd record. Run 1, Event 293, LumiSection 3669 on stream 1 at 21-Apr-2021 03:36:48.306 EDT >> cmd: Begin processing the 294th record. Run 1, Event 294, LumiSection 3669 on stream 5 at 21-Apr-2021 03:37:05.482 EDT >> cmd: Begin processing the 295th record. Run 1, Event 295, LumiSection 3669 on stream 3 at 21-Apr-2021 03:37:08.914 EDT >> cmd: Begin processing the 296th record. Run 1, Event 296, LumiSection 3669 on stream 0 at 21-Apr-2021 03:37:10.777 EDT >> cmd: Begin processing the 297th record. Run 1, Event 297, LumiSection 3669 on stream 4 at 21-Apr-2021 03:37:14.152 EDT >> cmd: Begin processing the 298th record. Run 1, Event 298, LumiSection 3669 on stream 2 at 21-Apr-2021 03:37:21.171 EDT >> cmd: Begin processing the 299th record. Run 1, Event 299, LumiSection 3669 on stream 5 at 21-Apr-2021 03:37:27.165 EDT >> cmd: Begin processing the 300th record. Run 1, Event 300, LumiSection 3669 on stream 0 at 21-Apr-2021 03:37:39.175 EDT >> cmd: Begin processing the 301st record. Run 1, Event 301, LumiSection 3669 on stream 1 at 21-Apr-2021 03:37:47.905 EDT >> cmd: Begin processing the 302nd record. Run 1, Event 302, LumiSection 3669 on stream 3 at 21-Apr-2021 03:37:58.956 EDT >> cmd: Begin processing the 303rd record. Run 1, Event 303, LumiSection 3669 on stream 2 at 21-Apr-2021 03:38:05.498 EDT >> cmd: Begin processing the 304th record. Run 1, Event 304, LumiSection 3669 on stream 4 at 21-Apr-2021 03:38:10.660 EDT >> cmd: Begin processing the 305th record. Run 1, Event 305, LumiSection 3669 on stream 0 at 21-Apr-2021 03:38:11.761 EDT >> cmd: Begin processing the 306th record. Run 1, Event 306, LumiSection 3669 on stream 1 at 21-Apr-2021 03:38:24.662 EDT >> cmd: Begin processing the 307th record. Run 1, Event 307, LumiSection 3669 on stream 5 at 21-Apr-2021 03:38:27.879 EDT >> cmd: Begin processing the 308th record. Run 1, Event 308, LumiSection 3669 on stream 0 at 21-Apr-2021 03:38:40.477 EDT >> cmd: Begin processing the 309th record. Run 1, Event 309, LumiSection 3669 on stream 2 at 21-Apr-2021 03:38:42.847 EDT >> cmd: Begin processing the 310th record. Run 1, Event 310, LumiSection 3669 on stream 5 at 21-Apr-2021 03:38:53.207 EDT >> cmd: Begin processing the 311th record. Run 1, Event 311, LumiSection 3669 on stream 4 at 21-Apr-2021 03:38:55.155 EDT >> cmd: Begin processing the 312th record. Run 1, Event 312, LumiSection 3669 on stream 2 at 21-Apr-2021 03:39:05.746 EDT >> cmd: Begin processing the 313th record. Run 1, Event 313, LumiSection 3669 on stream 1 at 21-Apr-2021 03:39:08.839 EDT >> cmd: Begin processing the 314th record. Run 1, Event 314, LumiSection 3669 on stream 5 at 21-Apr-2021 03:39:10.959 EDT >> cmd: Begin processing the 315th record. Run 1, Event 315, LumiSection 3669 on stream 0 at 21-Apr-2021 03:39:19.914 EDT >> cmd: Begin processing the 316th record. Run 1, Event 316, LumiSection 3669 on stream 2 at 21-Apr-2021 03:39:20.454 EDT >> cmd: Begin processing the 317th record. Run 1, Event 317, LumiSection 3669 on stream 3 at 21-Apr-2021 03:39:25.375 EDT >> cmd: Begin processing the 318th record. Run 1, Event 318, LumiSection 3669 on stream 4 at 21-Apr-2021 03:39:27.919 EDT >> cmd: Begin processing the 319th record. Run 1, Event 319, LumiSection 3669 on stream 1 at 21-Apr-2021 03:39:29.125 EDT >> cmd: Begin processing the 320th record. Run 1, Event 320, LumiSection 3669 on stream 5 at 21-Apr-2021 03:39:48.539 EDT >> cmd: Begin processing the 321st record. Run 1, Event 321, LumiSection 3669 on stream 0 at 21-Apr-2021 03:39:57.018 EDT >> cmd: Begin processing the 322nd record. Run 1, Event 322, LumiSection 3669 on stream 2 at 21-Apr-2021 03:39:59.587 EDT >> cmd: Begin processing the 323rd record. Run 1, Event 323, LumiSection 3669 on stream 2 at 21-Apr-2021 03:40:14.913 EDT >> cmd: Begin processing the 324th record. Run 1, Event 324, LumiSection 3669 on stream 3 at 21-Apr-2021 03:40:16.051 EDT >> cmd: Begin processing the 325th record. Run 1, Event 325, LumiSection 3669 on stream 4 at 21-Apr-2021 03:40:17.677 EDT >> cmd: Begin processing the 326th record. Run 1, Event 326, LumiSection 3669 on stream 1 at 21-Apr-2021 03:40:24.027 EDT >> cmd: Begin processing the 327th record. Run 1, Event 327, LumiSection 3669 on stream 0 at 21-Apr-2021 03:40:26.186 EDT >> cmd: Begin processing the 328th record. Run 1, Event 328, LumiSection 3669 on stream 5 at 21-Apr-2021 03:40:30.191 EDT >> cmd: Begin processing the 329th record. Run 1, Event 329, LumiSection 3669 on stream 2 at 21-Apr-2021 03:40:31.467 EDT >> cmd: Begin processing the 330th record. Run 1, Event 330, LumiSection 3669 on stream 3 at 21-Apr-2021 03:40:40.693 EDT >> cmd: Begin processing the 331st record. Run 1, Event 331, LumiSection 3669 on stream 4 at 21-Apr-2021 03:40:41.823 EDT >> cmd: Begin processing the 332nd record. Run 1, Event 332, LumiSection 3669 on stream 1 at 21-Apr-2021 03:40:47.371 EDT >> cmd: Begin processing the 333rd record. Run 1, Event 333, LumiSection 3669 on stream 2 at 21-Apr-2021 03:40:56.198 EDT >> cmd: Begin processing the 334th record. Run 1, Event 334, LumiSection 3669 on stream 5 at 21-Apr-2021 03:41:02.459 EDT >> cmd: Begin processing the 335th record. Run 1, Event 335, LumiSection 3669 on stream 0 at 21-Apr-2021 03:41:20.204 EDT >> cmd: Begin processing the 336th record. Run 1, Event 336, LumiSection 3669 on stream 3 at 21-Apr-2021 03:41:20.567 EDT >> cmd: Begin processing the 337th record. Run 1, Event 337, LumiSection 3669 on stream 1 at 21-Apr-2021 03:41:23.633 EDT >> cmd: Begin processing the 338th record. Run 1, Event 338, LumiSection 3669 on stream 2 at 21-Apr-2021 03:41:23.829 EDT >> cmd: Begin processing the 339th record. Run 1, Event 339, LumiSection 3669 on stream 4 at 21-Apr-2021 03:41:27.310 EDT >> cmd: Begin processing the 340th record. Run 1, Event 340, LumiSection 3669 on stream 5 at 21-Apr-2021 03:41:45.550 EDT >> cmd: Begin processing the 341st record. Run 1, Event 341, LumiSection 3669 on stream 1 at 21-Apr-2021 03:41:53.543 EDT >> cmd: Begin processing the 342nd record. Run 1, Event 342, LumiSection 3669 on stream 2 at 21-Apr-2021 03:42:00.243 EDT >> cmd: Begin processing the 343rd record. Run 1, Event 343, LumiSection 3669 on stream 0 at 21-Apr-2021 03:42:00.271 EDT >> cmd: Begin processing the 344th record. Run 1, Event 344, LumiSection 3669 on stream 1 at 21-Apr-2021 03:42:15.966 EDT >> cmd: Begin processing the 345th record. Run 1, Event 345, LumiSection 3669 on stream 4 at 21-Apr-2021 03:42:20.055 EDT >> cmd: Begin processing the 346th record. Run 1, Event 346, LumiSection 3669 on stream 3 at 21-Apr-2021 03:42:22.902 EDT >> cmd: Begin processing the 347th record. Run 1, Event 347, LumiSection 3669 on stream 2 at 21-Apr-2021 03:42:36.417 EDT >> cmd: Begin processing the 348th record. Run 1, Event 348, LumiSection 3669 on stream 5 at 21-Apr-2021 03:42:42.734 EDT >> cmd: Begin processing the 349th record. Run 1, Event 349, LumiSection 3669 on stream 0 at 21-Apr-2021 03:42:48.017 EDT >> cmd: Begin processing the 350th record. Run 1, Event 350, LumiSection 3669 on stream 1 at 21-Apr-2021 03:42:56.196 EDT >> cmd: Begin processing the 351st record. Run 1, Event 351, LumiSection 3669 on stream 2 at 21-Apr-2021 03:43:09.094 EDT >> cmd: Begin processing the 352nd record. Run 1, Event 352, LumiSection 3669 on stream 5 at 21-Apr-2021 03:43:10.287 EDT >> cmd: Begin processing the 353rd record. Run 1, Event 353, LumiSection 3669 on stream 4 at 21-Apr-2021 03:43:19.796 EDT >> cmd: Begin processing the 354th record. Run 1, Event 354, LumiSection 3669 on stream 5 at 21-Apr-2021 03:43:33.122 EDT >> cmd: Begin processing the 355th record. Run 1, Event 355, LumiSection 3669 on stream 3 at 21-Apr-2021 03:43:37.738 EDT >> cmd: Begin processing the 356th record. Run 1, Event 356, LumiSection 3669 on stream 0 at 21-Apr-2021 03:43:39.014 EDT >> cmd: Begin processing the 357th record. Run 1, Event 357, LumiSection 3669 on stream 0 at 21-Apr-2021 03:43:56.519 EDT >> cmd: Begin processing the 358th record. Run 1, Event 358, LumiSection 3669 on stream 1 at 21-Apr-2021 03:43:58.791 EDT >> cmd: Begin processing the 359th record. Run 1, Event 359, LumiSection 3669 on stream 5 at 21-Apr-2021 03:44:01.371 EDT >> cmd: Begin processing the 360th record. Run 1, Event 360, LumiSection 3669 on stream 4 at 21-Apr-2021 03:44:12.360 EDT >> cmd: Begin processing the 361st record. Run 1, Event 361, LumiSection 3669 on stream 2 at 21-Apr-2021 03:44:14.107 EDT >> cmd: Begin processing the 362nd record. Run 1, Event 362, LumiSection 3669 on stream 3 at 21-Apr-2021 03:44:18.927 EDT >> cmd: Begin processing the 363rd record. Run 1, Event 363, LumiSection 3669 on stream 4 at 21-Apr-2021 03:44:20.687 EDT >> cmd: Begin processing the 364th record. Run 1, Event 364, LumiSection 3669 on stream 5 at 21-Apr-2021 03:44:24.748 EDT >> cmd: Begin processing the 365th record. Run 1, Event 365, LumiSection 3669 on stream 0 at 21-Apr-2021 03:44:39.774 EDT >> cmd: Begin processing the 366th record. Run 1, Event 366, LumiSection 3669 on stream 2 at 21-Apr-2021 03:44:44.466 EDT >> cmd: Begin processing the 367th record. Run 1, Event 367, LumiSection 3669 on stream 4 at 21-Apr-2021 03:44:49.000 EDT >> cmd: Begin processing the 368th record. Run 1, Event 368, LumiSection 3669 on stream 3 at 21-Apr-2021 03:44:52.355 EDT >> cmd: Begin processing the 369th record. Run 1, Event 369, LumiSection 3669 on stream 1 at 21-Apr-2021 03:44:57.853 EDT >> cmd: Begin processing the 370th record. Run 1, Event 370, LumiSection 3669 on stream 2 at 21-Apr-2021 03:45:05.451 EDT >> cmd: Begin processing the 371st record. Run 1, Event 371, LumiSection 3669 on stream 0 at 21-Apr-2021 03:45:06.635 EDT >> cmd: Begin processing the 372nd record. Run 1, Event 372, LumiSection 3669 on stream 4 at 21-Apr-2021 03:45:10.487 EDT >> cmd: Begin processing the 373rd record. Run 1, Event 373, LumiSection 3669 on stream 5 at 21-Apr-2021 03:45:19.269 EDT >> cmd: Begin processing the 374th record. Run 1, Event 374, LumiSection 3669 on stream 0 at 21-Apr-2021 03:45:33.687 EDT >> cmd: Begin processing the 375th record. Run 1, Event 375, LumiSection 3669 on stream 4 at 21-Apr-2021 03:45:40.703 EDT >> cmd: Begin processing the 376th record. Run 1, Event 376, LumiSection 3669 on stream 2 at 21-Apr-2021 03:45:42.959 EDT >> cmd: Begin processing the 377th record. Run 1, Event 377, LumiSection 3669 on stream 1 at 21-Apr-2021 03:45:48.579 EDT >> cmd: Begin processing the 378th record. Run 1, Event 378, LumiSection 3669 on stream 3 at 21-Apr-2021 03:45:54.149 EDT >> cmd: Begin processing the 379th record. Run 1, Event 379, LumiSection 3669 on stream 5 at 21-Apr-2021 03:45:57.636 EDT >> cmd: Begin processing the 380th record. Run 1, Event 380, LumiSection 3669 on stream 2 at 21-Apr-2021 03:46:06.796 EDT >> cmd: Begin processing the 381st record. Run 1, Event 381, LumiSection 3669 on stream 0 at 21-Apr-2021 03:46:23.290 EDT >> cmd: Begin processing the 382nd record. Run 1, Event 382, LumiSection 3669 on stream 5 at 21-Apr-2021 03:46:29.861 EDT >> cmd: Begin processing the 383rd record. Run 1, Event 383, LumiSection 3669 on stream 2 at 21-Apr-2021 03:46:31.051 EDT >> cmd: Begin processing the 384th record. Run 1, Event 384, LumiSection 3669 on stream 3 at 21-Apr-2021 03:46:34.346 EDT >> cmd: Begin processing the 385th record. Run 1, Event 385, LumiSection 3669 on stream 4 at 21-Apr-2021 03:46:41.661 EDT >> cmd: Begin processing the 386th record. Run 1, Event 386, LumiSection 3669 on stream 0 at 21-Apr-2021 03:46:53.347 EDT >> cmd: Begin processing the 387th record. Run 1, Event 387, LumiSection 3669 on stream 1 at 21-Apr-2021 03:47:04.363 EDT >> cmd: Begin processing the 388th record. Run 1, Event 388, LumiSection 3669 on stream 0 at 21-Apr-2021 03:47:15.998 EDT >> cmd: Begin processing the 389th record. Run 1, Event 389, LumiSection 3669 on stream 3 at 21-Apr-2021 03:47:16.596 EDT >> cmd: Begin processing the 390th record. Run 1, Event 390, LumiSection 3669 on stream 2 at 21-Apr-2021 03:47:21.076 EDT >> cmd: Begin processing the 391st record. Run 1, Event 391, LumiSection 3669 on stream 5 at 21-Apr-2021 03:47:27.870 EDT >> cmd: Begin processing the 392nd record. Run 1, Event 392, LumiSection 3669 on stream 4 at 21-Apr-2021 03:47:35.983 EDT >> cmd: Begin processing the 393rd record. Run 1, Event 393, LumiSection 3669 on stream 2 at 21-Apr-2021 03:47:49.523 EDT >> cmd: Begin processing the 394th record. Run 1, Event 394, LumiSection 3669 on stream 3 at 21-Apr-2021 03:47:50.460 EDT >> cmd: Begin processing the 395th record. Run 1, Event 395, LumiSection 3669 on stream 5 at 21-Apr-2021 03:47:58.747 EDT >> cmd: Begin processing the 396th record. Run 1, Event 396, LumiSection 3669 on stream 0 at 21-Apr-2021 03:48:04.238 EDT >> cmd: Begin processing the 397th record. Run 1, Event 397, LumiSection 3669 on stream 1 at 21-Apr-2021 03:48:15.076 EDT >> cmd: Begin processing the 398th record. Run 1, Event 398, LumiSection 3669 on stream 4 at 21-Apr-2021 03:48:15.299 EDT >> cmd: Begin processing the 399th record. Run 1, Event 399, LumiSection 3669 on stream 3 at 21-Apr-2021 03:48:32.549 EDT >> cmd: Begin processing the 400th record. Run 1, Event 400, LumiSection 3669 on stream 0 at 21-Apr-2021 03:48:33.898 EDT >> cmd: Begin processing the 401st record. Run 1, Event 401, LumiSection 3669 on stream 1 at 21-Apr-2021 03:48:39.119 EDT >> cmd: Begin processing the 402nd record. Run 1, Event 402, LumiSection 3669 on stream 5 at 21-Apr-2021 03:48:41.426 EDT >> cmd: Begin processing the 403rd record. Run 1, Event 403, LumiSection 3669 on stream 2 at 21-Apr-2021 03:48:54.035 EDT >> cmd: Begin processing the 404th record. Run 1, Event 404, LumiSection 3669 on stream 5 at 21-Apr-2021 03:48:58.080 EDT >> cmd: Begin processing the 405th record. Run 1, Event 405, LumiSection 3669 on stream 4 at 21-Apr-2021 03:49:02.714 EDT >> cmd: Begin processing the 406th record. Run 1, Event 406, LumiSection 3669 on stream 0 at 21-Apr-2021 03:49:06.054 EDT >> cmd: Begin processing the 407th record. Run 1, Event 407, LumiSection 3669 on stream 2 at 21-Apr-2021 03:49:08.776 EDT >> cmd: Begin processing the 408th record. Run 1, Event 408, LumiSection 3669 on stream 3 at 21-Apr-2021 03:49:17.797 EDT >> cmd: Begin processing the 409th record. Run 1, Event 409, LumiSection 3669 on stream 4 at 21-Apr-2021 03:49:19.749 EDT >> cmd: Begin processing the 410th record. Run 1, Event 410, LumiSection 3669 on stream 1 at 21-Apr-2021 03:49:28.431 EDT >> cmd: Begin processing the 411th record. Run 1, Event 411, LumiSection 3669 on stream 0 at 21-Apr-2021 03:49:30.506 EDT >> cmd: Begin processing the 412th record. Run 1, Event 412, LumiSection 3669 on stream 2 at 21-Apr-2021 03:49:33.207 EDT >> cmd: Begin processing the 413th record. Run 1, Event 413, LumiSection 3669 on stream 3 at 21-Apr-2021 03:49:44.602 EDT >> cmd: Begin processing the 414th record. Run 1, Event 414, LumiSection 3669 on stream 4 at 21-Apr-2021 03:49:46.402 EDT >> cmd: Begin processing the 415th record. Run 1, Event 415, LumiSection 3669 on stream 1 at 21-Apr-2021 03:49:58.898 EDT >> cmd: Begin processing the 416th record. Run 1, Event 416, LumiSection 3669 on stream 5 at 21-Apr-2021 03:50:04.584 EDT >> cmd: Begin processing the 417th record. Run 1, Event 417, LumiSection 3669 on stream 3 at 21-Apr-2021 03:50:08.866 EDT >> cmd: Begin processing the 418th record. Run 1, Event 418, LumiSection 3669 on stream 4 at 21-Apr-2021 03:50:10.917 EDT >> cmd: Begin processing the 419th record. Run 1, Event 419, LumiSection 3669 on stream 0 at 21-Apr-2021 03:50:17.164 EDT >> cmd: Begin processing the 420th record. Run 1, Event 420, LumiSection 3669 on stream 2 at 21-Apr-2021 03:50:21.750 EDT >> cmd: Begin processing the 421st record. Run 1, Event 421, LumiSection 3669 on stream 4 at 21-Apr-2021 03:50:35.228 EDT >> cmd: Begin processing the 422nd record. Run 1, Event 422, LumiSection 3669 on stream 1 at 21-Apr-2021 03:50:47.900 EDT >> cmd: Begin processing the 423rd record. Run 1, Event 423, LumiSection 3669 on stream 3 at 21-Apr-2021 03:50:54.795 EDT >> cmd: Begin processing the 424th record. Run 1, Event 424, LumiSection 3669 on stream 0 at 21-Apr-2021 03:51:08.189 EDT >> cmd: Begin processing the 425th record. Run 1, Event 425, LumiSection 3669 on stream 2 at 21-Apr-2021 03:51:10.115 EDT >> cmd: Begin processing the 426th record. Run 1, Event 426, LumiSection 3669 on stream 4 at 21-Apr-2021 03:51:11.820 EDT >> cmd: Begin processing the 427th record. Run 1, Event 427, LumiSection 3669 on stream 5 at 21-Apr-2021 03:51:18.182 EDT >> cmd: Begin processing the 428th record. Run 1, Event 428, LumiSection 3669 on stream 3 at 21-Apr-2021 03:51:27.073 EDT >> cmd: Begin processing the 429th record. Run 1, Event 429, LumiSection 3669 on stream 1 at 21-Apr-2021 03:51:31.142 EDT >> cmd: Begin processing the 430th record. Run 1, Event 430, LumiSection 3669 on stream 2 at 21-Apr-2021 03:51:55.388 EDT >> cmd: Begin processing the 431st record. Run 1, Event 431, LumiSection 3669 on stream 4 at 21-Apr-2021 03:51:56.977 EDT >> cmd: Begin processing the 432nd record. Run 1, Event 432, LumiSection 3669 on stream 1 at 21-Apr-2021 03:52:02.515 EDT >> cmd: Begin processing the 433rd record. Run 1, Event 433, LumiSection 3669 on stream 5 at 21-Apr-2021 03:52:07.298 EDT >> cmd: Begin processing the 434th record. Run 1, Event 434, LumiSection 3669 on stream 3 at 21-Apr-2021 03:52:20.291 EDT >> cmd: Begin processing the 435th record. Run 1, Event 435, LumiSection 3669 on stream 0 at 21-Apr-2021 03:52:20.692 EDT >> cmd: Begin processing the 436th record. Run 1, Event 436, LumiSection 3669 on stream 4 at 21-Apr-2021 03:52:21.863 EDT >> cmd: Begin processing the 437th record. Run 1, Event 437, LumiSection 3669 on stream 1 at 21-Apr-2021 03:52:25.884 EDT >> cmd: Begin processing the 438th record. Run 1, Event 438, LumiSection 3669 on stream 5 at 21-Apr-2021 03:52:27.519 EDT >> cmd: Begin processing the 439th record. Run 1, Event 439, LumiSection 3669 on stream 2 at 21-Apr-2021 03:52:37.610 EDT >> cmd: Begin processing the 440th record. Run 1, Event 440, LumiSection 3669 on stream 5 at 21-Apr-2021 03:52:46.041 EDT >> cmd: Begin processing the 441st record. Run 1, Event 441, LumiSection 3669 on stream 4 at 21-Apr-2021 03:52:47.858 EDT >> cmd: Begin processing the 442nd record. Run 1, Event 442, LumiSection 3669 on stream 0 at 21-Apr-2021 03:52:50.411 EDT >> cmd: Begin processing the 443rd record. Run 1, Event 443, LumiSection 3669 on stream 3 at 21-Apr-2021 03:53:01.512 EDT >> cmd: Begin processing the 444th record. Run 1, Event 444, LumiSection 3669 on stream 1 at 21-Apr-2021 03:53:11.368 EDT >> cmd: Begin processing the 445th record. Run 1, Event 445, LumiSection 3669 on stream 0 at 21-Apr-2021 03:53:29.327 EDT >> cmd: Begin processing the 446th record. Run 1, Event 446, LumiSection 3669 on stream 2 at 21-Apr-2021 03:53:32.216 EDT >> cmd: Begin processing the 447th record. Run 1, Event 447, LumiSection 3669 on stream 5 at 21-Apr-2021 03:53:34.095 EDT >> cmd: Begin processing the 448th record. Run 1, Event 448, LumiSection 3669 on stream 4 at 21-Apr-2021 03:53:34.351 EDT >> cmd: Begin processing the 449th record. Run 1, Event 449, LumiSection 3669 on stream 3 at 21-Apr-2021 03:53:54.799 EDT >> cmd: Begin processing the 450th record. Run 1, Event 450, LumiSection 3669 on stream 4 at 21-Apr-2021 03:54:01.641 EDT >> cmd: Begin processing the 451st record. Run 1, Event 451, LumiSection 3669 on stream 1 at 21-Apr-2021 03:54:02.283 EDT >> cmd: Begin processing the 452nd record. Run 1, Event 452, LumiSection 3669 on stream 0 at 21-Apr-2021 03:54:03.372 EDT >> cmd: Begin processing the 453rd record. Run 1, Event 453, LumiSection 3669 on stream 5 at 21-Apr-2021 03:54:07.178 EDT >> cmd: Begin processing the 454th record. Run 1, Event 454, LumiSection 3669 on stream 2 at 21-Apr-2021 03:54:20.101 EDT >> cmd: Begin processing the 455th record. Run 1, Event 455, LumiSection 3669 on stream 4 at 21-Apr-2021 03:54:36.235 EDT >> cmd: Begin processing the 456th record. Run 1, Event 456, LumiSection 3669 on stream 0 at 21-Apr-2021 03:54:43.343 EDT >> cmd: Begin processing the 457th record. Run 1, Event 457, LumiSection 3669 on stream 1 at 21-Apr-2021 03:54:52.205 EDT >> cmd: Begin processing the 458th record. Run 1, Event 458, LumiSection 3669 on stream 3 at 21-Apr-2021 03:55:00.533 EDT >> cmd: Begin processing the 459th record. Run 1, Event 459, LumiSection 3669 on stream 5 at 21-Apr-2021 03:55:04.117 EDT >> cmd: Begin processing the 460th record. Run 1, Event 460, LumiSection 3669 on stream 4 at 21-Apr-2021 03:55:08.252 EDT >> cmd: Begin processing the 461st record. Run 1, Event 461, LumiSection 3669 on stream 0 at 21-Apr-2021 03:55:13.121 EDT >> cmd: Begin processing the 462nd record. Run 1, Event 462, LumiSection 3669 on stream 2 at 21-Apr-2021 03:55:21.673 EDT >> cmd: Begin processing the 463rd record. Run 1, Event 463, LumiSection 3669 on stream 3 at 21-Apr-2021 03:55:34.930 EDT >> cmd: Begin processing the 464th record. Run 1, Event 464, LumiSection 3669 on stream 4 at 21-Apr-2021 03:55:37.154 EDT >> cmd: Begin processing the 465th record. Run 1, Event 465, LumiSection 3669 on stream 1 at 21-Apr-2021 03:55:39.257 EDT >> cmd: Begin processing the 466th record. Run 1, Event 466, LumiSection 3669 on stream 0 at 21-Apr-2021 03:55:42.580 EDT >> cmd: Begin processing the 467th record. Run 1, Event 467, LumiSection 3669 on stream 5 at 21-Apr-2021 03:55:50.878 EDT >> cmd: Begin processing the 468th record. Run 1, Event 468, LumiSection 3669 on stream 2 at 21-Apr-2021 03:55:51.313 EDT >> cmd: Begin processing the 469th record. Run 1, Event 469, LumiSection 3669 on stream 4 at 21-Apr-2021 03:55:59.535 EDT >> cmd: Begin processing the 470th record. Run 1, Event 470, LumiSection 3669 on stream 3 at 21-Apr-2021 03:56:09.127 EDT >> cmd: Begin processing the 471st record. Run 1, Event 471, LumiSection 3669 on stream 5 at 21-Apr-2021 03:56:11.769 EDT >> cmd: Begin processing the 472nd record. Run 1, Event 472, LumiSection 3669 on stream 2 at 21-Apr-2021 03:56:17.939 EDT >> cmd: Begin processing the 473rd record. Run 1, Event 473, LumiSection 3669 on stream 1 at 21-Apr-2021 03:56:20.470 EDT >> cmd: Begin processing the 474th record. Run 1, Event 474, LumiSection 3669 on stream 0 at 21-Apr-2021 03:56:32.944 EDT >> cmd: Begin processing the 475th record. Run 1, Event 475, LumiSection 3669 on stream 2 at 21-Apr-2021 03:56:48.524 EDT >> cmd: Begin processing the 476th record. Run 1, Event 476, LumiSection 3669 on stream 5 at 21-Apr-2021 03:56:52.620 EDT >> cmd: Begin processing the 477th record. Run 1, Event 477, LumiSection 3669 on stream 1 at 21-Apr-2021 03:56:55.603 EDT >> cmd: Begin processing the 478th record. Run 1, Event 478, LumiSection 3669 on stream 0 at 21-Apr-2021 03:56:58.100 EDT >> cmd: Begin processing the 479th record. Run 1, Event 479, LumiSection 3669 on stream 4 at 21-Apr-2021 03:57:07.893 EDT >> cmd: Begin processing the 480th record. Run 1, Event 480, LumiSection 3669 on stream 3 at 21-Apr-2021 03:57:09.167 EDT >> cmd: Begin processing the 481st record. Run 1, Event 481, LumiSection 3669 on stream 2 at 21-Apr-2021 03:57:09.771 EDT >> cmd: Begin processing the 482nd record. Run 1, Event 482, LumiSection 3669 on stream 1 at 21-Apr-2021 03:57:24.136 EDT >> cmd: Begin processing the 483rd record. Run 1, Event 483, LumiSection 3669 on stream 5 at 21-Apr-2021 03:57:34.650 EDT >> cmd: Begin processing the 484th record. Run 1, Event 484, LumiSection 3669 on stream 3 at 21-Apr-2021 03:57:41.074 EDT >> cmd: Begin processing the 485th record. Run 1, Event 485, LumiSection 3669 on stream 0 at 21-Apr-2021 03:57:41.507 EDT >> cmd: Begin processing the 486th record. Run 1, Event 486, LumiSection 3669 on stream 2 at 21-Apr-2021 03:57:45.396 EDT >> cmd: Begin processing the 487th record. Run 1, Event 487, LumiSection 3669 on stream 4 at 21-Apr-2021 03:57:47.335 EDT >> cmd: Begin processing the 488th record. Run 1, Event 488, LumiSection 3669 on stream 0 at 21-Apr-2021 03:57:53.438 EDT >> cmd: Begin processing the 489th record. Run 1, Event 489, LumiSection 3669 on stream 5 at 21-Apr-2021 03:58:05.064 EDT >> cmd: Begin processing the 490th record. Run 1, Event 490, LumiSection 3669 on stream 1 at 21-Apr-2021 03:58:05.085 EDT >> cmd: Begin processing the 491st record. Run 1, Event 491, LumiSection 3669 on stream 3 at 21-Apr-2021 03:58:12.372 EDT >> cmd: Begin processing the 492nd record. Run 1, Event 492, LumiSection 3669 on stream 0 at 21-Apr-2021 03:58:21.266 EDT >> cmd: Begin processing the 493rd record. Run 1, Event 493, LumiSection 3669 on stream 5 at 21-Apr-2021 03:58:22.621 EDT >> cmd: Begin processing the 494th record. Run 1, Event 494, LumiSection 3669 on stream 2 at 21-Apr-2021 03:58:26.233 EDT >> cmd: Begin processing the 495th record. Run 1, Event 495, LumiSection 3669 on stream 4 at 21-Apr-2021 03:58:30.995 EDT >> cmd: Begin processing the 496th record. Run 1, Event 496, LumiSection 3669 on stream 1 at 21-Apr-2021 03:58:37.129 EDT >> cmd: Begin processing the 497th record. Run 1, Event 497, LumiSection 3669 on stream 3 at 21-Apr-2021 03:58:38.517 EDT >> cmd: Begin processing the 498th record. Run 1, Event 498, LumiSection 3669 on stream 5 at 21-Apr-2021 03:58:55.050 EDT >> cmd: Begin processing the 499th record. Run 1, Event 499, LumiSection 3669 on stream 2 at 21-Apr-2021 03:59:00.566 EDT >> cmd: Begin processing the 500th record. Run 1, Event 500, LumiSection 3669 on stream 4 at 21-Apr-2021 03:59:10.084 EDT >> cmd: 21-Apr-2021 03:59:46 EDT Closed file root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/gen_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/GEN-00000_36300.root >> cmd: >> cmd: TrigReport ---------- Event Summary ------------ >> cmd: TrigReport Events total = 500 passed = 500 failed = 0 >> cmd: >> cmd: TrigReport ---------- Path Summary ------------ >> cmd: TrigReport Trig Bit# Executed Passed Failed Error Name >> cmd: >> cmd: TrigReport -------End-Path Summary ------------ >> cmd: TrigReport Trig Bit# Executed Passed Failed Error Name >> cmd: TrigReport 0 1 500 500 0 0 RAWSIMoutput_step >> cmd: >> cmd: TrigReport ------ Modules in End-Path: RAWSIMoutput_step ------------ >> cmd: TrigReport Trig Bit# Visited Passed Failed Error Name >> cmd: TrigReport 0 0 500 500 0 0 RAWSIMoutput >> cmd: >> cmd: TrigReport ---------- Module Summary ------------ >> cmd: TrigReport Visited Executed Passed Failed Error Name >> cmd: TrigReport 0 0 0 0 0 MEtoEDMConverter >> cmd: TrigReport 500 500 500 0 0 RAWSIMoutput >> cmd: TrigReport 500 500 500 0 0 RAWSIMoutput_step >> cmd: TrigReport 500 500 500 0 0 TriggerResults >> cmd: TrigReport 500 500 500 0 0 endjob_step >> cmd: TrigReport 24000 500 500 0 0 g4SimHits >> cmd: TrigReport 500 500 500 0 0 randomEngineStateProducer >> cmd: TrigReport 500 500 500 0 0 simulation_step >> cmd: >> cmd: TimeReport ---------- Event Summary ---[sec]---- >> cmd: TimeReport event loop CPU/event = 0.192273 >> cmd: TimeReport event loop Real/event = 6.494942 >> cmd: TimeReport sum Streams Real/event = 38.112294 >> cmd: TimeReport efficiency CPU/Real/thread = 0.004934 >> cmd: >> cmd: TimeReport ---------- Path Summary ---[Real sec]---- >> cmd: TimeReport per event per exec Name >> cmd: TimeReport 0.000000 0.000000 simulation_step >> cmd: TimeReport per event per exec Name >> cmd: >> cmd: TimeReport -------End-Path Summary ---[Real sec]---- >> cmd: TimeReport per event per exec Name >> cmd: TimeReport 0.000000 0.000000 endjob_step >> cmd: TimeReport 38.111133 38.111133 RAWSIMoutput_step >> cmd: TimeReport per event per exec Name >> cmd: >> cmd: TimeReport ---------- Modules in Path: simulation_step ---[Real sec]---- >> cmd: TimeReport per event per visit Name >> cmd: TimeReport per event per visit Name >> cmd: >> cmd: TimeReport ------ Modules in End-Path: endjob_step ---[Real sec]---- >> cmd: TimeReport per event per visit Name >> cmd: >> cmd: TimeReport ------ Modules in End-Path: RAWSIMoutput_step ---[Real sec]---- >> cmd: TimeReport per event per visit Name >> cmd: TimeReport 0.226624 0.226624 RAWSIMoutput >> cmd: TimeReport per event per visit Name >> cmd: >> cmd: TimeReport ---------- Module Summary ---[Real sec]---- >> cmd: TimeReport per event per exec per visit Name >> cmd: TimeReport 0.000000 0.000000 0.000000 MEtoEDMConverter >> cmd: TimeReport 0.226624 0.226624 0.226624 RAWSIMoutput >> cmd: TimeReport 0.000013 0.000013 0.000013 RAWSIMoutput_step >> cmd: TimeReport 0.000005 0.000005 0.000005 TriggerResults >> cmd: TimeReport 0.000003 0.000003 0.000003 endjob_step >> cmd: TimeReport 37.841445 37.841445 37.841445 g4SimHits >> cmd: TimeReport 0.000013 0.000013 0.000013 randomEngineStateProducer >> cmd: TimeReport 0.000006 0.000006 0.000006 simulation_step >> cmd: TimeReport per event per exec per visit Name >> cmd: >> cmd: T---Report end! >> cmd: >> cmd: TimeReport> Time report complete in 3268.54 seconds >> cmd: Time Summary: >> cmd: - Min event: 8.3265 >> cmd: - Max event: 113.583 >> cmd: - Avg event: 38.1112 >> cmd: - Total loop: 3246.84 >> cmd: - Total init: 21.0445 >> cmd: - Total job: 3268.54 >> cmd: - EventSetup Lock: 1.07288e-05 >> cmd: - EventSetup Get: 22.0646 >> cmd: Event Throughput: 0.153996 ev/s >> cmd: CPU Summary: >> cmd: - Total loop: 19023.4 >> cmd: - Total init: 5.68715 >> cmd: - Total extra: 0 >> cmd: - Total job: 19030.9 >> cmd: Processing Summary: >> cmd: - Number of Events: 500 >> cmd: - Number of Global Begin Lumi Calls: 1 >> cmd: - Number of Global Begin Run Calls: 1 >> cmd: >> cmd: >> cmd: ============================================= >> cmd: >> cmd: MessageLogger Summary >> cmd: >> cmd: type category sev module subroutine count total >> cmd: ---- -------------------- -- ---------------- ---------------- ----- ----- >> cmd: 1 TimeReport -e AfterModEndJob 1 1 >> cmd: 2 fileAction -s file_close 1 1 >> cmd: 3 fileAction -s file_open 2 2 >> cmd: >> cmd: type category Examples: run/evt run/evt run/evt >> cmd: ---- -------------------- ---------------- ---------------- ---------------- >> cmd: 1 TimeReport End Run: 1 >> cmd: 2 fileAction End Run: 1 >> cmd: 3 fileAction pre-events pre-events >> cmd: >> cmd: Severity # Occurrences Total Occurrences >> cmd: -------- ------------- ----------------- >> cmd: Error 1 1 >> cmd: System 3 3 >> cmd: >> cmd: dropped waiting message count 0 >>> executable returned with exit code 0. @ Wed Apr 21 03:59:47 2021 >>> executing 'timeout 300 hdfs dfs -fs hdfs://eddie.crc.nd.edu:19000 -put SIM-00000.root /store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root' @ Wed Apr 21 03:59:57 2021 >> using /disk/vc3-root/tmp/worker-230547-26533/t.69766/cctools-temp-t.69766.aBSn9d/tmpVT3ObW to store command output >> cmd: timeout: failed to run command 'hdfs': No such file or directory >>> Checking output file transfer. @ Wed Apr 21 03:59:57 2021 >>> executing 'env XRD_LOGLEVEL=Debug xrdcp SIM-00000.root root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root' @ Wed Apr 21 03:59:57 2021 >> using /disk/vc3-root/tmp/worker-230547-26533/t.69766/cctools-temp-t.69766.aBSn9d/tmpQ2m8Yx to store command output >> cmd: [2021-04-21 03:59:57.635171 -0400][Warning][Utility ] Unable to process global config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-04-21 03:59:57.636142 -0400][Debug ][Utility ] Unable to process user config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-04-21 03:59:57.636297 -0400][Debug ][PlugInMgr ] Initializing plug-in manager... >> cmd: [2021-04-21 03:59:57.636344 -0400][Debug ][PlugInMgr ] No default plug-in, loading plug-in configs... >> cmd: [2021-04-21 03:59:57.636385 -0400][Debug ][PlugInMgr ] Processing plug-in definitions in /etc/xrootd/client.plugins.d... >> cmd: [2021-04-21 03:59:57.636468 -0400][Debug ][PlugInMgr ] Unable to process directory /etc/xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-04-21 03:59:57.636770 -0400][Debug ][PlugInMgr ] Processing plug-in definitions in /tmp/runos_singularity_home-282113084562864413726486454614658604106/.xrootd/client.plugins.d... >> cmd: [2021-04-21 03:59:57.636858 -0400][Debug ][PlugInMgr ] Unable to process directory /tmp/runos_singularity_home-282113084562864413726486454614658604106/.xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-04-21 03:59:57.637119 -0400][Debug ][Poller ] Available pollers: built-in >> cmd: [2021-04-21 03:59:57.637168 -0400][Debug ][Poller ] Attempting to create a poller according to preference: built-in >> cmd: [2021-04-21 03:59:57.637208 -0400][Debug ][Poller ] Creating poller: built-in >> cmd: [2021-04-21 03:59:57.637252 -0400][Debug ][Poller ] Creating and starting the built-in poller... >> cmd: [2021-04-21 03:59:57.637595 -0400][Debug ][Poller ] Using 1 poller threads >> cmd: [2021-04-21 03:59:57.637645 -0400][Debug ][TaskMgr ] Starting the task manager... >> cmd: [2021-04-21 03:59:57.637777 -0400][Debug ][TaskMgr ] Task manager started >> cmd: [2021-04-21 03:59:57.637825 -0400][Debug ][JobMgr ] Starting the job manager... >> cmd: [2021-04-21 03:59:57.638200 -0400][Debug ][JobMgr ] Job manager started, 3 workers >> cmd: [2021-04-21 03:59:57.638268 -0400][Debug ][TaskMgr ] Registering task: "FileTimer task" to be run at: [2021-04-21 03:59:57 -0400] >> cmd: [2021-04-21 03:59:57.638348 -0400][Debug ][PostMaster ] Creating new channel to: deepthought.crc.nd.edu:1094 1 stream(s) >> cmd: [2021-04-21 03:59:57.638412 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-04-21 03:59:57.639493 -0400][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" to be run at: [2021-04-21 04:00:12 -0400] >> cmd: [2021-04-21 03:59:57.640443 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-04-21 03:59:57.640581 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-04-21 03:59:57.640672 -0400][Debug ][Poller ] Adding socket 0x4cd060 to the poller >> cmd: [2021-04-21 04:01:58.033241 -0400][Error ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Socket error while handshaking: [ERROR] Socket timeout >> cmd: [2021-04-21 04:01:58.033404 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-04-21 04:01:58.033481 -0400][Debug ][Poller ] <--> Removing socket from the poller >> cmd: [2021-04-21 04:01:58.033625 -0400][Error ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] elapsed = 121, pConnectionWindow = 120 seconds. >> cmd: [2021-04-21 04:01:58.035533 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-04-21 04:01:58.035678 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-04-21 04:01:58.035770 -0400][Debug ][Poller ] Adding socket 0x4cd060 to the poller >> cmd: [2021-04-21 04:02:01.041192 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2021-04-21 04:02:01.041428 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-04-21 04:03:46.343949 -0400][Error ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Socket error while handshaking: [ERROR] Socket error: Connection reset by peer >> cmd: [2021-04-21 04:03:46.344088 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-04-21 04:03:46.344145 -0400][Debug ][Poller ] <[::ffff:10.32.79.81]:45660><--><[::ffff:129.74.85.55]:1094> Removing socket from the poller >> cmd: [2021-04-21 04:03:46.344273 -0400][Error ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] elapsed = 108, pConnectionWindow = 120 seconds. >> cmd: [2021-04-21 04:03:46.344331 -0400][Info ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Attempting reconnection in 12 seconds. >> cmd: [2021-04-21 04:03:46.344377 -0400][Debug ][TaskMgr ] Registering task: "StreamConnectorTask for deepthought.crc.nd.edu:1094 #0" to be run at: [2021-04-21 04:03:58 -0400] >> cmd: [2021-04-21 04:03:58.678215 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-04-21 04:03:58.678383 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-04-21 04:03:58.678471 -0400][Debug ][Poller ] Adding socket 0x4cd060 to the poller >> cmd: [2021-04-21 04:03:58.678633 -0400][Debug ][TaskMgr ] Done with task: "StreamConnectorTask for deepthought.crc.nd.edu:1094 #0" >> cmd: [2021-04-21 04:05:59.279655 -0400][Error ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Socket error while handshaking: [ERROR] Socket timeout >> cmd: [2021-04-21 04:05:59.279772 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-04-21 04:05:59.279828 -0400][Debug ][Poller ] <--> Removing socket from the poller >> cmd: [2021-04-21 04:05:59.279956 -0400][Error ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] elapsed = 121, pConnectionWindow = 120 seconds. >> cmd: [2021-04-21 04:05:59.281400 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-04-21 04:05:59.281541 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-04-21 04:05:59.281629 -0400][Debug ][Poller ] Adding socket 0x4cd060 to the poller >> cmd: [2021-04-21 04:05:59.300582 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2021-04-21 04:05:59.300724 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-04-21 04:06:34.897222 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Got the server hand shake response (type: manager [], protocol version 400) >> cmd: [2021-04-21 04:06:34.897487 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] kXR_protocol successful (type: manager [], protocol version 400) >> cmd: [2021-04-21 04:06:34.900641 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdcp&xrd.info=&xrd.hostname=d8civy109.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-04-21 04:06:34.900995 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Logged in, session: e2b101009b0d0000340200009cb40100 >> cmd: [2021-04-21 04:06:34.901126 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream 0 connected. >> cmd: [2021-04-21 04:06:34.901180 -0400][Debug ][Utility ] Monitor library name not set. No monitoring >> cmd: [2021-04-21 04:06:34.901624 -0400][Debug ][TaskMgr ] Registering task: "WaitTask for: 0x0x4c80d0" to be run at: [2021-04-21 04:06:44 -0400] >> cmd: [2021-04-21 04:06:44.704767 -0400][Debug ][TaskMgr ] Done with task: "WaitTask for: 0x0x4c80d0" >> cmd: [2021-04-21 04:06:57.781951 -0400][Debug ][TaskMgr ] Registering task: "WaitTask for: 0x0x4c80d0" to be run at: [2021-04-21 04:07:07 -0400] >> cmd: [2021-04-21 04:07:07.708748 -0400][Debug ][TaskMgr ] Done with task: "WaitTask for: 0x0x4c80d0" >> cmd: [2021-04-21 04:07:36.867807 -0400][Debug ][TaskMgr ] Registering task: "WaitTask for: 0x0x4c80d0" to be run at: [2021-04-21 04:07:46 -0400] >> cmd: [2021-04-21 04:07:46.715239 -0400][Debug ][TaskMgr ] Done with task: "WaitTask for: 0x0x4c80d0" >> cmd: [2021-04-21 04:08:03.053879 -0400][Debug ][TaskMgr ] Registering task: "WaitTask for: 0x0x4c80d0" to be run at: [2021-04-21 04:08:13 -0400] >> cmd: [2021-04-21 04:08:13.719776 -0400][Debug ][TaskMgr ] Done with task: "WaitTask for: 0x0x4c80d0" >> cmd: [2021-04-21 04:08:19.667663 -0400][Debug ][TaskMgr ] Registering task: "WaitTask for: 0x0x4c80d0" to be run at: [2021-04-21 04:08:29 -0400] >> cmd: [2021-04-21 04:08:29.722666 -0400][Debug ][TaskMgr ] Done with task: "WaitTask for: 0x0x4c80d0" >> cmd: [2021-04-21 04:08:38.562611 -0400][Debug ][TaskMgr ] Registering task: "WaitTask for: 0x0x4c80d0" to be run at: [2021-04-21 04:08:48 -0400] >> cmd: [2021-04-21 04:08:48.725829 -0400][Debug ][TaskMgr ] Done with task: "WaitTask for: 0x0x4c80d0" >> cmd: [2021-04-21 04:09:14.254381 -0400][Debug ][TaskMgr ] Registering task: "WaitTask for: 0x0x4c80d0" to be run at: [2021-04-21 04:09:24 -0400] >> cmd: [2021-04-21 04:09:24.731581 -0400][Debug ][TaskMgr ] Done with task: "WaitTask for: 0x0x4c80d0" >> cmd: [2021-04-21 04:10:27.326461 -0400][Debug ][TaskMgr ] Registering task: "WaitTask for: 0x0x4c80d0" to be run at: [2021-04-21 04:10:37 -0400] >> cmd: [2021-04-21 04:10:37.743399 -0400][Debug ][TaskMgr ] Done with task: "WaitTask for: 0x0x4c80d0" >> cmd: [2021-04-21 04:11:10.864239 -0400][Debug ][TaskMgr ] Registering task: "WaitTask for: 0x0x4c80d0" to be run at: [2021-04-21 04:11:20 -0400] >> cmd: [2021-04-21 04:11:20.750477 -0400][Debug ][TaskMgr ] Done with task: "WaitTask for: 0x0x4c80d0" >> cmd: [2021-04-21 04:12:09.446232 -0400][Debug ][TaskMgr ] Registering task: "WaitTask for: 0x0x4c80d0" to be run at: [2021-04-21 04:12:19 -0400] >> cmd: [2021-04-21 04:12:19.760163 -0400][Debug ][TaskMgr ] Done with task: "WaitTask for: 0x0x4c80d0" >> cmd: [2021-04-21 04:12:40.222658 -0400][Debug ][TaskMgr ] Registering task: "WaitTask for: 0x0x4c80d0" to be run at: [2021-04-21 04:12:50 -0400] >> cmd: [2021-04-21 04:12:50.765507 -0400][Debug ][TaskMgr ] Done with task: "WaitTask for: 0x0x4c80d0" >> cmd: [2021-04-21 04:13:16.046550 -0400][Debug ][TaskMgr ] Registering task: "WaitTask for: 0x0x4c80d0" to be run at: [2021-04-21 04:13:26 -0400] >> cmd: [2021-04-21 04:13:26.771449 -0400][Debug ][TaskMgr ] Done with task: "WaitTask for: 0x0x4c80d0" >> cmd: [2021-04-21 04:13:34.345037 -0400][Debug ][TaskMgr ] Registering task: "WaitTask for: 0x0x4c80d0" to be run at: [2021-04-21 04:13:44 -0400] >> cmd: [2021-04-21 04:13:44.774705 -0400][Debug ][TaskMgr ] Done with task: "WaitTask for: 0x0x4c80d0" >> cmd: [2021-04-21 04:14:22.454517 -0400][Debug ][TaskMgr ] Registering task: "WaitTask for: 0x0x4c80d0" to be run at: [2021-04-21 04:14:37 -0400] >> cmd: [2021-04-21 04:14:37.783636 -0400][Debug ][TaskMgr ] Done with task: "WaitTask for: 0x0x4c80d0" >> cmd: [2021-04-21 04:14:38.434931 -0400][Debug ][TaskMgr ] Registering task: "WaitTask for: 0x0x4c80d0" to be run at: [2021-04-21 04:14:48 -0400] >> cmd: [2021-04-21 04:14:48.785689 -0400][Debug ][TaskMgr ] Done with task: "WaitTask for: 0x0x4c80d0" >> cmd: [2021-04-21 04:14:50.899432 -0400][Debug ][TaskMgr ] Registering task: "WaitTask for: 0x0x4c80d0" to be run at: [2021-04-21 04:15:00 -0400] >> cmd: [2021-04-21 04:15:00.787832 -0400][Debug ][TaskMgr ] Done with task: "WaitTask for: 0x0x4c80d0" >> cmd: [2021-04-21 04:15:09.047836 -0400][Debug ][TaskMgr ] Registering task: "WaitTask for: 0x0x4c80d0" to be run at: [2021-04-21 04:15:19 -0400] >> cmd: [2021-04-21 04:15:19.791239 -0400][Debug ][TaskMgr ] Done with task: "WaitTask for: 0x0x4c80d0" >> cmd: [2021-04-21 04:15:34.505787 -0400][Debug ][TaskMgr ] Registering task: "WaitTask for: 0x0x4c80d0" to be run at: [2021-04-21 04:15:44 -0400] >> cmd: [2021-04-21 04:15:44.795753 -0400][Debug ][TaskMgr ] Done with task: "WaitTask for: 0x0x4c80d0" >> cmd: [2021-04-21 04:15:53.122642 -0400][Debug ][TaskMgr ] Registering task: "WaitTask for: 0x0x4c80d0" to be run at: [2021-04-21 04:16:03 -0400] >> cmd: [2021-04-21 04:16:03.799116 -0400][Debug ][TaskMgr ] Done with task: "WaitTask for: 0x0x4c80d0" >> cmd: [2021-04-21 04:16:59.463227 -0400][Debug ][TaskMgr ] Registering task: "WaitTask for: 0x0x4c80d0" to be run at: [2021-04-21 04:17:09 -0400] >> cmd: [2021-04-21 04:17:09.810156 -0400][Debug ][TaskMgr ] Done with task: "WaitTask for: 0x0x4c80d0" >> cmd: [2021-04-21 04:17:09.810983 -0400][Debug ][XRootD ] [deepthought.crc.nd.edu:1094] Handling error while processing kXR_stat (path: /store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root, flags: none): [ERROR] Error response: No such file or directory. >> cmd: [2021-04-21 04:17:09.811322 -0400][Debug ][Utility ] CopyProcess: 2 jobs to prepare >> cmd: [2021-04-21 04:17:09.811897 -0400][Debug ][XRootD ] [deepthought.crc.nd.edu:1094] Handling error while processing kXR_stat (path: /store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root, flags: none): [ERROR] Error response: No such file or directory. >> cmd: [2021-04-21 04:17:09.812032 -0400][Debug ][Utility ] Creating a classic copy job, from file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root to root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root >> cmd: [2021-04-21 04:17:09.812166 -0400][Debug ][Utility ] Opening file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root for reading >> cmd: [2021-04-21 04:17:09.812240 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending an open command >> cmd: [2021-04-21 04:17:09.812692 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Open has returned with status [SUCCESS] >> cmd: [2021-04-21 04:17:09.812776 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] successfully opened at localhost, handle: 0x16, session id: 1 >> cmd: [2021-04-21 04:17:09.812946 -0400][Debug ][Utility ] Opening root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501 for writing >> cmd: [2021-04-21 04:17:09.813043 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending an open command >> cmd: [2021-04-21 04:17:09.813690 -0400][Debug ][PostMaster ] Creating new channel to: primeradiant01.crc.nd.edu:1096 1 stream(s) >> cmd: [2021-04-21 04:17:09.813768 -0400][Debug ][PostMaster ] [primeradiant01.crc.nd.edu:1096 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-04-21 04:17:09.815145 -0400][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: primeradiant01.crc.nd.edu:1096" to be run at: [2021-04-21 04:17:24 -0400] >> cmd: [2021-04-21 04:17:09.816143 -0400][Debug ][PostMaster ] [primeradiant01.crc.nd.edu:1096] Found 1 address(es): [::ffff:149.165.243.5]:1096 >> cmd: [2021-04-21 04:17:09.816281 -0400][Debug ][AsyncSock ] [primeradiant01.crc.nd.edu:1096 #0.0] Attempting connection to [::ffff:149.165.243.5]:1096 >> cmd: [2021-04-21 04:17:09.816374 -0400][Debug ][Poller ] Adding socket 0x48001860 to the poller >> cmd: [2021-04-21 04:17:09.816476 -0400][Debug ][AsyncSock ] [primeradiant01.crc.nd.edu:1096 #0.0] Async connection call returned >> cmd: [2021-04-21 04:17:09.816576 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-04-21 04:17:09.816947 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] Got the server hand shake response (type: server [], protocol version 400) >> cmd: [2021-04-21 04:17:09.817126 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] kXR_protocol successful (type: server [], protocol version 400) >> cmd: [2021-04-21 04:17:09.819584 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdcp&xrd.info=&xrd.hostname=d8civy109.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-04-21 04:17:09.819906 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] Logged in, session: f66f00004d320000ff010000f76f0000 >> cmd: [2021-04-21 04:17:09.819954 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] Authentication is required: &P=gsi,v:10400,c:ssl,ca:ba240aa8.0|f5f0dfc2.0 >> cmd: [2021-04-21 04:17:09.819999 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] Sending authentication data >> cmd: [2021-04-21 04:17:09.826011 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] Trying to authenticate using gsi >> cmd: [2021-04-21 04:17:09.919694 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] Sending more authentication data for gsi >> cmd: [2021-04-21 04:17:09.924831 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] Authenticated with gsi. >> cmd: [2021-04-21 04:17:09.924915 -0400][Debug ][PostMaster ] [primeradiant01.crc.nd.edu:1096 #0] Stream 0 connected. >> cmd: [2021-04-21 04:17:10.217521 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Open has returned with status [SUCCESS] >> cmd: [2021-04-21 04:17:10.217623 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] successfully opened at primeradiant01.crc.nd.edu:1096, handle: 0x0, session id: 1 >> cmd: [2021-04-21 04:17:10.217814 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-04-21 04:17:10.231775 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-04-21 04:17:10.245531 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-04-21 04:17:10.256365 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-04-21 04:17:10.266973 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a write command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [16MB/452.2MB][ 3%][=> ][16MB/s] [2021-04-21 04:17:10.267408 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-04-21 04:17:10.277780 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a write command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [2021-04-21 04:17:10.277958 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-04-21 04:17:10.288463 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a write command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [2021-04-21 04:17:10.288638 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-04-21 04:17:10.299208 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a write command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [2021-04-21 04:17:10.299440 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-04-21 04:17:11.100370 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a write command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [80MB/452.2MB][ 17%][========> ][40MB/s] [2021-04-21 04:17:11.100660 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-04-21 04:17:11.694354 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a write command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [2021-04-21 04:17:11.694533 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-04-21 04:17:12.177464 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a write command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [112MB/452.2MB][ 24%][============> ][37.33MB/s] [2021-04-21 04:17:12.177765 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-04-21 04:17:12.710276 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a write command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [2021-04-21 04:17:12.710474 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-04-21 04:17:15.210255 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a write command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [144MB/452.2MB][ 31%][===============> ][24MB/s] [2021-04-21 04:17:15.210546 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-04-21 04:17:15.872480 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a write command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [2021-04-21 04:17:15.872660 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-04-21 04:17:16.905265 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a write command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [176MB/452.2MB][ 38%][===================> ][25.14MB/s] [2021-04-21 04:17:16.905553 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-04-21 04:17:18.372621 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a write command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [192MB/452.2MB][ 42%][=====================> ][21.33MB/s] [2021-04-21 04:17:18.372904 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-04-21 04:17:19.500748 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a write command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [208MB/452.2MB][ 46%][=======================> ][20.8MB/s] [2021-04-21 04:17:19.501014 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-04-21 04:17:20.307013 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a write command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [224MB/452.2MB][ 49%][========================> ][20.36MB/s] [2021-04-21 04:17:20.307267 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-04-21 04:17:20.743196 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a write command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [2021-04-21 04:17:20.743343 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-04-21 04:17:21.232434 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a write command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [256MB/452.2MB][ 56%][============================> ][21.33MB/s] [2021-04-21 04:17:21.232729 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-04-21 04:17:28.528115 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a write command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [272MB/452.2MB][ 60%][==============================> ][14.32MB/s] [2021-04-21 04:17:28.528389 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-04-21 04:17:28.790699 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a write command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [2021-04-21 04:17:28.790844 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-04-21 04:17:29.646819 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a write command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [304MB/452.2MB][ 67%][=================================> ][15.2MB/s] [2021-04-21 04:17:29.647146 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-04-21 04:17:29.849673 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a write command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [2021-04-21 04:17:29.849800 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-04-21 04:17:38.317880 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a write command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [336MB/452.2MB][ 74%][=====================================> ][11.59MB/s] [2021-04-21 04:17:38.318158 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-04-21 04:17:38.533302 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a write command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [2021-04-21 04:17:38.533435 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-04-21 04:17:38.735068 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a write command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [2021-04-21 04:17:38.735203 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-04-21 04:17:38.936432 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a write command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [2021-04-21 04:17:38.936559 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-04-21 04:17:50.328751 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a write command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [400MB/452.2MB][ 88%][============================================> ][9.756MB/s] [2021-04-21 04:17:50.329006 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a read command for handle 0x16 to localhost >> cmd: [2021-04-21 04:17:50.538896 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a write command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [2021-04-21 04:17:50.767249 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a write command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [2021-04-21 04:17:50.977415 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a write command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [2021-04-21 04:17:53.643655 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a write command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [452.2MB/452.2MB][100%][==================================================][10.28MB/s] [2021-04-21 04:17:54.288299 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Sending a close command for handle 0x0 to primeradiant01.crc.nd.edu:1096 >> cmd: [2021-04-21 04:18:04.934149 -0400][Debug ][File ] [0x4ceb50@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root?oss.asize=474136501] Close returned from primeradiant01.crc.nd.edu:1096 with: [SUCCESS] >> cmd: [2021-04-21 04:18:04.934367 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Sending a close command for handle 0x16 to localhost >> cmd: [2021-04-21 04:18:04.934607 -0400][Debug ][File ] [0x4c6ad0@file://localhost/disk/vc3-root/tmp/worker-230547-26533/t.69766/SIM-00000.root] Close returned from localhost with: [SUCCESS] >> cmd: [452.2MB/452.2MB][100%][==================================================][8.221MB/s] >> cmd: [2021-04-21 04:18:04.967503 -0400][Debug ][JobMgr ] Stopping the job manager... >> cmd: [2021-04-21 04:18:04.968280 -0400][Debug ][JobMgr ] Job manager stopped >> cmd: [2021-04-21 04:18:04.968338 -0400][Debug ][TaskMgr ] Stopping the task manager... >> cmd: [2021-04-21 04:18:04.968637 -0400][Debug ][TaskMgr ] Task manager stopped >> cmd: [2021-04-21 04:18:04.968683 -0400][Debug ][Poller ] Stopping the poller... >> cmd: [2021-04-21 04:18:04.968986 -0400][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" >> cmd: [2021-04-21 04:18:04.969068 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-04-21 04:18:04.969119 -0400][Debug ][Poller ] <[::ffff:10.32.79.81]:45684><--><[::ffff:129.74.85.55]:1094> Removing socket from the poller >> cmd: [2021-04-21 04:18:04.969206 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Destroying stream >> cmd: [2021-04-21 04:18:04.969255 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-04-21 04:18:04.969313 -0400][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: primeradiant01.crc.nd.edu:1096" >> cmd: [2021-04-21 04:18:04.969356 -0400][Debug ][AsyncSock ] [primeradiant01.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2021-04-21 04:18:04.969398 -0400][Debug ][Poller ] <[::ffff:10.32.79.81]:34420><--><[::ffff:149.165.243.5]:1096> Removing socket from the poller >> cmd: [2021-04-21 04:18:04.969471 -0400][Debug ][PostMaster ] [primeradiant01.crc.nd.edu:1096 #0] Destroying stream >> cmd: [2021-04-21 04:18:04.969514 -0400][Debug ][AsyncSock ] [primeradiant01.crc.nd.edu:1096 #0.0] Closing the socket >>> Checking output file transfer. @ Wed Apr 21 04:18:04 2021 >>> executing 'timeout 300 hdfs dfs -fs hdfs://eddie.crc.nd.edu:19000 -stat "Size: %b" /store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root' @ Wed Apr 21 04:18:04 2021 >> using /disk/vc3-root/tmp/worker-230547-26533/t.69766/cctools-temp-t.69766.aBSn9d/tmpL4wtPI to store command output >> cmd: timeout: failed to run command 'hdfs': No such file or directory >>>>> checking output for SIM-00000.root failed: timeout: failed to run command 'hdfs': No such file or directory @ Wed Apr 21 04:18:05 2021 >>> executing 'timeout 300 xrdfs deepthought.crc.nd.edu stat /store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root' @ Wed Apr 21 04:18:05 2021 >> using /disk/vc3-root/tmp/worker-230547-26533/t.69766/cctools-temp-t.69766.aBSn9d/tmpNudeab to store command output >> cmd: Path: /store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root >> cmd: Id: 0 >> cmd: Size: 474136501 >> cmd: MTime: 2021-04-21 08:17:59 >> cmd: Flags: 24 (Offline|IsReadable) >>> File transfer successful! @ Wed Apr 21 04:18:05 2021 >>> Checking output files... @ Wed Apr 21 04:18:05 2021 >>> Checking SIM-00000.root => sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root @ Wed Apr 21 04:18:05 2021 >>> executing 'timeout 300 hdfs dfs -fs hdfs://eddie.crc.nd.edu:19000 -stat "Size: %b" /store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root' @ Wed Apr 21 04:18:05 2021 >> using /disk/vc3-root/tmp/worker-230547-26533/t.69766/cctools-temp-t.69766.aBSn9d/tmpWtbwY1 to store command output >> cmd: timeout: failed to run command 'hdfs': No such file or directory >>>>> checking output for SIM-00000.root failed: timeout: failed to run command 'hdfs': No such file or directory @ Wed Apr 21 04:18:05 2021 >>> executing 'timeout 300 xrdfs deepthought.crc.nd.edu stat /store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root' @ Wed Apr 21 04:18:05 2021 >> using /disk/vc3-root/tmp/worker-230547-26533/t.69766/cctools-temp-t.69766.aBSn9d/tmptXEh7Z to store command output >> cmd: [ERROR] Server responded with an error: [3011] No servers are available to read the file. >> cmd: >>>>> checking output for SIM-00000.root failed: [ERROR] Server responded with an error: [3011] No servers are available to read the file. @ Wed Apr 21 04:18:05 2021 >>> executing '/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin/gfal-stat gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root' @ Wed Apr 21 04:18:05 2021 >> using /disk/vc3-root/tmp/worker-230547-26533/t.69766/cctools-temp-t.69766.aBSn9d/tmpdH6BbA to store command output >> cmd: gfal-stat error: 13 (Permission denied) - globus_ftp_client: the server responded with an error 530 530-Login incorrect. : /builddir/build/BUILD/gridftp-hdfs-1.1.1/src/gridftp_hdfs.c:hdfs_start:756: 530-Server is cancelling transfer due to over-load limit (host=deepthought.crc.nd.edu, user=kmohrman, path=(null)) 530 End. >>>>> checking output for SIM-00000.root failed: gfal-stat error: 13 (Permission denied) - globus_ftp_client: the server responded with an error 530 530-Login incorrect. : /builddir/build/BUILD/gridftp-hdfs-1.1.1/src/gridftp_hdfs.c:hdfs_start:756: 530-Server is cancelling transfer due to over-load limit (host=deepthought.crc.nd.edu, user=kmohrman, path=(null)) 530 End. @ Wed Apr 21 04:18:06 2021 >>> executing '/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin/gfal-stat gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root' @ Wed Apr 21 04:18:06 2021 >> using /disk/vc3-root/tmp/worker-230547-26533/t.69766/cctools-temp-t.69766.aBSn9d/tmpOEwqxu to store command output >> cmd: gfal-stat error: 13 (Permission denied) - globus_ftp_client: the server responded with an error 530 530-Login incorrect. : /builddir/build/BUILD/gridftp-hdfs-1.1.1/src/gridftp_hdfs.c:hdfs_start:756: 530-Server is cancelling transfer due to over-load limit (host=deepthought.crc.nd.edu, user=kmohrman, path=(null)) 530 End. >>>>> checking output for SIM-00000.root failed: gfal-stat error: 13 (Permission denied) - globus_ftp_client: the server responded with an error 530 530-Login incorrect. : /builddir/build/BUILD/gridftp-hdfs-1.1.1/src/gridftp_hdfs.c:hdfs_start:756: 530-Server is cancelling transfer due to over-load limit (host=deepthought.crc.nd.edu, user=kmohrman, path=(null)) 530 End. @ Wed Apr 21 04:18:07 2021 >>> executing 'stat /hadoop/store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root' @ Wed Apr 21 04:18:07 2021 >> using /disk/vc3-root/tmp/worker-230547-26533/t.69766/cctools-temp-t.69766.aBSn9d/tmp_2U1JC to store command output >> cmd: stat: cannot stat '/hadoop/store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root': No such file or directory >>>>> checking output for SIM-00000.root failed: stat: cannot stat '/hadoop/store/user/kmohrman/FullProduction/FullR2/UL17/Round1/Batch2/postLHE_step/v1/sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root': No such file or directory @ Wed Apr 21 04:18:07 2021 >> trace: Traceback (most recent call last): >> trace: File "task.py", line 268, in wrapper >> trace: result = fct(data, *args, **kwargs) >> trace: File "task.py", line 404, in check_outputs >> trace: raise IOError("could not verify output file '{}'".format(remote)) >> trace: IOError: could not verify output file 'sim_step_tHq4f_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_69766.root' >>>>> call to 'check_outputs' failed, exiting with exit code 211 @ Wed Apr 21 04:18:07 2021 Wed Apr 21 03:05:16 2021: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Wed Apr 21 03:05:17 2021: ApMon[WARNING]: Not sending parameters since no destination is defined. Wed Apr 21 03:05:17 2021: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. Wed Apr 21 03:59:47 2021: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Wed Apr 21 03:59:48 2021: ApMon[WARNING]: Not sending parameters since no destination is defined. Wed Apr 21 03:59:48 2021: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. >> Execution time 4389 >> Exiting with code 211 >> Reporting ExeExitCode 0 >> Reporting StageOutSE T3_US_NotreDame >> Reporting StageOutExitCode 211 Wed Apr 21 04:18:07 2021: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Wed Apr 21 04:18:08 2021: ApMon[WARNING]: Not sending parameters since no destination is defined. Wed Apr 21 04:18:08 2021: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. ==== working directory after execution @ Wed Apr 21 04:18:08 EDT 2021 ==== == dir: total 463928 == dir: drwxr-xr-x 18 kmohrman campus 215 Apr 21 03:05 CMSSW_10_6_17_patch1 == dir: -rw-r--r-- 1 kmohrman campus 474136501 Apr 21 03:59 SIM-00000.root == dir: -rw-r--r-- 2 kmohrman campus 3805 Apr 20 18:56 UL17_SIM_cfg.py == dir: -rw-r--r-- 1 kmohrman campus 5291 Apr 21 03:05 UL17_SIM_cfg_mod.py == dir: drwxr-xr-x 2 kmohrman campus 71 Apr 21 03:04 bin == dir: -rwxr-xr-x 3 kmohrman campus 627272 Apr 20 18:36 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 Apr 21 03:04 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 Apr 21 04:18 cctools-temp-t.69766.aBSn9d == dir: -rw------- 1 kmohrman campus 51 Apr 21 03:05 cvmfschecksum.cms-ib.cern.ch == dir: -rw------- 1 kmohrman campus 51 Apr 21 03:04 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 Apr 21 03:05 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 Apr 21 03:04 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 Apr 21 03:04 librmonitor_helper.so.Gv7XgW == dir: -rw-r--r-- 2 kmohrman campus 2065 Apr 21 03:04 parameters.json == dir: -rw------- 2 kmohrman campus 9921 Apr 21 03:04 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 Apr 21 03:04 python == dir: -rw-r--r-- 1 kmohrman campus 1274 Apr 21 04:18 report.json == dir: -rw-r--r-- 3 kmohrman campus 570 Apr 20 18:36 report.json.in == dir: -rw-r--r-- 1 kmohrman campus 22785 Apr 21 03:59 report.xml == dir: -rw-r--r-- 1 kmohrman campus 2997 Apr 21 04:18 report.xml.gz == dir: -rw-r--r-- 3 kmohrman campus 593 Apr 20 18:36 sandbox-CMSSW_10_6_17_patch1-slc7_amd64_gcc700.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 37 Apr 21 03:04 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 Apr 21 03:05 t_wrapper_ready == dir: -rw-r--r-- 1 kmohrman campus 11 Apr 21 03:04 t_wrapper_start == dir: -rwxr-xr-x 3 kmohrman campus 47217 Apr 20 18:36 task.py == dir: -rwxr-xr-x 3 kmohrman campus 5986 Apr 20 18:36 wrapper.sh === wrapper done @ Wed Apr 21 04:18:08 EDT 2021 === final return status = 211 @ Wed Apr 21 04:18:08 EDT 2021