==== wrapper started @ Tue May 25 02:04:47 EDT 2021 ==== == startup: hostname: d8civy109.crc.nd.edu == startup: kernel: Linux d8civy109.crc.nd.edu 3.10.0-1160.el7.x86_64 #1 SMP Tue Aug 18 14:50:17 EDT 2020 x86_64 x86_64 x86_64 GNU/Linux ==== tracing google @ Tue May 25 02:04:52 EDT 2021 ==== wrapper.sh: line 20: traceroute: command not found ==== environment at startup @ Tue May 25 02:04:57 EDT 2021 ==== == env: VC3_VERSION_SED=4.2 == env: CCTOOLS_RESOURCE_PROCESS_START=1621922697217727 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: VC3_ROOT_GZIP=/usr/ == env: SHELL=/bin/sh == env: TERM=xterm-256color == env: MAKEFLAGS=-j4 == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-26750/t.424470/cctools-temp-t.424470.MoQLsT == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-26750/t.424470/librmonitor_helper.so.q8lXpj == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: USER=kmohrman == env: TEMP=/disk/vc3-root/tmp/worker-230547-26750/t.424470/cctools-temp-t.424470.MoQLsT == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: LD_LIBRARY_PATH=/.singularity.d/libs == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_ROOT_MAKE=/usr/ == env: VC3_DISTFILES=/disk/vc3-distfiles == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-26750/cache/tmp == env: VC3_VERSION_TAR=1.26 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-4BOvyu == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: VC3_VERSION_GZIP=1.5 == env: VC3_ENV_TAG_GLOBAL=26499 == env: PATH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-4BOvyu == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PWD=/disk/vc3-root/tmp/worker-230547-26750/t.424470 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_FULL_SED=4.2.2 == env: VC3_VERSION_WHICH=2.20 == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-26750 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_ROOT_SED=/usr/ == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: CXX=g++ == env: SHLVL=3 == env: HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_MAKE=3.82 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: DISK=3000 == env: MEMORY=3000 == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: TMP=/disk/vc3-root/tmp/worker-230547-26750/t.424470/cctools-temp-t.424470.MoQLsT == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_VERSION_PKG_CONFIG=0.27 == env: VC3_ROOT_TAR=/usr/ == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-4BOvyu.wrapper == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: CC=gcc == env: CORES=6 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CCTOOLS_RESOURCE_MONITOR_INFO=1024 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_CRC_b3_postLHE.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=18475 == env: _=/usr/bin/env ==== cpu info @ Tue May 25 02:05:02 EDT 2021 ==== == cpu: processor : 0 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 1241.601 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 0 == cpu: cpu cores : 8 == cpu: apicid : 0 == cpu: initial apicid : 0 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.17 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 1 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2026.013 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 1 == cpu: cpu cores : 8 == cpu: apicid : 2 == cpu: initial apicid : 2 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.17 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 2 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 1563.269 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 2 == cpu: cpu cores : 8 == cpu: apicid : 4 == cpu: initial apicid : 4 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.17 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 3 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 1695.617 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 3 == cpu: cpu cores : 8 == cpu: apicid : 6 == cpu: initial apicid : 6 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.17 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 4 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 1580.249 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 4 == cpu: cpu cores : 8 == cpu: apicid : 8 == cpu: initial apicid : 8 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.17 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 5 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 1530.102 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 5 == cpu: cpu cores : 8 == cpu: apicid : 10 == cpu: initial apicid : 10 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.17 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 6 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 1197.802 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 6 == cpu: cpu cores : 8 == cpu: apicid : 12 == cpu: initial apicid : 12 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.17 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 7 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 1817.492 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 7 == cpu: cpu cores : 8 == cpu: apicid : 14 == cpu: initial apicid : 14 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.17 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 8 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2600.000 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 0 == cpu: cpu cores : 8 == cpu: apicid : 32 == cpu: initial apicid : 32 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.46 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 9 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 1203.674 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 1 == cpu: cpu cores : 8 == cpu: apicid : 34 == cpu: initial apicid : 34 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.46 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 10 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 1273.339 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 2 == cpu: cpu cores : 8 == cpu: apicid : 36 == cpu: initial apicid : 36 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.46 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 11 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 1203.515 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 3 == cpu: cpu cores : 8 == cpu: apicid : 38 == cpu: initial apicid : 38 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.46 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 12 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 1199.865 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 4 == cpu: cpu cores : 8 == cpu: apicid : 40 == cpu: initial apicid : 40 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.46 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 13 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 1283.020 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 5 == cpu: cpu cores : 8 == cpu: apicid : 42 == cpu: initial apicid : 42 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.46 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 14 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 1279.052 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 6 == cpu: cpu cores : 8 == cpu: apicid : 44 == cpu: initial apicid : 44 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.46 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 15 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 1202.722 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 7 == cpu: cpu cores : 8 == cpu: apicid : 46 == cpu: initial apicid : 46 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.46 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: === using CVMFS proxy: http://eddie.crc.nd.edu:3128 @ Tue May 25 02:05:27 EDT 2021 === using Frontier proxy: http://eddie.crc.nd.edu:3128 @ Tue May 25 02:05:27 EDT 2021 === parrot helper: /disk/vc3-root/tmp/worker-230547-26750/t.424470/lib/libparrot_helper.so @ Tue May 25 02:05:32 EDT 2021 ==== content of /disk/vc3-root/tmp/worker-230547-26750/cache/tmp @ Tue May 25 02:05:32 EDT 2021 ==== == cache: total 28 == cache: drwx------ 260 kmohrman campus 8192 May 25 02:04 ex_parrot_kmohrman == cache: -rw-r--r-- 1 kmohrman campus 10 May 25 00:23 hot_cache == cache: drwxr-x--- 260 kmohrman campus 8192 May 25 00:14 cvmfs === OSG certificate location: /cvmfs/oasis.opensciencegrid.org/mis/certificates @ Tue May 25 02:05:37 EDT 2021 === testing parrot usage @ Tue May 25 02:05:37 EDT 2021 === parrot OK @ Tue May 25 02:05:42 EDT 2021 === starting parrot to access CMSSW... @ Tue May 25 02:05:42 EDT 2021 ==== wrapper started @ Tue May 25 02:05:42 EDT 2021 ==== == startup: hostname: d8civy109.crc.nd.edu == startup: kernel: Linux d8civy109.crc.nd.edu 3.10.0-1160.el7.x86_64 #1 SMP Tue Aug 18 14:50:17 EDT 2020 x86_64 x86_64 x86_64 GNU/Linux ==== tracing google @ Tue May 25 02:05:42 EDT 2021 ==== wrapper.sh: line 20: traceroute: command not found ==== environment at startup @ Tue May 25 02:05:42 EDT 2021 ==== == env: VC3_VERSION_SED=4.2 == env: CCTOOLS_RESOURCE_PROCESS_START=1621922742794669 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/usr/ == env: LOBSTER_GFAL_COPY= == env: MAKEFLAGS=-j4 == env: PARROT_HELPER=/disk/vc3-root/tmp/worker-230547-26750/t.424470/lib/libparrot_helper.so == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-26750/t.424470/cctools-temp-t.424470.MoQLsT == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-26750/t.424470/librmonitor_helper.so.q8lXpj == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: LD_LIBRARY_PATH=/.singularity.d/libs:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-26750/t.424470/cctools-temp-t.424470.MoQLsT == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/usr/ == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-4BOvyu == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-26750/cache/tmp == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: PARROT_CVMFS_REPO= == env: VC3_VERSION_GZIP=1.5 == env: PATH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ENV_TAG_GLOBAL=26499 == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-4BOvyu == env: PWD=/disk/vc3-root/tmp/worker-230547-26750/t.424470 == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_WHICH=2.20 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: LOBSTER_LCG_CP= == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-26750 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/usr/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: CXX=g++ == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: DISK=3000 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-26750/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-26750/cache/tmp/cvmfs == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=3000 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TMP=/disk/vc3-root/tmp/worker-230547-26750/t.424470/cctools-temp-t.424470.MoQLsT == env: PYTHONPATH=python: == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_ROOT_TAR=/usr/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-4BOvyu.wrapper == env: CC=gcc == env: CCTOOLS_RESOURCE_MONITOR_INFO=1024 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=6 == env: PARROT_DEBUG_FLAGS= == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_CRC_b3_postLHE.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=18475 == env: _=/usr/bin/env ==== cpu info @ Tue May 25 02:05:43 EDT 2021 ==== == cpu: processor : 0 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3094.482 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 0 == cpu: cpu cores : 8 == cpu: apicid : 0 == cpu: initial apicid : 0 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.17 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 1 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3064.965 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 1 == cpu: cpu cores : 8 == cpu: apicid : 2 == cpu: initial apicid : 2 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.17 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 2 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3003.552 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 2 == cpu: cpu cores : 8 == cpu: apicid : 4 == cpu: initial apicid : 4 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.17 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 3 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3011.010 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 3 == cpu: cpu cores : 8 == cpu: apicid : 6 == cpu: initial apicid : 6 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.17 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 4 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3179.699 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 4 == cpu: cpu cores : 8 == cpu: apicid : 8 == cpu: initial apicid : 8 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.17 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 5 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3040.844 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 5 == cpu: cpu cores : 8 == cpu: apicid : 10 == cpu: initial apicid : 10 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.17 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 6 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3166.845 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 6 == cpu: cpu cores : 8 == cpu: apicid : 12 == cpu: initial apicid : 12 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.17 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 7 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 3028.308 == cpu: cache size : 20480 KB == cpu: physical id : 0 == cpu: siblings : 8 == cpu: core id : 7 == cpu: cpu cores : 8 == cpu: apicid : 14 == cpu: initial apicid : 14 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5187.17 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 8 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 1663.562 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 0 == cpu: cpu cores : 8 == cpu: apicid : 32 == cpu: initial apicid : 32 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.46 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 9 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2600.000 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 1 == cpu: cpu cores : 8 == cpu: apicid : 34 == cpu: initial apicid : 34 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.46 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 10 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2599.841 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 2 == cpu: cpu cores : 8 == cpu: apicid : 36 == cpu: initial apicid : 36 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.46 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 11 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2599.841 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 3 == cpu: cpu cores : 8 == cpu: apicid : 38 == cpu: initial apicid : 38 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.46 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 12 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2600.000 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 4 == cpu: cpu cores : 8 == cpu: apicid : 40 == cpu: initial apicid : 40 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.46 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 13 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2599.841 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 5 == cpu: cpu cores : 8 == cpu: apicid : 42 == cpu: initial apicid : 42 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.46 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 14 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2599.841 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 6 == cpu: cpu cores : 8 == cpu: apicid : 44 == cpu: initial apicid : 44 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.46 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 15 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 62 == cpu: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz == cpu: stepping : 4 == cpu: microcode : 0x42e == cpu: cpu MHz : 2600.158 == cpu: cache size : 20480 KB == cpu: physical id : 1 == cpu: siblings : 8 == cpu: core id : 7 == cpu: cpu cores : 8 == cpu: apicid : 46 == cpu: initial apicid : 46 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 13 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5192.46 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: === using parrot @ Tue May 25 02:05:43 EDT 2021 === sourcing CMS setup @ Tue May 25 02:05:43 EDT 2021 LibCvmfs version 2.4, revision 25 === sourcing OSG setup @ Tue May 25 02:05:45 EDT 2021 ==== environment after sourcing startup scripts @ Tue May 25 02:05:45 EDT 2021 ==== == env: VC3_VERSION_SED=4.2 == env: MANPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/man:/cvmfs/cms.cern.ch/share/man: == env: CCTOOLS_RESOURCE_PROCESS_START=1621922745467775 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: GFAL_PLUGIN_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/gfal2-plugins/ == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/usr/ == env: LOBSTER_GFAL_COPY=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin/gfal-copy == env: VOMS_USERCONF=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/vomses == env: MAKEFLAGS=-j4 == env: GLOBUS_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-26750/t.424470/cctools-temp-t.424470.MoQLsT == env: PERL5LIB=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5 == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: CVSROOT=:gserver:cmssw.cvs.cern.ch:/local/reps/CMSSW == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-26750/t.424470/librmonitor_helper.so.q8lXpj == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: X509_CERT_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/certificates == env: SCRAM_ARCH=slc7_amd64_gcc820 == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: LD_LIBRARY_PATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/dcap:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/lcgdm:/.singularity.d/libs:lib:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-26750/t.424470/cctools-temp-t.424470.MoQLsT == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/usr/ == env: OSG_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-4BOvyu == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-26750/cache/tmp == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: SITECONFIG_PATH=/cvmfs/cms.cern.ch/SITECONF/local == env: PARROT_CVMFS_REPO= == env: VC3_VERSION_GZIP=1.5 == env: PATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/sbin:/cvmfs/cms.cern.ch/common:/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ENV_TAG_GLOBAL=26499 == env: CMS_PATH=/cvmfs/cms.cern.ch == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-4BOvyu == env: PWD=/disk/vc3-root/tmp/worker-230547-26750/t.424470 == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_WHICH=2.20 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: X509_VOMS_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/vomsdir == env: LOBSTER_LCG_CP= == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-26750 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/usr/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: CXX=g++ == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: DISK=3000 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-26750/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-26750/cache/tmp/cvmfs == env: GFAL_CONFIG_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/gfal2.d/ == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=3000 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TMP=/disk/vc3-root/tmp/worker-230547-26750/t.424470/cctools-temp-t.424470.MoQLsT == env: PYTHONPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib/python2.7/site-packages:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/python2.7/site-packages:python:python: == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_ROOT_TAR=/usr/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-4BOvyu.wrapper == env: CC=gcc == env: CCTOOLS_RESOURCE_MONITOR_INFO=1024 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=6 == env: PARROT_DEBUG_FLAGS= == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_CRC_b3_postLHE.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=18475 == env: _=/usr/bin/env ==== proxy information @ Tue May 25 02:05:45 EDT 2021 ==== == proxy: subject : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman/CN=661123957 == proxy: issuer : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman == proxy: identity : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman == proxy: type : RFC compliant proxy == proxy: strength : 1024 bits == proxy: path : proxy == proxy: timeleft : 150:43:34 ==== working directory at startup @ Tue May 25 02:05:45 EDT 2021 ==== == dir: total 856 == dir: -rw-r--r-- 2 kmohrman campus 3827 May 25 01:07 UL18_SIM_cfg.py == dir: drwxr-xr-x 2 kmohrman campus 71 May 25 02:04 bin == dir: -rwxr-xr-x 4 kmohrman campus 627272 May 25 00:13 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 May 25 02:04 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 May 25 02:04 cctools-temp-t.424470.MoQLsT == dir: -rw------- 1 kmohrman campus 51 May 25 02:05 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 May 25 02:05 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 May 25 02:04 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 May 25 02:04 librmonitor_helper.so.q8lXpj == dir: -rw-r--r-- 2 kmohrman campus 2072 May 25 02:04 parameters.json == dir: -rw------- 2 kmohrman campus 9917 May 25 02:04 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 May 25 02:04 python == dir: -rw-r--r-- 4 kmohrman campus 570 May 25 00:13 report.json.in == dir: -rw-r--r-- 2 kmohrman campus 593 May 25 00:13 sandbox-CMSSW_10_6_17_patch1-slc7_amd64_gcc700.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 37 May 25 02:04 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 May 25 02:05 t_wrapper_start == dir: -rwxr-xr-x 4 kmohrman campus 47217 May 25 00:13 task.py == dir: -rwxr-xr-x 4 kmohrman campus 5986 May 25 00:13 wrapper.sh === creating new release CMSSW_10_6_17_patch1 for scram arch slc7_amd64_gcc700 @ Tue May 25 02:05:46 EDT 2021 WARNING: In non-interactive mode release checks e.g. deprecated releases, production architectures are disabled. === unpacking sandbox-CMSSW_10_6_17_patch1-slc7_amd64_gcc700.tar.bz2 @ Tue May 25 02:05:48 EDT 2021 ==== machine load @ Tue May 25 02:05:51 EDT 2021 ==== top: unknown option 'M' Usage: top -hv | -bcHiOSs -d secs -n max -u|U user -p pid(s) -o field -w [cols] ==== environment before execution @ Tue May 25 02:05:51 EDT 2021 ==== == env: G4LEVELGAMMADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4PhotonEvaporation/5.2/data/PhotonEvaporation5.2 == env: UTM_XSD_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj == env: SRT_G4LEVELGAMMADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4PhotonEvaporation/5.2/data/PhotonEvaporation5.2 == env: VC3_VERSION_SED=4.2 == env: CMSSW_RELEASE_BASE=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1 == env: SCRAMRT_SET=CMSSW:CMSSW_10_6_17_patch1:slc7_amd64_gcc700:V2_2_9_pre13:SRT_ == env: MANPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/man:/cvmfs/cms.cern.ch/share/man: == env: CCTOOLS_RESOURCE_PROCESS_START=1621922751514099 == env: CMSSW_FWLITE_INCLUDE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include == env: SRT_GCC_RUNTIME_ASAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: ROOT_INCLUDE_PATH=/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/include/slc7_amd64_gcc700/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/include/LCG:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mctester/1.25.0a-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dd4hep/v01-10x-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtDesigner:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauolapp/1.1.5-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/charybdis/1.003-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include/SHERPA-MC:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtOpenGL:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtGui:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwig/6.521-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt3Support:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lwtnn/2.4-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4/10.4.3-pafccj2/include/Geant4:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/classlib/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cgal/4.2-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tkonlinesw/4.2.0-1_gcc7-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/starlight/r193-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtCore:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtXml:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mcdb/1.0.3-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libungif/4.1.4-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libtiff/4.0.3-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/highfive/2.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libpng/1.6.16-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pcre/8.37-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/include/xrootd/private:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/vdt/0.4.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/toprex/4.23-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tbb/2019_U3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauola/27.121.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sigcpp/2.6.2-pafccj/include/sigc++-2.0:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sqlite/3.22.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/protobuf/3.5.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pacparser/1.3.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/oracle/12.1.0.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/py2-numpy/1.16.2-nmpfii2/c-api/core/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/meschach/1.2.pCMS1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libuuid/2.22.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libunwind/1.2.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libhepml/0.2.1-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ktjet/1.06-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jimmy/4.2-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jemalloc/5.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hls/2019.08/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj10:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hector/1.3.4_patch1-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libjpeg-turbo/2.0.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/giflib/4.2.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gsl/2.2.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gdbm/1.10-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/freetype/2.5.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftw3/3.3.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftjet/1.5.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/expat/2.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dpm/1.8.0.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vecgeom/v00.05.00-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xerces-c/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xz/5.2.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dcap/2.47.8-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libxml2/2.9.1-pafccj/include/libxml2:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/curl/7.59.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cppunit/1.40.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openssl/1.0.2d-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia6/426-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/photos/215.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/zlib-x86_64/1.2.11-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/bz2lib/1.0.6-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/include/python2.7:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tinyxml2/6.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ittnotify/16.06.18-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj/include:/usr/local/include:/usr/include == env: INTEL_LICENSE_FILE=28518@lxlicen01.cern.ch,28518@lxlicen02.cern.ch,28518@lxlicen03.cern.ch == env: SRT_TEXMFHOME_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/share/Rivet/texmf == env: SRT_GEANT4_PARFULLCMS_CONFIG_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-parfullcms/2014.01.27-pafccj2/share/ParFullCMS == env: GFAL_PLUGIN_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/gfal2-plugins/ == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/usr/ == env: LOBSTER_GFAL_COPY=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin/gfal-copy == env: PDFPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/share == env: CMSSW_FULL_RELEASE_BASE=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17 == env: SRT_TNS_ADMIN_SCRAMRTDEL=/etc == env: VOMS_USERCONF=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/vomses == env: MAKEFLAGS=-j4 == env: ROOT_GCC_TOOLCHAIN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: GLOBUS_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-26750/t.424470/cctools-temp-t.424470.MoQLsT == env: G4FORCENUMBEROFTHREADS=max == env: OPENBLAS_NUM_THREADS=1 == env: SRT_PDFPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/share == env: PERL5LIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5 == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: CMSSW_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms == env: LHAPDF_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/share/LHAPDF == env: CVSROOT=:gserver:cmssw.cvs.cern.ch:/local/reps/CMSSW == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-26750/t.424470/librmonitor_helper.so.q8lXpj == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: CMSSW_GIT_HASH=CMSSW_10_6_17_patch1 == env: SRT_G4ABLADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ABLA/3.0/data/G4ABLA3.0 == env: QTDIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2 == env: SRT_SCONS_LIB_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/scons/3.0.1-pafccj/lib == env: OLDPWD=/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1 == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: G4NEUTRONXSDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NEUTRONXS/1.4/data/G4NEUTRONXS1.4 == env: QTINC=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include == env: X509_CERT_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/certificates == env: SCRAM_ARCH=slc7_amd64_gcc700 == env: GIT_SSL_CAINFO=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/ssl/certs/ca-bundle.crt == env: SRT_CMS_OPENLOOPS_PREFIX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openloops/2.1.0-pafccj2 == env: SRT_GIT_EXEC_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/libexec/git-core == env: SRT_THEPEGPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj/share/ThePEG == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: ROOT_TTREECACHE_SIZE=0 == env: EVTGENDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/evtgen/1.6.0-pafccj5/share == env: SRT_INTEL_LICENSE_FILE_SCRAMRTDEL=28518@lxlicen01.cern.ch,28518@lxlicen02.cern.ch,28518@lxlicen03.cern.ch == env: SRT_ROOT_INCLUDE_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/include/slc7_amd64_gcc700/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/include/LCG:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mctester/1.25.0a-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dd4hep/v01-10x-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtDesigner:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauolapp/1.1.5-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/charybdis/1.003-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include/SHERPA-MC:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtOpenGL:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtGui:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwig/6.521-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt3Support:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lwtnn/2.4-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4/10.4.3-pafccj2/include/Geant4:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/classlib/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cgal/4.2-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tkonlinesw/4.2.0-1_gcc7-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/starlight/r193-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtCore:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtXml:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mcdb/1.0.3-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libungif/4.1.4-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libtiff/4.0.3-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/highfive/2.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libpng/1.6.16-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pcre/8.37-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/include/xrootd/private:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/vdt/0.4.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/toprex/4.23-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tbb/2019_U3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauola/27.121.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sigcpp/2.6.2-pafccj/include/sigc++-2.0:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sqlite/3.22.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/protobuf/3.5.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pacparser/1.3.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/oracle/12.1.0.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/py2-numpy/1.16.2-nmpfii2/c-api/core/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/meschach/1.2.pCMS1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libuuid/2.22.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libunwind/1.2.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libhepml/0.2.1-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ktjet/1.06-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jimmy/4.2-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jemalloc/5.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hls/2019.08/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj10:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hector/1.3.4_patch1-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libjpeg-turbo/2.0.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/giflib/4.2.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gsl/2.2.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gdbm/1.10-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/freetype/2.5.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftw3/3.3.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftjet/1.5.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/expat/2.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dpm/1.8.0.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vecgeom/v00.05.00-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xerces-c/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xz/5.2.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dcap/2.47.8-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libxml2/2.9.1-pafccj/include/libxml2:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/curl/7.59.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cppunit/1.40.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openssl/1.0.2d-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia6/426-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/photos/215.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/zlib-x86_64/1.2.11-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/bz2lib/1.0.6-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/include/python2.7:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tinyxml2/6.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ittnotify/16.06.18-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj/include:/usr/local/include:/usr/include == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: G4LEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4EMLOW/7.3/data/G4EMLOW7.3 == env: SRT_VINCIADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vincia/2.2.04-pafccj5/share/Vincia/xmldoc == env: SRT_ROOT_TTREECACHE_PREFILL_SCRAMRTDEL=0 == env: OPAL_PREFIX=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openmpi/2.1.5-pafccj == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: ROOT_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj10:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: SHERPA_INCLUDE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include/SHERPA-MC == env: SRT_LHAPDF_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/share/LHAPDF == env: SRT_PYTHON27PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1/python:/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch-tool-conf/CMSSW_10_6_17/lib/python2.7/site-packages == env: LD_LIBRARY_PATH=/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1/biglib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/biglib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/biglib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cuda/10.1.105-pafccj2/drivers:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/dcap:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/lcgdm:/.singularity.d/libs:lib:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-26750/t.424470/cctools-temp-t.424470.MoQLsT == env: SRT_CMSSW_RELEASE_BASE_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1 == env: SRT_RIVET_ANALYSIS_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/lib == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: SRT_PERL5LIB_SCRAMRT=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/perl5 == env: SRT_CMSSW_VERSION_SCRAMRTDEL=CMSSW_10_6_17_patch1 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/usr/ == env: GCC_RUNTIME_LSAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: SCRAM_CXX11_ABI=1 == env: VALGRIND_LIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/lib/valgrind == env: SRT_CMSSW_GIT_HASH_SCRAMRTDEL=CMSSW_10_6_17_patch1 == env: SRT_ROOTSYS_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/ == env: OSG_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-4BOvyu == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-26750/cache/tmp == env: G4NEUTRONHPDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NDL/4.5/data/G4NDL4.5 == env: GEANT4_PARFULLCMS_CONFIG_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-parfullcms/2014.01.27-pafccj2/share/ParFullCMS == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: CSC_TRACK_FINDER_DATA_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/CSCTrackFinderEmulation/1.2-pafccj/data/ == env: SRT_QTINC_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: G4ENSDFSTATEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ENSDFSTATE/2.2/data/G4ENSDFSTATE2.2 == env: G4RADIOACTIVEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4RadioactiveDecay/5.2/data/RadioactiveDecay5.2 == env: ROOFITSYS=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/ == env: SRT_ROOFITSYS_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/ == env: SRT_G4RADIOACTIVEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4RadioactiveDecay/5.2/data/RadioactiveDecay5.2 == env: SRT_G4ENSDFSTATEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ENSDFSTATE/2.2/data/G4ENSDFSTATE2.2 == env: SRT_CLHEP_PARAM_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2 == env: G4ABLADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ABLA/3.0/data/G4ABLA3.0 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: SRT_SHERPA_INCLUDE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include/SHERPA-MC == env: SRT_G4FORCENUMBEROFTHREADS_SCRAMRTDEL=max == env: SRT_WORKER_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/blackhat/0.9.9-pafccj/share/blackhat/datafiles/ == env: SITECONFIG_PATH=/cvmfs/cms.cern.ch/SITECONF/local == env: PARROT_CVMFS_REPO= == env: VC3_VERSION_GZIP=1.5 == env: GCC_RUNTIME_TSAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libtsan.so == env: TNS_ADMIN=/etc == env: SRT_HEPPDT_PARAM_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj == env: PATH=/cvmfs/cms.cern.ch/share/overrides/bin:/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1/bin/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/sbin:/cvmfs/cms.cern.ch/common:/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ENV_TAG_GLOBAL=26499 == env: THEPEGPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj/share/ThePEG == env: SRT_CMSSW_SEARCH_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1/poison:/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1/src:/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/data:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/poison:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/data == env: SRT_GIT_SSL_CAINFO_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/ssl/certs/ca-bundle.crt == env: SRT_GCC_RUNTIME_LSAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: CMS_PATH=/cvmfs/cms.cern.ch == env: VC3_ROOT=/disk/vc3-root == env: SRT_UTM_XSD_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj == env: SRT_PATH_SCRAMRT=/cvmfs/cms.cern.ch/share/overrides/bin:/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1/bin/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/bin == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-4BOvyu == env: RIVET_ANALYSIS_PATH=/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/lib == env: SRT_LOCALRT_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1 == env: SRT_CMSSW_BASE_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1 == env: PWD=/disk/vc3-root/tmp/worker-230547-26750/t.424470 == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: PYTHON_VALGRIND_SUPP=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/share/valgrind/valgrind-python.supp == env: SRT_OPAL_PREFIX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openmpi/2.1.5-pafccj == env: VC3_VERSION_WHICH=2.20 == env: GCC_RUNTIME_UBSAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libubsan.so == env: LANG=C == env: SRT_QTDIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: SRT_G4NEUTRONHPDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NDL/4.5/data/G4NDL4.5 == env: X509_VOMS_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/vomsdir == env: LOBSTER_LCG_CP= == env: SRT_SHERPA_SHARE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/share/SHERPA-MC == env: SRT_GCC_RUNTIME_TSAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libtsan.so == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-26750 == env: CASCADE_PDFPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/share == env: SRT_ROOT_GCC_TOOLCHAIN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: SRT_CASCADE_PDFPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/share == env: WORKER_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/blackhat/0.9.9-pafccj/share/blackhat/datafiles/ == env: GIT_TEMPLATE_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/git-core/templates == env: G4SAIDXSDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4SAIDDATA/1.1/data/G4SAIDDATA1.1 == env: MLAS_DYNAMIC_CPU_ARCH=0 == env: SRT_CMSSW_FULL_RELEASE_BASE_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: PYTHON27PATH=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1/python:/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch-tool-conf/CMSSW_10_6_17/lib/python2.7/site-packages == env: SRT_CMSSW_FWLITE_INCLUDE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/usr/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: ROOTSYS=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/ == env: SRT_PYTHIA8DATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/share/Pythia8/xmldoc == env: SRT_HERWIGPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj/share/Herwig == env: CXX=g++ == env: SRT_QTLIB_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/lib == env: SRT_PYTHON3PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1/python:/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch-tool-conf/CMSSW_10_6_17/lib/python3.6/site-packages == env: SHERPA_LIBRARY_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/lib/SHERPA-MC == env: SRT_PYTHON_VALGRIND_SUPP_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/share/valgrind/valgrind-python.supp == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: CMSSW_SEARCH_PATH=/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1/poison:/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1/src:/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/data:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/poison:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/data == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: GENEVA_DATA_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geneva/1.0-RC3-pafccj8/share/Geneva == env: DISK=3000 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-26750/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-26750/cache/tmp/cvmfs == env: GOSAMCONTRIB_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: ROOT_TTREECACHE_PREFILL=0 == env: GENREFLEX=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/bin/genreflex == env: VINCIADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vincia/2.2.04-pafccj5/share/Vincia/xmldoc == env: SRT_G4LEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4EMLOW/7.3/data/G4EMLOW7.3 == env: SRT_GENREFLEX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/bin/genreflex == env: SRT_GOSAMCONTRIB_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: SRT_ROOT_TTREECACHE_SIZE_SCRAMRTDEL=0 == env: SRT_EVTGENDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/evtgen/1.6.0-pafccj5/share == env: SRT_GENEVA_DATA_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geneva/1.0-RC3-pafccj8/share/Geneva == env: GFAL_CONFIG_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/gfal2.d/ == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=3000 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: SRT_CMSSW_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms == env: HEPPDT_PARAM_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj == env: SRT_LD_LIBRARY_PATH_SCRAMRT=/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1/biglib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/biglib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/biglib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cuda/10.1.105-pafccj2/drivers == env: TMP=/disk/vc3-root/tmp/worker-230547-26750/t.424470/cctools-temp-t.424470.MoQLsT == env: PYTHONPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib/python2.7/site-packages:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/python2.7/site-packages:python:python: == env: PYTHON3PATH=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1/python:/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch-tool-conf/CMSSW_10_6_17/lib/python3.6/site-packages == env: QTLIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/lib == env: SCONS_LIB_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/scons/3.0.1-pafccj/lib == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: COMPILER_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: FRONTIER_CLIENT=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/ == env: SRT_G4NEUTRONXSDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NEUTRONXS/1.4/data/G4NEUTRONXS1.4 == env: SRT_SHERPA_LIBRARY_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/lib/SHERPA-MC == env: VC3_ROOT_TAR=/usr/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CLHEP_PARAM_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2 == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-4BOvyu.wrapper == env: PYTHIA8DATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/share/Pythia8/xmldoc == env: HERWIGPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj/share/Herwig == env: SRT_FRONTIER_CLIENT_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/ == env: SRT_COMPILER_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: SRT_CSC_TRACK_FINDER_DATA_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/CSCTrackFinderEmulation/1.2-pafccj/data/ == env: GCC_RUNTIME_ASAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: SRT_ROOT_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj10:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: CC=gcc == env: TEXMFHOME=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/share/Rivet/texmf == env: SRT_MLAS_DYNAMIC_CPU_ARCH_SCRAMRTDEL=0 == env: SRT_OPENBLAS_NUM_THREADS_SCRAMRTDEL=1 == env: SRT_GIT_TEMPLATE_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/git-core/templates == env: SRT_G4SAIDXSDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4SAIDDATA/1.1/data/G4SAIDDATA1.1 == env: CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: SRT_GCC_RUNTIME_UBSAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libubsan.so == env: SRT_LANG_SCRAMRTDEL=C == env: CCTOOLS_RESOURCE_MONITOR_INFO=1024 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=6 == env: PARROT_DEBUG_FLAGS= == env: SHERPA_SHARE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/share/SHERPA-MC == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: CMS_OPENLOOPS_PREFIX=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openloops/2.1.0-pafccj2 == env: GIT_EXEC_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/libexec/git-core == env: LOCALRT=/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1 == env: CMSSW_BASE=/disk/vc3-root/tmp/worker-230547-26750/t.424470/CMSSW_10_6_17_patch1 == env: SRT_SCRAM_CXX11_ABI_SCRAMRTDEL=1 == env: SRT_VALGRIND_LIB_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/lib/valgrind == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_CRC_b3_postLHE.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=18475 == env: _=/usr/bin/env === wrapper ready @ Tue May 25 02:05:53 EDT 2021 ==== working directory before execution @ Tue May 25 02:05:53 EDT 2021 ==== == dir: total 864 == dir: drwxr-xr-x 18 kmohrman campus 215 May 25 02:05 CMSSW_10_6_17_patch1 == dir: -rw-r--r-- 2 kmohrman campus 3827 May 25 01:07 UL18_SIM_cfg.py == dir: drwxr-xr-x 2 kmohrman campus 71 May 25 02:04 bin == dir: -rwxr-xr-x 4 kmohrman campus 627272 May 25 00:13 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 May 25 02:04 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 May 25 02:04 cctools-temp-t.424470.MoQLsT == dir: -rw------- 1 kmohrman campus 51 May 25 02:05 cvmfschecksum.cms-ib.cern.ch == dir: -rw------- 1 kmohrman campus 51 May 25 02:05 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 May 25 02:05 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 May 25 02:04 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 May 25 02:04 librmonitor_helper.so.q8lXpj == dir: -rw-r--r-- 2 kmohrman campus 2072 May 25 02:04 parameters.json == dir: -rw------- 2 kmohrman campus 9917 May 25 02:04 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 May 25 02:04 python == dir: -rw-r--r-- 4 kmohrman campus 570 May 25 00:13 report.json.in == dir: -rw-r--r-- 2 kmohrman campus 593 May 25 00:13 sandbox-CMSSW_10_6_17_patch1-slc7_amd64_gcc700.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 37 May 25 02:04 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 May 25 02:05 t_wrapper_ready == dir: -rw-r--r-- 1 kmohrman campus 11 May 25 02:05 t_wrapper_start == dir: -rwxr-xr-x 4 kmohrman campus 47217 May 25 00:13 task.py == dir: -rwxr-xr-x 4 kmohrman campus 5986 May 25 00:13 wrapper.sh >>> data is {u'files': {u'info': {}, u'output_info': {}, u'skipped': []}, u'cpu_time': 0, u'exe_exit_code': 0, u'events_written': 0, u'output_size': 0, u'task_exit_code': 0, u'output_storage_element': u'', u'cache': {u'start_size': 0, u'type': 2, u'end_size': 0}, u'stageout_exit_code': 0, u'output_bare_size': 0, u'transfers': defaultdict(, {}), u'task_timing': {u'wrapper_ready': 0, u'wrapper_start': 0, u'prologue_end': 0, u'epilogue_end': 0, u'stage_out_end': 0, u'stage_in_end': 0, u'processing_end': 0}, u'events_per_run': 0} @ Tue May 25 02:06:00 2021 >>> Trying hdfs client access method @ Tue May 25 02:06:00 2021 >>> executing 'timeout 300 hdfs dfs -fs hdfs://eddie.crc.nd.edu:19000 -get /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/gen_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/GEN-00000_170544.root GEN-00000_170544.root' @ Tue May 25 02:06:00 2021 >> using /disk/vc3-root/tmp/worker-230547-26750/t.424470/cctools-temp-t.424470.MoQLsT/tmpnjeK_q to store command output >> cmd: timeout: failed to run command 'hdfs': No such file or directory >>>>> Unable to copy input with hdfs client @ Tue May 25 02:06:00 2021 >>> Trying xrootd access method @ Tue May 25 02:06:00 2021 >>> executing 'env XRD_LOGLEVEL=Debug timeout 300 xrdfs deepthought.crc.nd.edu stat /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/gen_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/GEN-00000_170544.root' @ Tue May 25 02:06:00 2021 >> using /disk/vc3-root/tmp/worker-230547-26750/t.424470/cctools-temp-t.424470.MoQLsT/tmp6_H1Rx to store command output >> cmd: [2021-05-25 02:06:01.101639 -0400][Warning][Utility ] Unable to process global config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 02:06:01.103541 -0400][Debug ][Utility ] Unable to process user config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 02:06:01.103724 -0400][Debug ][PlugInMgr ] Initializing plug-in manager... >> cmd: [2021-05-25 02:06:01.103784 -0400][Debug ][PlugInMgr ] No default plug-in, loading plug-in configs... >> cmd: [2021-05-25 02:06:01.103849 -0400][Debug ][PlugInMgr ] Processing plug-in definitions in /etc/xrootd/client.plugins.d... >> cmd: [2021-05-25 02:06:01.104001 -0400][Debug ][PlugInMgr ] Unable to process directory /etc/xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 02:06:01.104725 -0400][Debug ][PlugInMgr ] Processing plug-in definitions in /tmp/runos_singularity_home-220123464960721214200475588710455738022/.xrootd/client.plugins.d... >> cmd: [2021-05-25 02:06:01.104840 -0400][Debug ][PlugInMgr ] Unable to process directory /tmp/runos_singularity_home-220123464960721214200475588710455738022/.xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 02:06:01.105049 -0400][Debug ][App ] Executing: stat /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/gen_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/GEN-00000_170544.root >> cmd: [2021-05-25 02:06:01.105165 -0400][Debug ][Poller ] Available pollers: built-in >> cmd: [2021-05-25 02:06:01.105218 -0400][Debug ][Poller ] Attempting to create a poller according to preference: built-in >> cmd: [2021-05-25 02:06:01.105270 -0400][Debug ][Poller ] Creating poller: built-in >> cmd: [2021-05-25 02:06:01.105327 -0400][Debug ][Poller ] Creating and starting the built-in poller... >> cmd: [2021-05-25 02:06:01.105736 -0400][Debug ][Poller ] Using 1 poller threads >> cmd: [2021-05-25 02:06:01.105810 -0400][Debug ][TaskMgr ] Starting the task manager... >> cmd: [2021-05-25 02:06:01.105957 -0400][Debug ][TaskMgr ] Task manager started >> cmd: [2021-05-25 02:06:01.106024 -0400][Debug ][JobMgr ] Starting the job manager... >> cmd: [2021-05-25 02:06:01.106394 -0400][Debug ][JobMgr ] Job manager started, 3 workers >> cmd: [2021-05-25 02:06:01.106450 -0400][Debug ][TaskMgr ] Registering task: "FileTimer task" to be run at: [2021-05-25 02:06:01 -0400] >> cmd: [2021-05-25 02:06:01.106529 -0400][Debug ][PostMaster ] Creating new channel to: deepthought.crc.nd.edu:1094 1 stream(s) >> cmd: [2021-05-25 02:06:01.106595 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-05-25 02:06:01.108389 -0400][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" to be run at: [2021-05-25 02:06:16 -0400] >> cmd: [2021-05-25 02:06:01.109619 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 02:06:01.109776 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 02:06:01.109873 -0400][Debug ][Poller ] Adding socket 0x18d1920 to the poller >> cmd: [2021-05-25 02:06:01.110514 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2021-05-25 02:06:01.110625 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-05-25 02:06:01.111344 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Got the server hand shake response (type: manager [], protocol version 500) >> cmd: [2021-05-25 02:06:01.111526 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] kXR_protocol successful (type: manager [], protocol version 500) >> cmd: [2021-05-25 02:06:01.115239 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=d8civy109.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-05-25 02:06:01.117524 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Logged in, session: 85500000cf3c0b00a00b000030550000 >> cmd: [2021-05-25 02:06:01.117608 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream 0 connected. >> cmd: [2021-05-25 02:06:01.117656 -0400][Debug ][Utility ] Monitor library name not set. No monitoring >> cmd: [2021-05-25 02:06:01.121961 -0400][Debug ][PostMaster ] Creating new channel to: primeradiant03.crc.nd.edu:1096 1 stream(s) >> cmd: [2021-05-25 02:06:01.122062 -0400][Debug ][PostMaster ] [primeradiant03.crc.nd.edu:1096 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-05-25 02:06:01.125754 -0400][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: primeradiant03.crc.nd.edu:1096" to be run at: [2021-05-25 02:06:16 -0400] >> cmd: [2021-05-25 02:06:01.128923 -0400][Debug ][PostMaster ] [primeradiant03.crc.nd.edu:1096] Found 1 address(es): [::ffff:149.165.243.11]:1096 >> cmd: [2021-05-25 02:06:01.129076 -0400][Debug ][AsyncSock ] [primeradiant03.crc.nd.edu:1096 #0.0] Attempting connection to [::ffff:149.165.243.11]:1096 >> cmd: [2021-05-25 02:06:01.129165 -0400][Debug ][Poller ] Adding socket 0x980016a0 to the poller >> cmd: [2021-05-25 02:06:01.129284 -0400][Debug ][AsyncSock ] [primeradiant03.crc.nd.edu:1096 #0.0] Async connection call returned >> cmd: [2021-05-25 02:06:01.129384 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-05-25 02:06:01.129704 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Got the server hand shake response (type: server [], protocol version 500) >> cmd: [2021-05-25 02:06:01.129877 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] kXR_protocol successful (type: server [], protocol version 500) >> cmd: [2021-05-25 02:06:01.132922 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=d8civy109.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-05-25 02:06:01.153705 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Logged in, session: 582301001c210000201900005e230100 >> cmd: [2021-05-25 02:06:01.153775 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Authentication is required: &P=gsi,v:10400,c:ssl,ca:ba240aa8.0|f5f0dfc2.0 >> cmd: [2021-05-25 02:06:01.153824 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Sending authentication data >> cmd: [2021-05-25 02:06:01.161681 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Trying to authenticate using gsi >> cmd: [2021-05-25 02:06:01.231948 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Sending more authentication data for gsi >> cmd: [2021-05-25 02:06:01.239062 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Authenticated with gsi. >> cmd: [2021-05-25 02:06:01.239149 -0400][Debug ][PostMaster ] [primeradiant03.crc.nd.edu:1096 #0] Stream 0 connected. >> cmd: [2021-05-25 02:07:01.465909 -0400][Debug ][AsyncSock ] [primeradiant03.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2021-05-25 02:07:01.466223 -0400][Debug ][Poller ] <[::ffff:10.32.79.81]:45992><--><[::ffff:149.165.243.11]:1096> Removing socket from the poller >> cmd: [2021-05-25 02:07:01.466633 -0400][Debug ][PostMaster ] [primeradiant03.crc.nd.edu:1096 #0] Recovering error for stream #0: [ERROR] Socket error. >> cmd: [2021-05-25 02:07:01.466745 -0400][Debug ][PostMaster ] [primeradiant03.crc.nd.edu:1096 #0] Reporting disconnection to queued message handlers. >> cmd: [2021-05-25 02:07:01.466855 -0400][Debug ][XRootD ] [primeradiant03.crc.nd.edu:1096] Handling error while processing kXR_stat (path: /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/gen_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/GEN-00000_170544.root, flags: none): [ERROR] Socket error. >> cmd: [2021-05-25 02:07:01.469473 -0400][Debug ][PostMaster ] Creating new channel to: primeradiant02.crc.nd.edu:1096 1 stream(s) >> cmd: [2021-05-25 02:07:01.469662 -0400][Debug ][PostMaster ] [primeradiant02.crc.nd.edu:1096 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-05-25 02:07:01.472835 -0400][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: primeradiant02.crc.nd.edu:1096" to be run at: [2021-05-25 02:07:16 -0400] >> cmd: [2021-05-25 02:07:01.474734 -0400][Debug ][PostMaster ] [primeradiant02.crc.nd.edu:1096] Found 1 address(es): [::ffff:149.165.243.6]:1096 >> cmd: [2021-05-25 02:07:01.475074 -0400][Debug ][AsyncSock ] [primeradiant02.crc.nd.edu:1096 #0.0] Attempting connection to [::ffff:149.165.243.6]:1096 >> cmd: [2021-05-25 02:07:01.475285 -0400][Debug ][Poller ] Adding socket 0xa0001540 to the poller >> cmd: [2021-05-25 02:07:01.475872 -0400][Debug ][AsyncSock ] [primeradiant02.crc.nd.edu:1096 #0.0] Async connection call returned >> cmd: [2021-05-25 02:07:01.476099 -0400][Debug ][XRootDTransport ] [primeradiant02.crc.nd.edu:1096 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-05-25 02:07:01.476820 -0400][Debug ][XRootDTransport ] [primeradiant02.crc.nd.edu:1096 #0.0] Got the server hand shake response (type: server [], protocol version 500) >> cmd: [2021-05-25 02:07:01.477196 -0400][Debug ][XRootDTransport ] [primeradiant02.crc.nd.edu:1096 #0.0] kXR_protocol successful (type: server [], protocol version 500) >> cmd: [2021-05-25 02:07:01.481444 -0400][Debug ][XRootDTransport ] [primeradiant02.crc.nd.edu:1096 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=d8civy109.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-05-25 02:07:01.482120 -0400][Debug ][XRootDTransport ] [primeradiant02.crc.nd.edu:1096 #0.0] Logged in, session: 87150000785b00001c05000087150000 >> cmd: [2021-05-25 02:07:01.482232 -0400][Debug ][XRootDTransport ] [primeradiant02.crc.nd.edu:1096 #0.0] Authentication is required: &P=gsi,v:10400,c:ssl,ca:ba240aa8.0|f5f0dfc2.0 >> cmd: [2021-05-25 02:07:01.482326 -0400][Debug ][XRootDTransport ] [primeradiant02.crc.nd.edu:1096 #0.0] Sending authentication data >> cmd: [2021-05-25 02:07:01.483872 -0400][Debug ][XRootDTransport ] [primeradiant02.crc.nd.edu:1096 #0.0] Trying to authenticate using gsi >> cmd: [2021-05-25 02:07:01.523352 -0400][Debug ][XRootDTransport ] [primeradiant02.crc.nd.edu:1096 #0.0] Sending more authentication data for gsi >> cmd: [2021-05-25 02:07:01.530718 -0400][Debug ][XRootDTransport ] [primeradiant02.crc.nd.edu:1096 #0.0] Authenticated with gsi. >> cmd: [2021-05-25 02:07:01.530865 -0400][Debug ][PostMaster ] [primeradiant02.crc.nd.edu:1096 #0] Stream 0 connected. >> cmd: Path: /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/gen_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/GEN-00000_170544.root >> cmd: Id: 0 >> cmd: Size: 29547902 >> cmd: MTime: 2021-05-19 21:23:26 >> cmd: Flags: 24 (Offline|IsReadable) >> cmd: [2021-05-25 02:07:01.561574 -0400][Debug ][JobMgr ] Stopping the job manager... >> cmd: [2021-05-25 02:07:01.562944 -0400][Debug ][JobMgr ] Job manager stopped >> cmd: [2021-05-25 02:07:01.563048 -0400][Debug ][TaskMgr ] Stopping the task manager... >> cmd: [2021-05-25 02:07:01.563538 -0400][Debug ][TaskMgr ] Task manager stopped >> cmd: [2021-05-25 02:07:01.563603 -0400][Debug ][Poller ] Stopping the poller... >> cmd: [2021-05-25 02:07:01.564034 -0400][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" >> cmd: [2021-05-25 02:07:01.564120 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-05-25 02:07:01.564178 -0400][Debug ][Poller ] <[::ffff:10.32.79.81]:34612><--><[::ffff:129.74.85.55]:1094> Removing socket from the poller >> cmd: [2021-05-25 02:07:01.564293 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Destroying stream >> cmd: [2021-05-25 02:07:01.564352 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-05-25 02:07:01.564411 -0400][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: primeradiant02.crc.nd.edu:1096" >> cmd: [2021-05-25 02:07:01.564464 -0400][Debug ][AsyncSock ] [primeradiant02.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2021-05-25 02:07:01.564517 -0400][Debug ][Poller ] <[::ffff:10.32.79.81]:36948><--><[::ffff:149.165.243.6]:1096> Removing socket from the poller >> cmd: [2021-05-25 02:07:01.564604 -0400][Debug ][PostMaster ] [primeradiant02.crc.nd.edu:1096 #0] Destroying stream >> cmd: [2021-05-25 02:07:01.564693 -0400][Debug ][AsyncSock ] [primeradiant02.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2021-05-25 02:07:01.564753 -0400][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: primeradiant03.crc.nd.edu:1096" >> cmd: [2021-05-25 02:07:01.564805 -0400][Debug ][AsyncSock ] [primeradiant03.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2021-05-25 02:07:01.564876 -0400][Debug ][PostMaster ] [primeradiant03.crc.nd.edu:1096 #0] Destroying stream >> cmd: [2021-05-25 02:07:01.564929 -0400][Debug ][AsyncSock ] [primeradiant03.crc.nd.edu:1096 #0.0] Closing the socket >>> will stream using xrootd instead of copying @ Tue May 25 02:07:01 2021 >>> modified input files @ Tue May 25 02:07:01 2021 >> input: root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/gen_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/GEN-00000_170544.root >>> updated parameters are @ Tue May 25 02:07:01 2021 >> json: { >> json: "accelerate stage-in": 3, >> json: "arguments": [], >> json: "cores": 6, >> json: "default ce": "T3_US_NotreDame", >> json: "default host": "earth.crc.nd.edu", >> json: "default se": "T3_US_NotreDame", >> json: "disable streaming": false, >> json: "epilogue": null, >> json: "executable": "cmsRun", >> json: "file map": { >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/gen_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/GEN-00000_170544.root": "gen_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/GEN-00000_170544.root" >> json: }, >> json: "gridpack": false, >> json: "input": [ >> json: "hdfs://eddie.crc.nd.edu:19000/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1", >> json: "file:///hadoop/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/" >> json: ], >> json: "mask": { >> json: "events": -1, >> json: "files": [ >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/gen_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/GEN-00000_170544.root" >> json: ], >> json: "lumis": { >> json: "1": [ >> json: [ >> json: 7818, >> json: 7818 >> json: ] >> json: ] >> json: } >> json: }, >> json: "monitoring": { >> json: "monitorid": null, >> json: "syncid": null, >> json: "taskid": "lobster_kmohrman_EFT_CRC_b3_postLHE_crc_20210518_1057_ef74fc80a747ad6e" >> json: }, >> json: "output": [ >> json: "hdfs://eddie.crc.nd.edu:19000/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1", >> json: "file:///hadoop/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/" >> json: ], >> json: "output files": [ >> json: [ >> json: "SIM-00000.root", >> json: "sim_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_424470.root" >> json: ] >> json: ], >> json: "prologue": null, >> json: "pset": "UL18_SIM_cfg.py", >> json: "want summary": true >> json: } >>> using sync CE T3_US_NotreDame @ Tue May 25 02:07:01 2021 >>> config file fragment @ Tue May 25 02:07:03 2021 >> pset: >> pset: import FWCore.ParameterSet.Config as cms >> pset: process.Timing = cms.Service("Timing", >> pset: useJobReport = cms.untracked.bool(True), >> pset: summaryOnly = cms.untracked.bool(True)) >> pset: >> pset: process.maxEvents = cms.untracked.PSet(input = cms.untracked.int32(-1)) >> pset: >> pset: import os >> pset: _, major, minor, _ = os.environ["CMSSW_VERSION"].split('_', 3) >> pset: if int(major) >= 7 and int(minor) >= 4: >> pset: xrdstats = cms.Service("XrdAdaptor::XrdStatisticsService", cms.untracked.PSet(reportToFJR = cms.untracked.bool(True))) >> pset: process.add_(xrdstats) >> pset: >> pset: for prod in process.producers.values(): >> pset: if prod.hasParameter('nEvents') and prod.type_() == 'ExternalLHEProducer': >> pset: prod.nEvents = cms.untracked.uint32(-1) >> pset: >> pset: process.source.fileNames = cms.untracked.vstring(['root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/gen_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/GEN-00000_170544.root']) >> pset: process.source.lumisToProcess = cms.untracked.VLuminosityBlockRange(['1:7818']) >> pset: if hasattr(process, 'options'): >> pset: process.options.wantSummary = cms.untracked.bool(True) >> pset: else: >> pset: process.options = cms.untracked.PSet(wantSummary = cms.untracked.bool(True)) >> pset: >> pset: if hasattr(process, 'options'): >> pset: process.options.numberOfThreads = cms.untracked.uint32(6) >> pset: process.options.numberOfStreams = cms.untracked.uint32(0) >> pset: else: >> pset: process.options = cms.untracked.PSet( >> pset: numberOfThreads = cms.untracked.uint32(6), >> pset: numberOfStreams = cms.untracked.uint32(0) >> pset: ) >>> executing 'cmsRun -j report.xml UL18_SIM_cfg_mod.py' @ Tue May 25 02:07:03 2021 >> using /disk/vc3-root/tmp/worker-230547-26750/t.424470/cctools-temp-t.424470.MoQLsT/tmppPjkkC to store command output >> cmd: %MSG-i ThreadStreamSetup: (NoModuleName) 25-May-2021 02:07:13 EDT pre-events >> cmd: setting # threads 6 >> cmd: setting # streams 6 >> cmd: %MSG >> cmd: 25-May-2021 02:07:25 EDT Initiating request to open file root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/gen_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/GEN-00000_170544.root >> cmd: 25-May-2021 02:07:29 EDT Successfully opened file root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/gen_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/GEN-00000_170544.root >> cmd: Begin processing the 1st record. Run 1, Event 1, LumiSection 7818 on stream 0 at 25-May-2021 02:08:22.101 EDT >> cmd: Begin processing the 2nd record. Run 1, Event 2, LumiSection 7818 on stream 2 at 25-May-2021 02:08:22.102 EDT >> cmd: Begin processing the 3rd record. Run 1, Event 4, LumiSection 7818 on stream 1 at 25-May-2021 02:08:22.103 EDT >> cmd: Begin processing the 4th record. Run 1, Event 10, LumiSection 7818 on stream 5 at 25-May-2021 02:08:22.104 EDT >> cmd: Begin processing the 5th record. Run 1, Event 14, LumiSection 7818 on stream 3 at 25-May-2021 02:08:22.105 EDT >> cmd: Begin processing the 6th record. Run 1, Event 16, LumiSection 7818 on stream 4 at 25-May-2021 02:08:22.106 EDT >> cmd: Begin processing the 7th record. Run 1, Event 18, LumiSection 7818 on stream 2 at 25-May-2021 02:08:49.000 EDT >> cmd: Begin processing the 8th record. Run 1, Event 20, LumiSection 7818 on stream 3 at 25-May-2021 02:08:54.011 EDT >> cmd: Begin processing the 9th record. Run 1, Event 24, LumiSection 7818 on stream 0 at 25-May-2021 02:09:04.237 EDT >> cmd: Begin processing the 10th record. Run 1, Event 25, LumiSection 7818 on stream 3 at 25-May-2021 02:09:12.659 EDT >> cmd: Begin processing the 11th record. Run 1, Event 28, LumiSection 7818 on stream 2 at 25-May-2021 02:09:13.155 EDT >> cmd: Begin processing the 12th record. Run 1, Event 30, LumiSection 7818 on stream 1 at 25-May-2021 02:09:22.881 EDT >> cmd: Begin processing the 13th record. Run 1, Event 31, LumiSection 7818 on stream 5 at 25-May-2021 02:09:26.319 EDT >> cmd: Begin processing the 14th record. Run 1, Event 33, LumiSection 7818 on stream 0 at 25-May-2021 02:09:34.036 EDT >> cmd: Begin processing the 15th record. Run 1, Event 39, LumiSection 7818 on stream 4 at 25-May-2021 02:09:43.757 EDT >> cmd: Begin processing the 16th record. Run 1, Event 43, LumiSection 7818 on stream 3 at 25-May-2021 02:09:51.408 EDT >> cmd: Begin processing the 17th record. Run 1, Event 44, LumiSection 7818 on stream 2 at 25-May-2021 02:09:54.320 EDT >> cmd: Begin processing the 18th record. Run 1, Event 45, LumiSection 7818 on stream 1 at 25-May-2021 02:09:57.670 EDT >> cmd: Begin processing the 19th record. Run 1, Event 49, LumiSection 7818 on stream 0 at 25-May-2021 02:10:15.675 EDT >> cmd: Begin processing the 20th record. Run 1, Event 51, LumiSection 7818 on stream 4 at 25-May-2021 02:10:15.861 EDT >> cmd: Begin processing the 21st record. Run 1, Event 52, LumiSection 7818 on stream 2 at 25-May-2021 02:10:25.889 EDT >> cmd: Begin processing the 22nd record. Run 1, Event 54, LumiSection 7818 on stream 5 at 25-May-2021 02:10:27.230 EDT >> cmd: Begin processing the 23rd record. Run 1, Event 55, LumiSection 7818 on stream 2 at 25-May-2021 02:10:47.613 EDT >> cmd: Begin processing the 24th record. Run 1, Event 58, LumiSection 7818 on stream 3 at 25-May-2021 02:10:53.460 EDT >> cmd: Begin processing the 25th record. Run 1, Event 60, LumiSection 7818 on stream 1 at 25-May-2021 02:10:54.442 EDT >> cmd: Begin processing the 26th record. Run 1, Event 61, LumiSection 7818 on stream 0 at 25-May-2021 02:10:59.284 EDT >> cmd: Begin processing the 27th record. Run 1, Event 62, LumiSection 7818 on stream 4 at 25-May-2021 02:11:00.272 EDT >> cmd: Begin processing the 28th record. Run 1, Event 63, LumiSection 7818 on stream 2 at 25-May-2021 02:11:16.900 EDT >> cmd: Begin processing the 29th record. Run 1, Event 66, LumiSection 7818 on stream 5 at 25-May-2021 02:11:21.520 EDT >> cmd: [2021-05-25 02:11:25.344160 -0400][Error ][XRootD ] [deepthought.crc.nd.edu:1094] Unable to get the response to request kXR_open (file: /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/gen_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/GEN-00000_170544.root?tried=primeradiant04.crc.nd.edu, mode: 0660, flags: kXR_open_read kXR_async kXR_retstat ) >> cmd: Begin processing the 30th record. Run 1, Event 67, LumiSection 7818 on stream 1 at 25-May-2021 02:11:30.324 EDT >> cmd: Begin processing the 31st record. Run 1, Event 70, LumiSection 7818 on stream 4 at 25-May-2021 02:11:41.058 EDT >> cmd: Begin processing the 32nd record. Run 1, Event 71, LumiSection 7818 on stream 3 at 25-May-2021 02:11:45.321 EDT >> cmd: Begin processing the 33rd record. Run 1, Event 73, LumiSection 7818 on stream 0 at 25-May-2021 02:11:49.652 EDT >> cmd: Begin processing the 34th record. Run 1, Event 74, LumiSection 7818 on stream 2 at 25-May-2021 02:11:52.963 EDT >> cmd: Begin processing the 35th record. Run 1, Event 77, LumiSection 7818 on stream 1 at 25-May-2021 02:11:55.744 EDT >> cmd: Begin processing the 36th record. Run 1, Event 79, LumiSection 7818 on stream 0 at 25-May-2021 02:12:16.907 EDT >> cmd: Begin processing the 37th record. Run 1, Event 84, LumiSection 7818 on stream 5 at 25-May-2021 02:12:18.825 EDT >> cmd: Begin processing the 38th record. Run 1, Event 85, LumiSection 7818 on stream 3 at 25-May-2021 02:12:18.922 EDT >> cmd: Begin processing the 39th record. Run 1, Event 86, LumiSection 7818 on stream 2 at 25-May-2021 02:12:20.115 EDT >> cmd: Begin processing the 40th record. Run 1, Event 89, LumiSection 7818 on stream 1 at 25-May-2021 02:12:20.358 EDT >> cmd: Begin processing the 41st record. Run 1, Event 94, LumiSection 7818 on stream 4 at 25-May-2021 02:12:26.676 EDT >> cmd: Begin processing the 42nd record. Run 1, Event 97, LumiSection 7818 on stream 5 at 25-May-2021 02:12:37.279 EDT >> cmd: Begin processing the 43rd record. Run 1, Event 98, LumiSection 7818 on stream 2 at 25-May-2021 02:12:37.978 EDT >> cmd: Begin processing the 44th record. Run 1, Event 101, LumiSection 7818 on stream 3 at 25-May-2021 02:12:39.182 EDT >> cmd: Begin processing the 45th record. Run 1, Event 102, LumiSection 7818 on stream 1 at 25-May-2021 02:12:39.228 EDT >> cmd: Begin processing the 46th record. Run 1, Event 105, LumiSection 7818 on stream 4 at 25-May-2021 02:12:40.837 EDT >> cmd: Begin processing the 47th record. Run 1, Event 106, LumiSection 7818 on stream 0 at 25-May-2021 02:12:55.758 EDT >> cmd: Begin processing the 48th record. Run 1, Event 108, LumiSection 7818 on stream 2 at 25-May-2021 02:13:03.968 EDT >> cmd: Begin processing the 49th record. Run 1, Event 113, LumiSection 7818 on stream 1 at 25-May-2021 02:13:08.531 EDT >> cmd: Begin processing the 50th record. Run 1, Event 118, LumiSection 7818 on stream 4 at 25-May-2021 02:13:08.796 EDT >> cmd: Begin processing the 51st record. Run 1, Event 124, LumiSection 7818 on stream 3 at 25-May-2021 02:13:11.910 EDT >> cmd: Begin processing the 52nd record. Run 1, Event 125, LumiSection 7818 on stream 5 at 25-May-2021 02:13:17.054 EDT >> cmd: Begin processing the 53rd record. Run 1, Event 127, LumiSection 7818 on stream 0 at 25-May-2021 02:13:35.869 EDT >> cmd: Begin processing the 54th record. Run 1, Event 131, LumiSection 7818 on stream 2 at 25-May-2021 02:13:39.744 EDT >> cmd: Begin processing the 55th record. Run 1, Event 137, LumiSection 7818 on stream 5 at 25-May-2021 02:13:49.902 EDT >> cmd: Begin processing the 56th record. Run 1, Event 140, LumiSection 7818 on stream 3 at 25-May-2021 02:13:52.281 EDT >> cmd: Begin processing the 57th record. Run 1, Event 141, LumiSection 7818 on stream 0 at 25-May-2021 02:13:56.809 EDT >> cmd: Begin processing the 58th record. Run 1, Event 142, LumiSection 7818 on stream 4 at 25-May-2021 02:14:05.896 EDT >> cmd: Begin processing the 59th record. Run 1, Event 153, LumiSection 7818 on stream 2 at 25-May-2021 02:14:09.254 EDT >> cmd: Begin processing the 60th record. Run 1, Event 159, LumiSection 7818 on stream 1 at 25-May-2021 02:14:12.289 EDT >> cmd: Begin processing the 61st record. Run 1, Event 160, LumiSection 7818 on stream 5 at 25-May-2021 02:14:18.569 EDT >> cmd: Begin processing the 62nd record. Run 1, Event 162, LumiSection 7818 on stream 3 at 25-May-2021 02:14:24.864 EDT >> cmd: Begin processing the 63rd record. Run 1, Event 165, LumiSection 7818 on stream 0 at 25-May-2021 02:14:38.273 EDT >> cmd: Begin processing the 64th record. Run 1, Event 167, LumiSection 7818 on stream 1 at 25-May-2021 02:14:44.786 EDT >> cmd: Begin processing the 65th record. Run 1, Event 171, LumiSection 7818 on stream 2 at 25-May-2021 02:14:49.494 EDT >> cmd: Begin processing the 66th record. Run 1, Event 173, LumiSection 7818 on stream 4 at 25-May-2021 02:14:52.268 EDT >> cmd: Begin processing the 67th record. Run 1, Event 175, LumiSection 7818 on stream 5 at 25-May-2021 02:14:56.722 EDT >> cmd: Begin processing the 68th record. Run 1, Event 178, LumiSection 7818 on stream 1 at 25-May-2021 02:15:09.116 EDT >> cmd: Begin processing the 69th record. Run 1, Event 179, LumiSection 7818 on stream 3 at 25-May-2021 02:15:11.691 EDT >> cmd: Begin processing the 70th record. Run 1, Event 180, LumiSection 7818 on stream 0 at 25-May-2021 02:15:13.510 EDT >> cmd: Begin processing the 71st record. Run 1, Event 184, LumiSection 7818 on stream 2 at 25-May-2021 02:15:31.321 EDT >> cmd: Begin processing the 72nd record. Run 1, Event 193, LumiSection 7818 on stream 5 at 25-May-2021 02:15:33.694 EDT >> cmd: Begin processing the 73rd record. Run 1, Event 197, LumiSection 7818 on stream 1 at 25-May-2021 02:15:34.835 EDT >> cmd: Begin processing the 74th record. Run 1, Event 200, LumiSection 7818 on stream 0 at 25-May-2021 02:15:35.965 EDT >> cmd: Begin processing the 75th record. Run 1, Event 202, LumiSection 7818 on stream 3 at 25-May-2021 02:15:47.846 EDT >> cmd: Begin processing the 76th record. Run 1, Event 204, LumiSection 7818 on stream 4 at 25-May-2021 02:15:54.304 EDT >> cmd: Begin processing the 77th record. Run 1, Event 207, LumiSection 7818 on stream 5 at 25-May-2021 02:16:00.745 EDT >> cmd: Begin processing the 78th record. Run 1, Event 208, LumiSection 7818 on stream 2 at 25-May-2021 02:16:04.175 EDT >> cmd: Begin processing the 79th record. Run 1, Event 216, LumiSection 7818 on stream 3 at 25-May-2021 02:16:07.060 EDT >> cmd: Begin processing the 80th record. Run 1, Event 218, LumiSection 7818 on stream 1 at 25-May-2021 02:16:08.797 EDT >> cmd: Begin processing the 81st record. Run 1, Event 222, LumiSection 7818 on stream 4 at 25-May-2021 02:16:21.074 EDT >> cmd: Begin processing the 82nd record. Run 1, Event 223, LumiSection 7818 on stream 0 at 25-May-2021 02:16:25.768 EDT >> cmd: Begin processing the 83rd record. Run 1, Event 224, LumiSection 7818 on stream 1 at 25-May-2021 02:16:28.446 EDT >> cmd: Begin processing the 84th record. Run 1, Event 225, LumiSection 7818 on stream 2 at 25-May-2021 02:16:37.730 EDT >> cmd: Begin processing the 85th record. Run 1, Event 227, LumiSection 7818 on stream 5 at 25-May-2021 02:16:44.835 EDT >> cmd: Begin processing the 86th record. Run 1, Event 228, LumiSection 7818 on stream 3 at 25-May-2021 02:16:46.209 EDT >> cmd: Begin processing the 87th record. Run 1, Event 231, LumiSection 7818 on stream 5 at 25-May-2021 02:17:09.506 EDT >> cmd: Begin processing the 88th record. Run 1, Event 233, LumiSection 7818 on stream 2 at 25-May-2021 02:17:18.498 EDT >> cmd: Begin processing the 89th record. Run 1, Event 235, LumiSection 7818 on stream 0 at 25-May-2021 02:17:19.846 EDT >> cmd: Begin processing the 90th record. Run 1, Event 240, LumiSection 7818 on stream 4 at 25-May-2021 02:17:22.620 EDT >> cmd: Begin processing the 91st record. Run 1, Event 241, LumiSection 7818 on stream 5 at 25-May-2021 02:17:38.031 EDT >> cmd: Begin processing the 92nd record. Run 1, Event 242, LumiSection 7818 on stream 1 at 25-May-2021 02:17:45.870 EDT >> cmd: Begin processing the 93rd record. Run 1, Event 244, LumiSection 7818 on stream 0 at 25-May-2021 02:17:51.548 EDT >> cmd: Begin processing the 94th record. Run 1, Event 247, LumiSection 7818 on stream 3 at 25-May-2021 02:17:57.379 EDT >> cmd: Begin processing the 95th record. Run 1, Event 248, LumiSection 7818 on stream 2 at 25-May-2021 02:17:59.012 EDT >> cmd: Begin processing the 96th record. Run 1, Event 249, LumiSection 7818 on stream 4 at 25-May-2021 02:18:04.851 EDT >> cmd: Begin processing the 97th record. Run 1, Event 257, LumiSection 7818 on stream 5 at 25-May-2021 02:18:29.166 EDT >> cmd: Begin processing the 98th record. Run 1, Event 259, LumiSection 7818 on stream 2 at 25-May-2021 02:18:35.454 EDT >> cmd: Begin processing the 99th record. Run 1, Event 260, LumiSection 7818 on stream 0 at 25-May-2021 02:18:38.438 EDT >> cmd: Begin processing the 100th record. Run 1, Event 261, LumiSection 7818 on stream 1 at 25-May-2021 02:18:47.399 EDT >> cmd: Begin processing the 101st record. Run 1, Event 267, LumiSection 7818 on stream 4 at 25-May-2021 02:19:05.696 EDT >> cmd: Begin processing the 102nd record. Run 1, Event 269, LumiSection 7818 on stream 3 at 25-May-2021 02:19:05.749 EDT >> cmd: Begin processing the 103rd record. Run 1, Event 271, LumiSection 7818 on stream 5 at 25-May-2021 02:19:09.072 EDT >> cmd: Begin processing the 104th record. Run 1, Event 274, LumiSection 7818 on stream 2 at 25-May-2021 02:19:21.113 EDT >> cmd: Begin processing the 105th record. Run 1, Event 275, LumiSection 7818 on stream 1 at 25-May-2021 02:19:21.444 EDT >> cmd: Begin processing the 106th record. Run 1, Event 277, LumiSection 7818 on stream 0 at 25-May-2021 02:19:33.878 EDT >> cmd: Begin processing the 107th record. Run 1, Event 281, LumiSection 7818 on stream 5 at 25-May-2021 02:19:40.672 EDT >> cmd: Begin processing the 108th record. Run 1, Event 283, LumiSection 7818 on stream 3 at 25-May-2021 02:19:50.428 EDT >> cmd: Begin processing the 109th record. Run 1, Event 288, LumiSection 7818 on stream 1 at 25-May-2021 02:19:54.230 EDT >> cmd: Begin processing the 110th record. Run 1, Event 291, LumiSection 7818 on stream 2 at 25-May-2021 02:20:01.742 EDT >> cmd: Begin processing the 111th record. Run 1, Event 293, LumiSection 7818 on stream 5 at 25-May-2021 02:20:09.683 EDT >> cmd: Begin processing the 112th record. Run 1, Event 294, LumiSection 7818 on stream 4 at 25-May-2021 02:20:11.019 EDT >> cmd: Begin processing the 113th record. Run 1, Event 297, LumiSection 7818 on stream 0 at 25-May-2021 02:20:11.050 EDT >> cmd: Begin processing the 114th record. Run 1, Event 298, LumiSection 7818 on stream 3 at 25-May-2021 02:20:21.728 EDT >> cmd: Begin processing the 115th record. Run 1, Event 300, LumiSection 7818 on stream 1 at 25-May-2021 02:20:33.898 EDT >> cmd: Begin processing the 116th record. Run 1, Event 301, LumiSection 7818 on stream 2 at 25-May-2021 02:20:39.022 EDT >> cmd: Begin processing the 117th record. Run 1, Event 302, LumiSection 7818 on stream 0 at 25-May-2021 02:20:41.030 EDT >> cmd: Begin processing the 118th record. Run 1, Event 303, LumiSection 7818 on stream 4 at 25-May-2021 02:20:44.987 EDT >> cmd: Begin processing the 119th record. Run 1, Event 305, LumiSection 7818 on stream 3 at 25-May-2021 02:20:57.517 EDT >> cmd: Begin processing the 120th record. Run 1, Event 306, LumiSection 7818 on stream 4 at 25-May-2021 02:21:06.832 EDT >> cmd: Begin processing the 121st record. Run 1, Event 311, LumiSection 7818 on stream 0 at 25-May-2021 02:21:09.653 EDT >> cmd: Begin processing the 122nd record. Run 1, Event 314, LumiSection 7818 on stream 1 at 25-May-2021 02:21:13.767 EDT >> cmd: Begin processing the 123rd record. Run 1, Event 319, LumiSection 7818 on stream 2 at 25-May-2021 02:21:17.245 EDT >> cmd: Begin processing the 124th record. Run 1, Event 322, LumiSection 7818 on stream 5 at 25-May-2021 02:21:32.944 EDT >> cmd: Begin processing the 125th record. Run 1, Event 323, LumiSection 7818 on stream 3 at 25-May-2021 02:21:40.400 EDT >> cmd: Begin processing the 126th record. Run 1, Event 326, LumiSection 7818 on stream 0 at 25-May-2021 02:21:50.810 EDT >> cmd: Begin processing the 127th record. Run 1, Event 329, LumiSection 7818 on stream 1 at 25-May-2021 02:21:51.948 EDT >> cmd: Begin processing the 128th record. Run 1, Event 330, LumiSection 7818 on stream 0 at 25-May-2021 02:22:17.270 EDT >> cmd: Begin processing the 129th record. Run 1, Event 332, LumiSection 7818 on stream 4 at 25-May-2021 02:22:19.821 EDT >> cmd: Begin processing the 130th record. Run 1, Event 333, LumiSection 7818 on stream 5 at 25-May-2021 02:22:22.327 EDT >> cmd: Begin processing the 131st record. Run 1, Event 334, LumiSection 7818 on stream 3 at 25-May-2021 02:22:26.000 EDT >> cmd: Begin processing the 132nd record. Run 1, Event 340, LumiSection 7818 on stream 1 at 25-May-2021 02:22:26.505 EDT >> cmd: Begin processing the 133rd record. Run 1, Event 345, LumiSection 7818 on stream 2 at 25-May-2021 02:22:34.383 EDT >> cmd: Begin processing the 134th record. Run 1, Event 349, LumiSection 7818 on stream 0 at 25-May-2021 02:22:48.452 EDT >> cmd: Begin processing the 135th record. Run 1, Event 356, LumiSection 7818 on stream 2 at 25-May-2021 02:22:51.431 EDT >> cmd: Begin processing the 136th record. Run 1, Event 359, LumiSection 7818 on stream 4 at 25-May-2021 02:23:03.139 EDT >> cmd: Begin processing the 137th record. Run 1, Event 361, LumiSection 7818 on stream 3 at 25-May-2021 02:23:12.564 EDT >> cmd: Begin processing the 138th record. Run 1, Event 366, LumiSection 7818 on stream 2 at 25-May-2021 02:23:12.922 EDT >> cmd: Begin processing the 139th record. Run 1, Event 368, LumiSection 7818 on stream 5 at 25-May-2021 02:23:14.713 EDT >> cmd: Begin processing the 140th record. Run 1, Event 375, LumiSection 7818 on stream 0 at 25-May-2021 02:23:30.714 EDT >> cmd: Begin processing the 141st record. Run 1, Event 376, LumiSection 7818 on stream 4 at 25-May-2021 02:23:32.408 EDT >> cmd: Begin processing the 142nd record. Run 1, Event 382, LumiSection 7818 on stream 5 at 25-May-2021 02:23:38.247 EDT >> cmd: Begin processing the 143rd record. Run 1, Event 383, LumiSection 7818 on stream 1 at 25-May-2021 02:23:38.575 EDT >> cmd: Begin processing the 144th record. Run 1, Event 384, LumiSection 7818 on stream 3 at 25-May-2021 02:23:39.347 EDT >> cmd: Begin processing the 145th record. Run 1, Event 385, LumiSection 7818 on stream 2 at 25-May-2021 02:23:44.017 EDT >> cmd: [2021-05-25 02:23:44.484522 -0400][Error ][XRootD ] [deepthought.crc.nd.edu:1094] Unable to get the response to request kXR_open (file: /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/gen_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/GEN-00000_170544.root?tried=primeradiant04.crc.nd.edu, mode: 0660, flags: kXR_open_read kXR_async kXR_retstat ) >> cmd: Begin processing the 146th record. Run 1, Event 395, LumiSection 7818 on stream 1 at 25-May-2021 02:23:57.822 EDT >> cmd: Begin processing the 147th record. Run 1, Event 399, LumiSection 7818 on stream 4 at 25-May-2021 02:24:08.519 EDT >> cmd: Begin processing the 148th record. Run 1, Event 401, LumiSection 7818 on stream 0 at 25-May-2021 02:24:08.603 EDT >> cmd: Begin processing the 149th record. Run 1, Event 403, LumiSection 7818 on stream 3 at 25-May-2021 02:24:16.464 EDT >> cmd: Begin processing the 150th record. Run 1, Event 404, LumiSection 7818 on stream 1 at 25-May-2021 02:24:21.989 EDT >> cmd: Begin processing the 151st record. Run 1, Event 408, LumiSection 7818 on stream 5 at 25-May-2021 02:24:24.334 EDT >> cmd: Begin processing the 152nd record. Run 1, Event 409, LumiSection 7818 on stream 2 at 25-May-2021 02:24:37.229 EDT >> cmd: Begin processing the 153rd record. Run 1, Event 414, LumiSection 7818 on stream 4 at 25-May-2021 02:24:43.276 EDT >> cmd: Begin processing the 154th record. Run 1, Event 415, LumiSection 7818 on stream 0 at 25-May-2021 02:24:48.045 EDT >> cmd: Begin processing the 155th record. Run 1, Event 436, LumiSection 7818 on stream 4 at 25-May-2021 02:25:00.421 EDT >> cmd: Begin processing the 156th record. Run 1, Event 439, LumiSection 7818 on stream 1 at 25-May-2021 02:25:08.692 EDT >> cmd: Begin processing the 157th record. Run 1, Event 440, LumiSection 7818 on stream 5 at 25-May-2021 02:25:08.856 EDT >> cmd: Begin processing the 158th record. Run 1, Event 441, LumiSection 7818 on stream 0 at 25-May-2021 02:25:09.988 EDT >> cmd: Begin processing the 159th record. Run 1, Event 446, LumiSection 7818 on stream 2 at 25-May-2021 02:25:19.992 EDT >> cmd: Begin processing the 160th record. Run 1, Event 448, LumiSection 7818 on stream 3 at 25-May-2021 02:25:23.609 EDT >> cmd: Begin processing the 161st record. Run 1, Event 450, LumiSection 7818 on stream 5 at 25-May-2021 02:25:29.660 EDT >> cmd: Begin processing the 162nd record. Run 1, Event 451, LumiSection 7818 on stream 1 at 25-May-2021 02:25:36.433 EDT >> cmd: Begin processing the 163rd record. Run 1, Event 456, LumiSection 7818 on stream 0 at 25-May-2021 02:25:47.790 EDT >> cmd: Begin processing the 164th record. Run 1, Event 458, LumiSection 7818 on stream 4 at 25-May-2021 02:25:58.614 EDT >> cmd: Begin processing the 165th record. Run 1, Event 468, LumiSection 7818 on stream 1 at 25-May-2021 02:26:06.005 EDT >> cmd: Begin processing the 166th record. Run 1, Event 470, LumiSection 7818 on stream 3 at 25-May-2021 02:26:10.070 EDT >> cmd: Begin processing the 167th record. Run 1, Event 471, LumiSection 7818 on stream 2 at 25-May-2021 02:26:10.565 EDT >> cmd: Begin processing the 168th record. Run 1, Event 476, LumiSection 7818 on stream 5 at 25-May-2021 02:26:15.518 EDT >> cmd: Begin processing the 169th record. Run 1, Event 479, LumiSection 7818 on stream 0 at 25-May-2021 02:26:19.591 EDT >> cmd: Begin processing the 170th record. Run 1, Event 480, LumiSection 7818 on stream 1 at 25-May-2021 02:26:32.589 EDT >> cmd: Begin processing the 171st record. Run 1, Event 482, LumiSection 7818 on stream 3 at 25-May-2021 02:26:35.129 EDT >> cmd: Begin processing the 172nd record. Run 1, Event 486, LumiSection 7818 on stream 4 at 25-May-2021 02:26:35.329 EDT >> cmd: Begin processing the 173rd record. Run 1, Event 489, LumiSection 7818 on stream 2 at 25-May-2021 02:27:03.362 EDT >> cmd: Begin processing the 174th record. Run 1, Event 492, LumiSection 7818 on stream 0 at 25-May-2021 02:27:04.993 EDT >> cmd: Begin processing the 175th record. Run 1, Event 493, LumiSection 7818 on stream 5 at 25-May-2021 02:27:10.678 EDT >> cmd: Begin processing the 176th record. Run 1, Event 495, LumiSection 7818 on stream 3 at 25-May-2021 02:27:14.086 EDT >> cmd: Begin processing the 177th record. Run 1, Event 496, LumiSection 7818 on stream 4 at 25-May-2021 02:27:15.877 EDT >> cmd: Begin processing the 178th record. Run 1, Event 498, LumiSection 7818 on stream 0 at 25-May-2021 02:27:22.549 EDT >> cmd: 25-May-2021 02:28:24 EDT Closed file root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/gen_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/GEN-00000_170544.root >> cmd: >> cmd: TrigReport ---------- Event Summary ------------ >> cmd: TrigReport Events total = 178 passed = 178 failed = 0 >> cmd: >> cmd: TrigReport ---------- Path Summary ------------ >> cmd: TrigReport Trig Bit# Executed Passed Failed Error Name >> cmd: >> cmd: TrigReport -------End-Path Summary ------------ >> cmd: TrigReport Trig Bit# Executed Passed Failed Error Name >> cmd: TrigReport 0 1 178 178 0 0 RAWSIMoutput_step >> cmd: >> cmd: TrigReport ------ Modules in End-Path: RAWSIMoutput_step ------------ >> cmd: TrigReport Trig Bit# Visited Passed Failed Error Name >> cmd: TrigReport 0 0 178 178 0 0 RAWSIMoutput >> cmd: >> cmd: TrigReport ---------- Module Summary ------------ >> cmd: TrigReport Visited Executed Passed Failed Error Name >> cmd: TrigReport 0 0 0 0 0 MEtoEDMConverter >> cmd: TrigReport 178 178 178 0 0 RAWSIMoutput >> cmd: TrigReport 178 178 178 0 0 RAWSIMoutput_step >> cmd: TrigReport 178 178 178 0 0 TriggerResults >> cmd: TrigReport 178 178 178 0 0 endjob_step >> cmd: TrigReport 8544 178 178 0 0 g4SimHits >> cmd: TrigReport 178 178 178 0 0 randomEngineStateProducer >> cmd: TrigReport 178 178 178 0 0 simulation_step >> cmd: >> cmd: TimeReport ---------- Event Summary ---[sec]---- >> cmd: TimeReport event loop CPU/event = 0.406976 >> cmd: TimeReport event loop Real/event = 7.041427 >> cmd: TimeReport sum Streams Real/event = 39.290084 >> cmd: TimeReport efficiency CPU/Real/thread = 0.009633 >> cmd: >> cmd: TimeReport ---------- Path Summary ---[Real sec]---- >> cmd: TimeReport per event per exec Name >> cmd: TimeReport 0.000000 0.000000 simulation_step >> cmd: TimeReport per event per exec Name >> cmd: >> cmd: TimeReport -------End-Path Summary ---[Real sec]---- >> cmd: TimeReport per event per exec Name >> cmd: TimeReport 0.000000 0.000000 endjob_step >> cmd: TimeReport 39.288051 39.288051 RAWSIMoutput_step >> cmd: TimeReport per event per exec Name >> cmd: >> cmd: TimeReport ---------- Modules in Path: simulation_step ---[Real sec]---- >> cmd: TimeReport per event per visit Name >> cmd: TimeReport per event per visit Name >> cmd: >> cmd: TimeReport ------ Modules in End-Path: endjob_step ---[Real sec]---- >> cmd: TimeReport per event per visit Name >> cmd: >> cmd: TimeReport ------ Modules in End-Path: RAWSIMoutput_step ---[Real sec]---- >> cmd: TimeReport per event per visit Name >> cmd: TimeReport 0.247554 0.247554 RAWSIMoutput >> cmd: TimeReport per event per visit Name >> cmd: >> cmd: TimeReport ---------- Module Summary ---[Real sec]---- >> cmd: TimeReport per event per exec per visit Name >> cmd: TimeReport 0.000000 0.000000 0.000000 MEtoEDMConverter >> cmd: TimeReport 0.247554 0.247554 0.247554 RAWSIMoutput >> cmd: TimeReport 0.000013 0.000013 0.000013 RAWSIMoutput_step >> cmd: TimeReport 0.000006 0.000006 0.000006 TriggerResults >> cmd: TimeReport 0.000002 0.000002 0.000002 endjob_step >> cmd: TimeReport 38.994221 38.994221 38.994221 g4SimHits >> cmd: TimeReport 0.000013 0.000013 0.000013 randomEngineStateProducer >> cmd: TimeReport 0.000010 0.000010 0.000010 simulation_step >> cmd: TimeReport per event per exec per visit Name >> cmd: >> cmd: T---Report end! >> cmd: >> cmd: TimeReport> Time report complete in 1280.58 seconds >> cmd: Time Summary: >> cmd: - Min event: 14.1603 >> cmd: - Max event: 83.259 >> cmd: - Avg event: 39.2881 >> cmd: - Total loop: 1252.86 >> cmd: - Total init: 27.1759 >> cmd: - Total job: 1280.58 >> cmd: - EventSetup Lock: 1.00136e-05 >> cmd: - EventSetup Get: 22.025 >> cmd: Event Throughput: 0.142074 ev/s >> cmd: CPU Summary: >> cmd: - Total loop: 7018.37 >> cmd: - Total init: 5.79905 >> cmd: - Total extra: 0 >> cmd: - Total job: 7025.83 >> cmd: Processing Summary: >> cmd: - Number of Events: 178 >> cmd: - Number of Global Begin Lumi Calls: 1 >> cmd: - Number of Global Begin Run Calls: 1 >> cmd: >> cmd: >> cmd: ============================================= >> cmd: >> cmd: MessageLogger Summary >> cmd: >> cmd: type category sev module subroutine count total >> cmd: ---- -------------------- -- ---------------- ---------------- ----- ----- >> cmd: 1 TimeReport -e AfterModEndJob 1 1 >> cmd: 2 fileAction -s file_close 1 1 >> cmd: 3 fileAction -s file_open 2 2 >> cmd: >> cmd: type category Examples: run/evt run/evt run/evt >> cmd: ---- -------------------- ---------------- ---------------- ---------------- >> cmd: 1 TimeReport End Run: 1 >> cmd: 2 fileAction End Run: 1 >> cmd: 3 fileAction pre-events pre-events >> cmd: >> cmd: Severity # Occurrences Total Occurrences >> cmd: -------- ------------- ----------------- >> cmd: Error 1 1 >> cmd: System 3 3 >> cmd: >> cmd: dropped waiting message count 0 >>> executable returned with exit code 0. @ Tue May 25 02:28:25 2021 >>> executing 'timeout 300 hdfs dfs -fs hdfs://eddie.crc.nd.edu:19000 -put SIM-00000.root /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/sim_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_424470.root' @ Tue May 25 02:28:34 2021 >> using /disk/vc3-root/tmp/worker-230547-26750/t.424470/cctools-temp-t.424470.MoQLsT/tmpd0hT26 to store command output >> cmd: timeout: failed to run command 'hdfs': No such file or directory >>> Checking output file transfer. @ Tue May 25 02:28:34 2021 >>> executing 'env XRD_LOGLEVEL=Debug xrdcp SIM-00000.root root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/sim_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_424470.root' @ Tue May 25 02:28:34 2021 >> using /disk/vc3-root/tmp/worker-230547-26750/t.424470/cctools-temp-t.424470.MoQLsT/tmpNeV6KK to store command output >> cmd: [2021-05-25 02:28:35.097168 -0400][Warning][Utility ] Unable to process global config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 02:28:35.099467 -0400][Debug ][Utility ] Unable to process user config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 02:28:35.099847 -0400][Debug ][PlugInMgr ] Initializing plug-in manager... >> cmd: [2021-05-25 02:28:35.099970 -0400][Debug ][PlugInMgr ] No default plug-in, loading plug-in configs... >> cmd: [2021-05-25 02:28:35.100074 -0400][Debug ][PlugInMgr ] Processing plug-in definitions in /etc/xrootd/client.plugins.d... >> cmd: [2021-05-25 02:28:35.100243 -0400][Debug ][PlugInMgr ] Unable to process directory /etc/xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 02:28:35.101011 -0400][Debug ][PlugInMgr ] Processing plug-in definitions in /tmp/runos_singularity_home-220123464960721214200475588710455738022/.xrootd/client.plugins.d... >> cmd: [2021-05-25 02:28:35.101220 -0400][Debug ][PlugInMgr ] Unable to process directory /tmp/runos_singularity_home-220123464960721214200475588710455738022/.xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 02:28:35.101715 -0400][Debug ][Poller ] Available pollers: built-in >> cmd: [2021-05-25 02:28:35.101805 -0400][Debug ][Poller ] Attempting to create a poller according to preference: built-in >> cmd: [2021-05-25 02:28:35.101886 -0400][Debug ][Poller ] Creating poller: built-in >> cmd: [2021-05-25 02:28:35.101974 -0400][Debug ][Poller ] Creating and starting the built-in poller... >> cmd: [2021-05-25 02:28:35.102597 -0400][Debug ][Poller ] Using 1 poller threads >> cmd: [2021-05-25 02:28:35.102678 -0400][Debug ][TaskMgr ] Starting the task manager... >> cmd: [2021-05-25 02:28:35.102903 -0400][Debug ][TaskMgr ] Task manager started >> cmd: [2021-05-25 02:28:35.103002 -0400][Debug ][JobMgr ] Starting the job manager... >> cmd: [2021-05-25 02:28:35.103521 -0400][Debug ][JobMgr ] Job manager started, 3 workers >> cmd: [2021-05-25 02:28:35.103618 -0400][Debug ][TaskMgr ] Registering task: "FileTimer task" to be run at: [2021-05-25 02:28:35 -0400] >> cmd: [2021-05-25 02:28:35.103748 -0400][Debug ][PostMaster ] Creating new channel to: deepthought.crc.nd.edu:1094 1 stream(s) >> cmd: [2021-05-25 02:28:35.103855 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-05-25 02:28:35.105260 -0400][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" to be run at: [2021-05-25 02:28:50 -0400] >> cmd: [2021-05-25 02:28:35.107343 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 02:28:35.107597 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 02:28:35.107756 -0400][Debug ][Poller ] Adding socket 0xc95060 to the poller >> cmd: [2021-05-25 02:30:42.389403 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2021-05-25 02:30:42.389686 -0400][Error ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Unable to connect: Connection timed out >> cmd: [2021-05-25 02:30:42.389777 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-05-25 02:30:42.389876 -0400][Debug ][Poller ] <--> Removing socket from the poller >> cmd: [2021-05-25 02:30:42.390136 -0400][Error ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] elapsed = 127, pConnectionWindow = 120 seconds. >> cmd: [2021-05-25 02:30:42.392375 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 02:30:42.392623 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 02:30:42.392777 -0400][Debug ][Poller ] Adding socket 0xc95060 to the poller >> cmd: [2021-05-25 02:32:49.621095 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2021-05-25 02:32:49.621326 -0400][Error ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Unable to connect: Connection timed out >> cmd: [2021-05-25 02:32:49.621379 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-05-25 02:32:49.621428 -0400][Debug ][Poller ] <--> Removing socket from the poller >> cmd: [2021-05-25 02:32:49.621560 -0400][Error ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] elapsed = 127, pConnectionWindow = 120 seconds. >> cmd: [2021-05-25 02:32:49.622730 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 02:32:49.622872 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 02:32:49.622962 -0400][Debug ][Poller ] Adding socket 0xc95060 to the poller >> cmd: [2021-05-25 02:34:50.158471 -0400][Error ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Socket error while handshaking: [ERROR] Socket timeout >> cmd: [2021-05-25 02:34:50.158643 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-05-25 02:34:50.158713 -0400][Debug ][Poller ] <--> Removing socket from the poller >> cmd: [2021-05-25 02:34:50.158857 -0400][Error ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] elapsed = 121, pConnectionWindow = 120 seconds. >> cmd: [2021-05-25 02:34:50.160187 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 02:34:50.160364 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 02:34:50.160472 -0400][Debug ][Poller ] Adding socket 0xc95060 to the poller >> cmd: [2021-05-25 02:36:57.429092 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2021-05-25 02:36:57.429306 -0400][Error ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Unable to connect: Connection timed out >> cmd: [2021-05-25 02:36:57.429362 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-05-25 02:36:57.429410 -0400][Debug ][Poller ] <--> Removing socket from the poller >> cmd: [2021-05-25 02:36:57.429539 -0400][Error ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] elapsed = 127, pConnectionWindow = 120 seconds. >> cmd: [2021-05-25 02:36:57.430900 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 02:36:57.431051 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 02:36:57.431155 -0400][Debug ][Poller ] Adding socket 0xc95060 to the poller >> cmd: [2021-05-25 02:39:04.661156 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2021-05-25 02:39:04.661393 -0400][Error ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Unable to connect: Connection timed out >> cmd: [2021-05-25 02:39:04.661448 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-05-25 02:39:04.661499 -0400][Debug ][Poller ] <--> Removing socket from the poller >> cmd: [2021-05-25 02:39:04.661630 -0400][Error ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] elapsed = 127, pConnectionWindow = 120 seconds. >> cmd: [2021-05-25 02:39:04.661683 -0400][Error ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Unable to recover: [ERROR] Connection error. >> cmd: [2021-05-25 02:39:04.661739 -0400][Error ][XRootD ] [deepthought.crc.nd.edu:1094] Impossible to send message kXR_stat (path: /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/sim_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_424470.root, flags: none). Trying to recover. >> cmd: [2021-05-25 02:39:04.661806 -0400][Debug ][XRootD ] [deepthought.crc.nd.edu:1094] Handling error while processing kXR_stat (path: /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/sim_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_424470.root, flags: none): [FATAL] Connection error. >> cmd: [2021-05-25 02:39:04.662345 -0400][Debug ][Utility ] CopyProcess: 2 jobs to prepare >> cmd: [2021-05-25 02:39:04.662470 -0400][Error ][XRootD ] [deepthought.crc.nd.edu:1094] Unable to send the message kXR_stat (path: /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/sim_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_424470.root, flags: none): [FATAL] Connection error >> cmd: Prepare: [FATAL] Connection error >> cmd: [2021-05-25 02:39:04.697546 -0400][Debug ][JobMgr ] Stopping the job manager... >> cmd: [2021-05-25 02:39:04.698460 -0400][Debug ][JobMgr ] Job manager stopped >> cmd: [2021-05-25 02:39:04.698543 -0400][Debug ][TaskMgr ] Stopping the task manager... >> cmd: [2021-05-25 02:39:04.698824 -0400][Debug ][TaskMgr ] Task manager stopped >> cmd: [2021-05-25 02:39:04.698881 -0400][Debug ][Poller ] Stopping the poller... >> cmd: [2021-05-25 02:39:04.699190 -0400][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" >> cmd: [2021-05-25 02:39:04.699256 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-05-25 02:39:04.699307 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Destroying stream >> cmd: [2021-05-25 02:39:04.699356 -0400][Debug ][Utility ] Monitor library name not set. No monitoring >> cmd: [2021-05-25 02:39:04.699402 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >>> Checking output file transfer. @ Tue May 25 02:39:04 2021 >>> executing '/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin/gfal-copy -f file:///disk/vc3-root/tmp/worker-230547-26750/t.424470/SIM-00000.root gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/sim_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_424470.root' @ Tue May 25 02:39:04 2021 >> using /disk/vc3-root/tmp/worker-230547-26750/t.424470/cctools-temp-t.424470.MoQLsT/tmpjo5b7T to store command output >> cmd: gfal-copy error: 70 (Communication error on send) - globus_xio: Unable to connect to deepthought.crc.nd.edu:2811 globus_xio: System error in connect: Connection timed out globus_xio: A system call failed: Connection timed out >> cmd: Copying 193335313 bytes file:///disk/vc3-root/tmp/worker-230547-26750/t.424470/SIM-00000.root => gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/sim_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_424470.root >>> Checking output file transfer. @ Tue May 25 02:45:27 2021 >>> executing '/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin/gfal-copy -f file:///disk/vc3-root/tmp/worker-230547-26750/t.424470/SIM-00000.root gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/sim_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_424470.root' @ Tue May 25 02:45:27 2021 >> using /disk/vc3-root/tmp/worker-230547-26750/t.424470/cctools-temp-t.424470.MoQLsT/tmpwtRbzZ to store command output >> cmd: gfal-copy error: 70 (Communication error on send) - globus_xio: Unable to connect to deepthought.crc.nd.edu:2811 globus_xio: System error in connect: Connection timed out globus_xio: A system call failed: Connection timed out >> cmd: Copying 193335313 bytes file:///disk/vc3-root/tmp/worker-230547-26750/t.424470/SIM-00000.root => gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/sim_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/SIM-00000_424470.root >>> Checking output file transfer. @ Tue May 25 02:51:49 2021 >> trace: Traceback (most recent call last): >> trace: File "task.py", line 268, in wrapper >> trace: result = fct(data, *args, **kwargs) >> trace: File "task.py", line 821, in copy_outputs >> trace: raise RuntimeError("no stage-out method succeeded") >> trace: RuntimeError: no stage-out method succeeded >>>>> call to 'copy_outputs' failed, exiting with exit code 210 @ Tue May 25 02:51:49 2021 Tue May 25 02:07:01 2021: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Tue May 25 02:07:02 2021: ApMon[WARNING]: Not sending parameters since no destination is defined. Tue May 25 02:07:02 2021: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. Tue May 25 02:28:25 2021: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Tue May 25 02:28:25 2021: ApMon[WARNING]: Not sending parameters since no destination is defined. Tue May 25 02:28:25 2021: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. >> Execution time 2767 >> Exiting with code 210 >> Reporting ExeExitCode 0 >> Reporting StageOutSE >> Reporting StageOutExitCode 210 Tue May 25 02:51:49 2021: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Tue May 25 02:51:50 2021: ApMon[WARNING]: Not sending parameters since no destination is defined. Tue May 25 02:51:50 2021: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. ==== working directory after execution @ Tue May 25 02:51:50 EDT 2021 ==== == dir: total 189712 == dir: drwxr-xr-x 18 kmohrman campus 215 May 25 02:05 CMSSW_10_6_17_patch1 == dir: -rw-r--r-- 1 kmohrman campus 193335313 May 25 02:28 SIM-00000.root == dir: -rw-r--r-- 2 kmohrman campus 3827 May 25 01:07 UL18_SIM_cfg.py == dir: -rw-r--r-- 1 kmohrman campus 5315 May 25 02:07 UL18_SIM_cfg_mod.py == dir: drwxr-xr-x 2 kmohrman campus 71 May 25 02:04 bin == dir: -rwxr-xr-x 5 kmohrman campus 627272 May 25 00:13 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 May 25 02:04 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 May 25 02:51 cctools-temp-t.424470.MoQLsT == dir: -rw------- 1 kmohrman campus 51 May 25 02:05 cvmfschecksum.cms-ib.cern.ch == dir: -rw------- 1 kmohrman campus 51 May 25 02:05 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 May 25 02:05 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 May 25 02:04 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 May 25 02:04 librmonitor_helper.so.q8lXpj == dir: -rw-r--r-- 2 kmohrman campus 2072 May 25 02:04 parameters.json == dir: -rw------- 2 kmohrman campus 9917 May 25 02:04 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 May 25 02:04 python == dir: -rw-r--r-- 1 kmohrman campus 1241 May 25 02:51 report.json == dir: -rw-r--r-- 5 kmohrman campus 570 May 25 00:13 report.json.in == dir: -rw-r--r-- 1 kmohrman campus 22787 May 25 02:28 report.xml == dir: -rw-r--r-- 1 kmohrman campus 3005 May 25 02:51 report.xml.gz == dir: -rw-r--r-- 2 kmohrman campus 593 May 25 00:13 sandbox-CMSSW_10_6_17_patch1-slc7_amd64_gcc700.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 37 May 25 02:04 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 May 25 02:05 t_wrapper_ready == dir: -rw-r--r-- 1 kmohrman campus 11 May 25 02:05 t_wrapper_start == dir: -rwxr-xr-x 5 kmohrman campus 47217 May 25 00:13 task.py == dir: -rwxr-xr-x 5 kmohrman campus 5986 May 25 00:13 wrapper.sh === wrapper done @ Tue May 25 02:51:50 EDT 2021 === final return status = 210 @ Tue May 25 02:51:50 EDT 2021