==== wrapper started @ Tue May 25 01:56:15 EDT 2021 ==== == startup: hostname: d12chas348.crc.nd.edu == startup: kernel: Linux d12chas348.crc.nd.edu 3.10.0-1160.el7.x86_64 #1 SMP Tue Aug 18 14:50:17 EDT 2020 x86_64 x86_64 x86_64 GNU/Linux ==== tracing google @ Tue May 25 01:56:20 EDT 2021 ==== wrapper.sh: line 20: traceroute: command not found ==== environment at startup @ Tue May 25 01:56:25 EDT 2021 ==== == env: VC3_VERSION_SED=4.2 == env: CCTOOLS_RESOURCE_PROCESS_START=1621922185921355 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: VC3_ROOT_GZIP=/usr/ == env: SHELL=/bin/sh == env: TERM=xterm-256color == env: MAKEFLAGS=-j4 == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-6660/t.425221/cctools-temp-t.425221.4PhZhS == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-6660/t.425221/librmonitor_helper.so.LqxmwG == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_20 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: USER=kmohrman == env: TEMP=/disk/vc3-root/tmp/worker-230547-6660/t.425221/cctools-temp-t.425221.4PhZhS == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: LD_LIBRARY_PATH=/.singularity.d/libs == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_ROOT_MAKE=/usr/ == env: VC3_DISTFILES=/disk/vc3-distfiles == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-6660/cache/tmp == env: VC3_VERSION_TAR=1.26 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-UFzuT1 == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: VC3_VERSION_GZIP=1.5 == env: VC3_ENV_TAG_GLOBAL=6407 == env: PATH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-UFzuT1 == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PWD=/disk/vc3-root/tmp/worker-230547-6660/t.425221 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_FULL_SED=4.2.2 == env: VC3_VERSION_WHICH=2.20 == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-6660 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_ROOT_SED=/usr/ == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: CXX=g++ == env: SHLVL=3 == env: HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_MAKE=3.82 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: DISK=300 == env: MEMORY=1000 == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: TMP=/disk/vc3-root/tmp/worker-230547-6660/t.425221/cctools-temp-t.425221.4PhZhS == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_VERSION_PKG_CONFIG=0.27 == env: VC3_ROOT_TAR=/usr/ == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-UFzuT1.wrapper == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: CC=gcc == env: CORES=1 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CCTOOLS_RESOURCE_MONITOR_INFO=1029 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_CRC_b3_postLHE.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=27072 == env: _=/usr/bin/env ==== cpu info @ Tue May 25 01:56:30 EDT 2021 ==== == cpu: processor : 0 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 2899.932 == cpu: cache size : 15360 KB == cpu: physical id : 0 == cpu: siblings : 12 == cpu: core id : 0 == cpu: cpu cores : 12 == cpu: apicid : 0 == cpu: initial apicid : 0 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4999.56 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 1 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 2500.000 == cpu: cache size : 15360 KB == cpu: physical id : 0 == cpu: siblings : 12 == cpu: core id : 1 == cpu: cpu cores : 12 == cpu: apicid : 2 == cpu: initial apicid : 2 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4999.56 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 2 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 1299.743 == cpu: cache size : 15360 KB == cpu: physical id : 0 == cpu: siblings : 12 == cpu: core id : 2 == cpu: cpu cores : 12 == cpu: apicid : 4 == cpu: initial apicid : 4 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4999.56 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 3 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 1199.951 == cpu: cache size : 15360 KB == cpu: physical id : 0 == cpu: siblings : 12 == cpu: core id : 3 == cpu: cpu cores : 12 == cpu: apicid : 6 == cpu: initial apicid : 6 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4999.56 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 4 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 1199.951 == cpu: cache size : 15360 KB == cpu: physical id : 0 == cpu: siblings : 12 == cpu: core id : 4 == cpu: cpu cores : 12 == cpu: apicid : 8 == cpu: initial apicid : 8 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4999.56 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 5 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 1200.256 == cpu: cache size : 15360 KB == cpu: physical id : 0 == cpu: siblings : 12 == cpu: core id : 5 == cpu: cpu cores : 12 == cpu: apicid : 10 == cpu: initial apicid : 10 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4999.56 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 6 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 1232.452 == cpu: cache size : 15360 KB == cpu: physical id : 0 == cpu: siblings : 12 == cpu: core id : 8 == cpu: cpu cores : 12 == cpu: apicid : 16 == cpu: initial apicid : 16 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4999.56 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 7 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 2910.461 == cpu: cache size : 15360 KB == cpu: physical id : 0 == cpu: siblings : 12 == cpu: core id : 9 == cpu: cpu cores : 12 == cpu: apicid : 18 == cpu: initial apicid : 18 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4999.56 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 8 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 2899.932 == cpu: cache size : 15360 KB == cpu: physical id : 0 == cpu: siblings : 12 == cpu: core id : 10 == cpu: cpu cores : 12 == cpu: apicid : 20 == cpu: initial apicid : 20 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4999.56 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 9 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 1492.614 == cpu: cache size : 15360 KB == cpu: physical id : 0 == cpu: siblings : 12 == cpu: core id : 11 == cpu: cpu cores : 12 == cpu: apicid : 22 == cpu: initial apicid : 22 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4999.56 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 10 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 1398.773 == cpu: cache size : 15360 KB == cpu: physical id : 0 == cpu: siblings : 12 == cpu: core id : 12 == cpu: cpu cores : 12 == cpu: apicid : 24 == cpu: initial apicid : 24 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4999.56 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 11 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 1199.798 == cpu: cache size : 15360 KB == cpu: physical id : 0 == cpu: siblings : 12 == cpu: core id : 13 == cpu: cpu cores : 12 == cpu: apicid : 26 == cpu: initial apicid : 26 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4999.56 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 12 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 2899.932 == cpu: cache size : 15360 KB == cpu: physical id : 1 == cpu: siblings : 12 == cpu: core id : 0 == cpu: cpu cores : 12 == cpu: apicid : 32 == cpu: initial apicid : 32 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5018.18 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 13 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 1897.430 == cpu: cache size : 15360 KB == cpu: physical id : 1 == cpu: siblings : 12 == cpu: core id : 1 == cpu: cpu cores : 12 == cpu: apicid : 34 == cpu: initial apicid : 34 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5018.18 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 14 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 1199.951 == cpu: cache size : 15360 KB == cpu: physical id : 1 == cpu: siblings : 12 == cpu: core id : 2 == cpu: cpu cores : 12 == cpu: apicid : 36 == cpu: initial apicid : 36 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5018.18 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 15 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 1199.951 == cpu: cache size : 15360 KB == cpu: physical id : 1 == cpu: siblings : 12 == cpu: core id : 3 == cpu: cpu cores : 12 == cpu: apicid : 38 == cpu: initial apicid : 38 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5018.18 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 16 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 1200.103 == cpu: cache size : 15360 KB == cpu: physical id : 1 == cpu: siblings : 12 == cpu: core id : 4 == cpu: cpu cores : 12 == cpu: apicid : 40 == cpu: initial apicid : 40 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5018.18 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 17 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 1199.951 == cpu: cache size : 15360 KB == cpu: physical id : 1 == cpu: siblings : 12 == cpu: core id : 5 == cpu: cpu cores : 12 == cpu: apicid : 42 == cpu: initial apicid : 42 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5018.18 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 18 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 2899.932 == cpu: cache size : 15360 KB == cpu: physical id : 1 == cpu: siblings : 12 == cpu: core id : 8 == cpu: cpu cores : 12 == cpu: apicid : 48 == cpu: initial apicid : 48 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5018.18 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 19 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 2899.932 == cpu: cache size : 15360 KB == cpu: physical id : 1 == cpu: siblings : 12 == cpu: core id : 9 == cpu: cpu cores : 12 == cpu: apicid : 50 == cpu: initial apicid : 50 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5018.18 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 20 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 2899.932 == cpu: cache size : 15360 KB == cpu: physical id : 1 == cpu: siblings : 12 == cpu: core id : 10 == cpu: cpu cores : 12 == cpu: apicid : 52 == cpu: initial apicid : 52 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5018.18 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 21 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 2899.932 == cpu: cache size : 15360 KB == cpu: physical id : 1 == cpu: siblings : 12 == cpu: core id : 11 == cpu: cpu cores : 12 == cpu: apicid : 54 == cpu: initial apicid : 54 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5018.18 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 22 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 1799.011 == cpu: cache size : 15360 KB == cpu: physical id : 1 == cpu: siblings : 12 == cpu: core id : 12 == cpu: cpu cores : 12 == cpu: apicid : 56 == cpu: initial apicid : 56 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5018.18 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 23 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 1696.166 == cpu: cache size : 15360 KB == cpu: physical id : 1 == cpu: siblings : 12 == cpu: core id : 13 == cpu: cpu cores : 12 == cpu: apicid : 58 == cpu: initial apicid : 58 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5018.18 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: === using CVMFS proxy: http://eddie.crc.nd.edu:3128 @ Tue May 25 01:57:01 EDT 2021 === using Frontier proxy: http://eddie.crc.nd.edu:3128 @ Tue May 25 01:57:01 EDT 2021 === parrot helper: /disk/vc3-root/tmp/worker-230547-6660/t.425221/lib/libparrot_helper.so @ Tue May 25 01:57:06 EDT 2021 ==== content of /disk/vc3-root/tmp/worker-230547-6660/cache/tmp @ Tue May 25 01:57:06 EDT 2021 ==== == cache: total 28 == cache: drwx------ 262 kmohrman campus 8192 May 25 01:50 ex_parrot_kmohrman == cache: -rw-r--r-- 1 kmohrman campus 10 May 24 21:12 hot_cache == cache: drwxr-x--- 260 kmohrman campus 8192 May 24 21:04 cvmfs === OSG certificate location: /cvmfs/oasis.opensciencegrid.org/mis/certificates @ Tue May 25 01:57:11 EDT 2021 === testing parrot usage @ Tue May 25 01:57:11 EDT 2021 === parrot OK @ Tue May 25 01:57:16 EDT 2021 === starting parrot to access CMSSW... @ Tue May 25 01:57:16 EDT 2021 ==== wrapper started @ Tue May 25 01:57:16 EDT 2021 ==== == startup: hostname: d12chas348.crc.nd.edu == startup: kernel: Linux d12chas348.crc.nd.edu 3.10.0-1160.el7.x86_64 #1 SMP Tue Aug 18 14:50:17 EDT 2020 x86_64 x86_64 x86_64 GNU/Linux ==== tracing google @ Tue May 25 01:57:16 EDT 2021 ==== wrapper.sh: line 20: traceroute: command not found ==== environment at startup @ Tue May 25 01:57:16 EDT 2021 ==== == env: VC3_VERSION_SED=4.2 == env: CCTOOLS_RESOURCE_PROCESS_START=1621922236486968 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/usr/ == env: LOBSTER_GFAL_COPY= == env: MAKEFLAGS=-j4 == env: PARROT_HELPER=/disk/vc3-root/tmp/worker-230547-6660/t.425221/lib/libparrot_helper.so == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-6660/t.425221/cctools-temp-t.425221.4PhZhS == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-6660/t.425221/librmonitor_helper.so.LqxmwG == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_20 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: LD_LIBRARY_PATH=/.singularity.d/libs:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-6660/t.425221/cctools-temp-t.425221.4PhZhS == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/usr/ == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-UFzuT1 == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-6660/cache/tmp == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: PARROT_CVMFS_REPO= == env: VC3_VERSION_GZIP=1.5 == env: PATH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ENV_TAG_GLOBAL=6407 == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-UFzuT1 == env: PWD=/disk/vc3-root/tmp/worker-230547-6660/t.425221 == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_WHICH=2.20 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: LOBSTER_LCG_CP= == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-6660 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/usr/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: CXX=g++ == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: DISK=300 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-6660/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-6660/cache/tmp/cvmfs == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=1000 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TMP=/disk/vc3-root/tmp/worker-230547-6660/t.425221/cctools-temp-t.425221.4PhZhS == env: PYTHONPATH=python: == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_ROOT_TAR=/usr/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-UFzuT1.wrapper == env: CC=gcc == env: CCTOOLS_RESOURCE_MONITOR_INFO=1029 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=1 == env: PARROT_DEBUG_FLAGS= == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_CRC_b3_postLHE.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=27072 == env: _=/usr/bin/env ==== cpu info @ Tue May 25 01:57:16 EDT 2021 ==== == cpu: processor : 0 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 2899.932 == cpu: cache size : 15360 KB == cpu: physical id : 0 == cpu: siblings : 12 == cpu: core id : 0 == cpu: cpu cores : 12 == cpu: apicid : 0 == cpu: initial apicid : 0 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4999.56 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 1 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 2899.932 == cpu: cache size : 15360 KB == cpu: physical id : 0 == cpu: siblings : 12 == cpu: core id : 1 == cpu: cpu cores : 12 == cpu: apicid : 2 == cpu: initial apicid : 2 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4999.56 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 2 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 1200.103 == cpu: cache size : 15360 KB == cpu: physical id : 0 == cpu: siblings : 12 == cpu: core id : 2 == cpu: cpu cores : 12 == cpu: apicid : 4 == cpu: initial apicid : 4 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4999.56 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 3 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 2499.847 == cpu: cache size : 15360 KB == cpu: physical id : 0 == cpu: siblings : 12 == cpu: core id : 3 == cpu: cpu cores : 12 == cpu: apicid : 6 == cpu: initial apicid : 6 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4999.56 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 4 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 1266.479 == cpu: cache size : 15360 KB == cpu: physical id : 0 == cpu: siblings : 12 == cpu: core id : 4 == cpu: cpu cores : 12 == cpu: apicid : 8 == cpu: initial apicid : 8 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4999.56 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 5 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 1880.950 == cpu: cache size : 15360 KB == cpu: physical id : 0 == cpu: siblings : 12 == cpu: core id : 5 == cpu: cpu cores : 12 == cpu: apicid : 10 == cpu: initial apicid : 10 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4999.56 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 6 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 2500.000 == cpu: cache size : 15360 KB == cpu: physical id : 0 == cpu: siblings : 12 == cpu: core id : 8 == cpu: cpu cores : 12 == cpu: apicid : 16 == cpu: initial apicid : 16 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4999.56 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 7 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 1300.201 == cpu: cache size : 15360 KB == cpu: physical id : 0 == cpu: siblings : 12 == cpu: core id : 9 == cpu: cpu cores : 12 == cpu: apicid : 18 == cpu: initial apicid : 18 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4999.56 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 8 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 2899.932 == cpu: cache size : 15360 KB == cpu: physical id : 0 == cpu: siblings : 12 == cpu: core id : 10 == cpu: cpu cores : 12 == cpu: apicid : 20 == cpu: initial apicid : 20 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4999.56 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 9 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 1399.993 == cpu: cache size : 15360 KB == cpu: physical id : 0 == cpu: siblings : 12 == cpu: core id : 11 == cpu: cpu cores : 12 == cpu: apicid : 22 == cpu: initial apicid : 22 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4999.56 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 10 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 2499.847 == cpu: cache size : 15360 KB == cpu: physical id : 0 == cpu: siblings : 12 == cpu: core id : 12 == cpu: cpu cores : 12 == cpu: apicid : 24 == cpu: initial apicid : 24 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4999.56 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 11 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 1254.730 == cpu: cache size : 15360 KB == cpu: physical id : 0 == cpu: siblings : 12 == cpu: core id : 13 == cpu: cpu cores : 12 == cpu: apicid : 26 == cpu: initial apicid : 26 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4999.56 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 12 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 2899.932 == cpu: cache size : 15360 KB == cpu: physical id : 1 == cpu: siblings : 12 == cpu: core id : 0 == cpu: cpu cores : 12 == cpu: apicid : 32 == cpu: initial apicid : 32 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5018.18 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 13 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 2299.194 == cpu: cache size : 15360 KB == cpu: physical id : 1 == cpu: siblings : 12 == cpu: core id : 1 == cpu: cpu cores : 12 == cpu: apicid : 34 == cpu: initial apicid : 34 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5018.18 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 14 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 1497.344 == cpu: cache size : 15360 KB == cpu: physical id : 1 == cpu: siblings : 12 == cpu: core id : 2 == cpu: cpu cores : 12 == cpu: apicid : 36 == cpu: initial apicid : 36 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5018.18 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 15 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 1199.951 == cpu: cache size : 15360 KB == cpu: physical id : 1 == cpu: siblings : 12 == cpu: core id : 3 == cpu: cpu cores : 12 == cpu: apicid : 38 == cpu: initial apicid : 38 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5018.18 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 16 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 1199.951 == cpu: cache size : 15360 KB == cpu: physical id : 1 == cpu: siblings : 12 == cpu: core id : 4 == cpu: cpu cores : 12 == cpu: apicid : 40 == cpu: initial apicid : 40 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5018.18 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 17 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 1199.493 == cpu: cache size : 15360 KB == cpu: physical id : 1 == cpu: siblings : 12 == cpu: core id : 5 == cpu: cpu cores : 12 == cpu: apicid : 42 == cpu: initial apicid : 42 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5018.18 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 18 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 2899.932 == cpu: cache size : 15360 KB == cpu: physical id : 1 == cpu: siblings : 12 == cpu: core id : 8 == cpu: cpu cores : 12 == cpu: apicid : 48 == cpu: initial apicid : 48 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5018.18 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 19 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 2899.932 == cpu: cache size : 15360 KB == cpu: physical id : 1 == cpu: siblings : 12 == cpu: core id : 9 == cpu: cpu cores : 12 == cpu: apicid : 50 == cpu: initial apicid : 50 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5018.18 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 20 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 1298.065 == cpu: cache size : 15360 KB == cpu: physical id : 1 == cpu: siblings : 12 == cpu: core id : 10 == cpu: cpu cores : 12 == cpu: apicid : 52 == cpu: initial apicid : 52 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5018.18 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 21 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 1285.858 == cpu: cache size : 15360 KB == cpu: physical id : 1 == cpu: siblings : 12 == cpu: core id : 11 == cpu: cpu cores : 12 == cpu: apicid : 54 == cpu: initial apicid : 54 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5018.18 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 22 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 1432.342 == cpu: cache size : 15360 KB == cpu: physical id : 1 == cpu: siblings : 12 == cpu: core id : 12 == cpu: cpu cores : 12 == cpu: apicid : 56 == cpu: initial apicid : 56 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5018.18 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 23 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 63 == cpu: model name : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz == cpu: stepping : 2 == cpu: microcode : 0x44 == cpu: cpu MHz : 1296.691 == cpu: cache size : 15360 KB == cpu: physical id : 1 == cpu: siblings : 12 == cpu: core id : 13 == cpu: cpu cores : 12 == cpu: apicid : 58 == cpu: initial apicid : 58 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 15 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 5018.18 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 46 bits physical, 48 bits virtual == cpu: power management: == cpu: === using parrot @ Tue May 25 01:57:18 EDT 2021 === sourcing CMS setup @ Tue May 25 01:57:18 EDT 2021 LibCvmfs version 2.4, revision 25 === sourcing OSG setup @ Tue May 25 01:57:20 EDT 2021 ==== environment after sourcing startup scripts @ Tue May 25 01:57:20 EDT 2021 ==== == env: VC3_VERSION_SED=4.2 == env: MANPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/man:/cvmfs/cms.cern.ch/share/man: == env: CCTOOLS_RESOURCE_PROCESS_START=1621922240094952 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: GFAL_PLUGIN_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/gfal2-plugins/ == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/usr/ == env: LOBSTER_GFAL_COPY=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin/gfal-copy == env: VOMS_USERCONF=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/vomses == env: MAKEFLAGS=-j4 == env: GLOBUS_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-6660/t.425221/cctools-temp-t.425221.4PhZhS == env: PERL5LIB=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5 == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: CVSROOT=:gserver:cmssw.cvs.cern.ch:/local/reps/CMSSW == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-6660/t.425221/librmonitor_helper.so.LqxmwG == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: X509_CERT_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/certificates == env: SCRAM_ARCH=slc7_amd64_gcc820 == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_20 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: LD_LIBRARY_PATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/dcap:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/lcgdm:/.singularity.d/libs:lib:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-6660/t.425221/cctools-temp-t.425221.4PhZhS == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/usr/ == env: OSG_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-UFzuT1 == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-6660/cache/tmp == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: SITECONFIG_PATH=/cvmfs/cms.cern.ch/SITECONF/local == env: PARROT_CVMFS_REPO= == env: VC3_VERSION_GZIP=1.5 == env: PATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/sbin:/cvmfs/cms.cern.ch/common:/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ENV_TAG_GLOBAL=6407 == env: CMS_PATH=/cvmfs/cms.cern.ch == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-UFzuT1 == env: PWD=/disk/vc3-root/tmp/worker-230547-6660/t.425221 == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_WHICH=2.20 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: X509_VOMS_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/vomsdir == env: LOBSTER_LCG_CP= == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-6660 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/usr/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: CXX=g++ == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: DISK=300 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-6660/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-6660/cache/tmp/cvmfs == env: GFAL_CONFIG_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/gfal2.d/ == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=1000 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TMP=/disk/vc3-root/tmp/worker-230547-6660/t.425221/cctools-temp-t.425221.4PhZhS == env: PYTHONPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib/python2.7/site-packages:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/python2.7/site-packages:python:python: == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_ROOT_TAR=/usr/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-UFzuT1.wrapper == env: CC=gcc == env: CCTOOLS_RESOURCE_MONITOR_INFO=1029 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=1 == env: PARROT_DEBUG_FLAGS= == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_CRC_b3_postLHE.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=27072 == env: _=/usr/bin/env ==== proxy information @ Tue May 25 01:57:20 EDT 2021 ==== == proxy: subject : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman/CN=661123957 == proxy: issuer : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman == proxy: identity : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman == proxy: type : RFC compliant proxy == proxy: strength : 1024 bits == proxy: path : proxy == proxy: timeleft : 150:51:59 ==== working directory at startup @ Tue May 25 01:57:20 EDT 2021 ==== == dir: total 876 == dir: -rwxr-xr-x 2 kmohrman campus 1576 May 25 01:56 0024_5241_report.json == dir: -rwxr-xr-x 2 kmohrman campus 1578 May 25 01:56 0025_2903_report.json == dir: -rwxr-xr-x 2 kmohrman campus 1570 May 25 01:56 0026_2402_report.json == dir: -rwxr-xr-x 2 kmohrman campus 1435 May 25 01:56 0042_3345_report.json == dir: drwxr-xr-x 2 kmohrman campus 71 May 25 01:56 bin == dir: -rwxr-xr-x 5 kmohrman campus 627272 May 24 21:03 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 May 25 01:56 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 May 25 01:56 cctools-temp-t.425221.4PhZhS == dir: -rw------- 1 kmohrman campus 51 May 25 01:57 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 May 25 01:57 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 May 25 01:56 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 May 25 01:56 librmonitor_helper.so.LqxmwG == dir: -rw-r--r-- 2 kmohrman campus 868 May 25 01:56 merge_cfg.py == dir: -rw-r--r-- 2 kmohrman campus 808 May 25 01:56 merge_reports.py == dir: -rw-r--r-- 2 kmohrman campus 2471 May 25 01:56 parameters.json == dir: -rw------- 2 kmohrman campus 9917 May 25 01:56 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 May 25 01:56 python == dir: -rw-r--r-- 5 kmohrman campus 570 May 24 21:03 report.json.in == dir: -rw-r--r-- 2 kmohrman campus 549 May 24 23:31 sandbox-CMSSW_10_6_20-slc7_amd64_gcc700.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 37 May 25 01:56 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 May 25 01:57 t_wrapper_start == dir: -rwxr-xr-x 5 kmohrman campus 47217 May 24 21:03 task.py == dir: -rwxr-xr-x 5 kmohrman campus 5986 May 24 21:03 wrapper.sh === creating new release CMSSW_10_6_20 for scram arch slc7_amd64_gcc700 @ Tue May 25 01:57:20 EDT 2021 WARNING: In non-interactive mode release checks e.g. deprecated releases, production architectures are disabled. === unpacking sandbox-CMSSW_10_6_20-slc7_amd64_gcc700.tar.bz2 @ Tue May 25 01:57:24 EDT 2021 ==== machine load @ Tue May 25 01:57:27 EDT 2021 ==== top: unknown option 'M' Usage: top -hv | -bcHiOSs -d secs -n max -u|U user -p pid(s) -o field -w [cols] ==== environment before execution @ Tue May 25 01:57:27 EDT 2021 ==== == env: G4LEVELGAMMADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4PhotonEvaporation/5.2/data/PhotonEvaporation5.2 == env: UTM_XSD_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj == env: SRT_G4LEVELGAMMADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4PhotonEvaporation/5.2/data/PhotonEvaporation5.2 == env: VC3_VERSION_SED=4.2 == env: CMSSW_RELEASE_BASE=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20 == env: SCRAMRT_SET=CMSSW:CMSSW_10_6_20:slc7_amd64_gcc700:V2_2_9_pre13:SRT_ == env: MANPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/man:/cvmfs/cms.cern.ch/share/man: == env: CCTOOLS_RESOURCE_PROCESS_START=1621922247307374 == env: CMSSW_FWLITE_INCLUDE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include == env: SRT_GCC_RUNTIME_ASAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: ROOT_INCLUDE_PATH=/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/include/LCG:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mctester/1.25.0a-pafccj9/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj6/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dd4hep/v01-10x-pafccj9/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtDesigner:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauolapp/1.1.5-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/charybdis/1.003-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj2/include/SHERPA-MC:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtOpenGL:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtGui:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwig/6.521-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt3Support:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lwtnn/2.4-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4/10.4.3-pafccj2/include/Geant4:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/classlib/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cgal/4.2-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tkonlinesw/4.2.0-1_gcc7-pafccj9/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/starlight/r193-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtCore:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtXml:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mcdb/1.0.3-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libungif/4.1.4-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libtiff/4.0.3-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/highfive/2.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libpng/1.6.16-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pcre/8.37-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/include/xrootd/private:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/vdt/0.4.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/toprex/4.23-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tbb/2019_U3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauola/27.121.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sigcpp/2.6.2-pafccj/include/sigc++-2.0:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sqlite/3.22.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/protobuf/3.5.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pacparser/1.3.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/oracle/12.1.0.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/py2-numpy/1.16.2-nmpfii2/c-api/core/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/meschach/1.2.pCMS1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lz4/1.9.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libuuid/2.22.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libunwind/1.2.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libhepml/0.2.1-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ktjet/1.06-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jimmy/4.2-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jemalloc/5.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hls/2019.08/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj12:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hector/1.3.4_patch1-pafccj9/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libjpeg-turbo/2.0.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/giflib/4.2.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gsl/2.2.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gdbm/1.10-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/freetype/2.5.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftw3/3.3.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftjet/1.5.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/expat/2.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dpm/1.8.0.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vecgeom/v00.05.00-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xerces-c/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xz/5.2.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dcap/2.47.8-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libxml2/2.9.1-pafccj/include/libxml2:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/curl/7.59.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cppunit/1.40.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openssl/1.0.2d-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia6/426-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/photos/215.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/zlib-x86_64/1.2.11-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/bz2lib/1.0.6-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/include/python2.7:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tinyxml2/6.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ittnotify/16.06.18-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj/include:/usr/local/include:/usr/include == env: INTEL_LICENSE_FILE=28518@lxlicen01.cern.ch,28518@lxlicen02.cern.ch,28518@lxlicen03.cern.ch == env: SRT_TEXMFHOME_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj8/share/Rivet/texmf == env: SRT_GEANT4_PARFULLCMS_CONFIG_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-parfullcms/2014.01.27-pafccj2/share/ParFullCMS == env: GFAL_PLUGIN_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/gfal2-plugins/ == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/usr/ == env: LOBSTER_GFAL_COPY=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin/gfal-copy == env: PDFPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj8/share == env: SRT_TNS_ADMIN_SCRAMRTDEL=/etc == env: VOMS_USERCONF=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/vomses == env: MAKEFLAGS=-j4 == env: ROOT_GCC_TOOLCHAIN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: GLOBUS_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-6660/t.425221/cctools-temp-t.425221.4PhZhS == env: G4FORCENUMBEROFTHREADS=max == env: OPENBLAS_NUM_THREADS=1 == env: SRT_PDFPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj8/share == env: PERL5LIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5 == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: CMSSW_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms == env: LHAPDF_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/share/LHAPDF == env: CVSROOT=:gserver:cmssw.cvs.cern.ch:/local/reps/CMSSW == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-6660/t.425221/librmonitor_helper.so.LqxmwG == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: CMSSW_GIT_HASH=CMSSW_10_6_20 == env: SRT_G4ABLADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ABLA/3.0/data/G4ABLA3.0 == env: QTDIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2 == env: SRT_SCONS_LIB_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/scons/3.0.1-pafccj/lib == env: OLDPWD=/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20 == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: G4NEUTRONXSDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NEUTRONXS/1.4/data/G4NEUTRONXS1.4 == env: QTINC=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include == env: X509_CERT_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/certificates == env: SCRAM_ARCH=slc7_amd64_gcc700 == env: GIT_SSL_CAINFO=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/ssl/certs/ca-bundle.crt == env: SRT_CMS_OPENLOOPS_PREFIX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openloops/2.1.0-pafccj2 == env: SRT_GIT_EXEC_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/libexec/git-core == env: SRT_THEPEGPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj2/share/ThePEG == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_20 == env: ROOT_TTREECACHE_SIZE=0 == env: EVTGENDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/evtgen/1.6.0-pafccj5/share == env: SRT_INTEL_LICENSE_FILE_SCRAMRTDEL=28518@lxlicen01.cern.ch,28518@lxlicen02.cern.ch,28518@lxlicen03.cern.ch == env: SRT_ROOT_INCLUDE_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/include/LCG:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mctester/1.25.0a-pafccj9/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj6/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dd4hep/v01-10x-pafccj9/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtDesigner:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauolapp/1.1.5-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/charybdis/1.003-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj2/include/SHERPA-MC:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtOpenGL:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtGui:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwig/6.521-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt3Support:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lwtnn/2.4-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4/10.4.3-pafccj2/include/Geant4:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/classlib/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cgal/4.2-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tkonlinesw/4.2.0-1_gcc7-pafccj9/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/starlight/r193-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtCore:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtXml:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mcdb/1.0.3-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libungif/4.1.4-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libtiff/4.0.3-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/highfive/2.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libpng/1.6.16-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pcre/8.37-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/include/xrootd/private:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/vdt/0.4.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/toprex/4.23-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tbb/2019_U3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauola/27.121.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sigcpp/2.6.2-pafccj/include/sigc++-2.0:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sqlite/3.22.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/protobuf/3.5.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pacparser/1.3.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/oracle/12.1.0.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/py2-numpy/1.16.2-nmpfii2/c-api/core/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/meschach/1.2.pCMS1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lz4/1.9.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libuuid/2.22.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libunwind/1.2.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libhepml/0.2.1-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ktjet/1.06-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jimmy/4.2-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jemalloc/5.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hls/2019.08/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj12:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hector/1.3.4_patch1-pafccj9/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libjpeg-turbo/2.0.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/giflib/4.2.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gsl/2.2.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gdbm/1.10-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/freetype/2.5.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftw3/3.3.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftjet/1.5.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/expat/2.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dpm/1.8.0.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vecgeom/v00.05.00-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xerces-c/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xz/5.2.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dcap/2.47.8-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libxml2/2.9.1-pafccj/include/libxml2:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/curl/7.59.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cppunit/1.40.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openssl/1.0.2d-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia6/426-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/photos/215.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/zlib-x86_64/1.2.11-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/bz2lib/1.0.6-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/include/python2.7:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tinyxml2/6.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ittnotify/16.06.18-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj/include:/usr/local/include:/usr/include == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: G4LEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4EMLOW/7.3/data/G4EMLOW7.3 == env: SRT_VINCIADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vincia/2.2.04-pafccj5/share/Vincia/xmldoc == env: SRT_ROOT_TTREECACHE_PREFILL_SCRAMRTDEL=0 == env: OPAL_PREFIX=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openmpi/2.1.5-pafccj == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: ROOT_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj12:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: SHERPA_INCLUDE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj2/include/SHERPA-MC == env: SRT_LHAPDF_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/share/LHAPDF == env: SRT_PYTHON27PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20/python:/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-tool-conf/45.0-pafccj26/lib/python2.7/site-packages == env: LD_LIBRARY_PATH=/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20/biglib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/biglib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cuda/10.1.105-pafccj2/drivers:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/dcap:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/lcgdm:/.singularity.d/libs:lib:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-6660/t.425221/cctools-temp-t.425221.4PhZhS == env: SRT_CMSSW_RELEASE_BASE_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20 == env: SRT_RIVET_ANALYSIS_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj8/lib == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: SRT_PERL5LIB_SCRAMRT=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/perl5 == env: SRT_CMSSW_VERSION_SCRAMRTDEL=CMSSW_10_6_20 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/usr/ == env: GCC_RUNTIME_LSAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: SCRAM_CXX11_ABI=1 == env: VALGRIND_LIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/lib/valgrind == env: SRT_CMSSW_GIT_HASH_SCRAMRTDEL=CMSSW_10_6_20 == env: SRT_ROOTSYS_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj6/ == env: OSG_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-UFzuT1 == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-6660/cache/tmp == env: G4NEUTRONHPDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NDL/4.5/data/G4NDL4.5 == env: GEANT4_PARFULLCMS_CONFIG_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-parfullcms/2014.01.27-pafccj2/share/ParFullCMS == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: CSC_TRACK_FINDER_DATA_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/CSCTrackFinderEmulation/1.2-pafccj/data/ == env: SRT_QTINC_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: G4ENSDFSTATEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ENSDFSTATE/2.2/data/G4ENSDFSTATE2.2 == env: G4RADIOACTIVEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4RadioactiveDecay/5.2/data/RadioactiveDecay5.2 == env: ROOFITSYS=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj6/ == env: SRT_ROOFITSYS_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj6/ == env: SRT_G4RADIOACTIVEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4RadioactiveDecay/5.2/data/RadioactiveDecay5.2 == env: SRT_G4ENSDFSTATEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ENSDFSTATE/2.2/data/G4ENSDFSTATE2.2 == env: SRT_CLHEP_PARAM_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2 == env: G4ABLADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ABLA/3.0/data/G4ABLA3.0 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: SRT_SHERPA_INCLUDE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj2/include/SHERPA-MC == env: SRT_G4FORCENUMBEROFTHREADS_SCRAMRTDEL=max == env: SRT_WORKER_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/blackhat/0.9.9-pafccj/share/blackhat/datafiles/ == env: SITECONFIG_PATH=/cvmfs/cms.cern.ch/SITECONF/local == env: PARROT_CVMFS_REPO= == env: VC3_VERSION_GZIP=1.5 == env: GCC_RUNTIME_TSAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libtsan.so == env: TNS_ADMIN=/etc == env: SRT_HEPPDT_PARAM_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj == env: PATH=/cvmfs/cms.cern.ch/share/overrides/bin:/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20/bin/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/sbin:/cvmfs/cms.cern.ch/common:/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ENV_TAG_GLOBAL=6407 == env: THEPEGPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj2/share/ThePEG == env: SRT_CMSSW_SEARCH_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20/poison:/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20/src:/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20/external/slc7_amd64_gcc700/data:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/external/slc7_amd64_gcc700/data == env: SRT_GIT_SSL_CAINFO_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/ssl/certs/ca-bundle.crt == env: SRT_GCC_RUNTIME_LSAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: CMS_PATH=/cvmfs/cms.cern.ch == env: VC3_ROOT=/disk/vc3-root == env: SRT_UTM_XSD_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj == env: SRT_PATH_SCRAMRT=/cvmfs/cms.cern.ch/share/overrides/bin:/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20/bin/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/bin == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-UFzuT1 == env: RIVET_ANALYSIS_PATH=/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj8/lib == env: SRT_LOCALRT_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20 == env: SRT_CMSSW_BASE_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20 == env: PWD=/disk/vc3-root/tmp/worker-230547-6660/t.425221 == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: PYTHON_VALGRIND_SUPP=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/share/valgrind/valgrind-python.supp == env: SRT_OPAL_PREFIX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openmpi/2.1.5-pafccj == env: VC3_VERSION_WHICH=2.20 == env: GCC_RUNTIME_UBSAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libubsan.so == env: LANG=C == env: SRT_QTDIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: SRT_G4NEUTRONHPDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NDL/4.5/data/G4NDL4.5 == env: X509_VOMS_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/vomsdir == env: LOBSTER_LCG_CP= == env: SRT_SHERPA_SHARE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj2/share/SHERPA-MC == env: SRT_GCC_RUNTIME_TSAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libtsan.so == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-6660 == env: CASCADE_PDFPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/share == env: SRT_ROOT_GCC_TOOLCHAIN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: SRT_CASCADE_PDFPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/share == env: WORKER_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/blackhat/0.9.9-pafccj/share/blackhat/datafiles/ == env: GIT_TEMPLATE_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/git-core/templates == env: G4SAIDXSDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4SAIDDATA/1.1/data/G4SAIDDATA1.1 == env: MLAS_DYNAMIC_CPU_ARCH=0 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: PYTHON27PATH=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20/python:/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-tool-conf/45.0-pafccj26/lib/python2.7/site-packages == env: SRT_CMSSW_FWLITE_INCLUDE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/usr/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: ROOTSYS=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj6/ == env: SRT_PYTHIA8DATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/share/Pythia8/xmldoc == env: SRT_HERWIGPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj3/share/Herwig == env: CXX=g++ == env: SRT_QTLIB_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/lib == env: SRT_PYTHON3PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20/python:/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-tool-conf/45.0-pafccj26/lib/python3.6/site-packages == env: SHERPA_LIBRARY_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj2/lib/SHERPA-MC == env: SRT_PYTHON_VALGRIND_SUPP_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/share/valgrind/valgrind-python.supp == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: CMSSW_SEARCH_PATH=/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20/poison:/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20/src:/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20/external/slc7_amd64_gcc700/data:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/external/slc7_amd64_gcc700/data == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: GENEVA_DATA_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geneva/1.0-RC3-pafccj8/share/Geneva == env: DISK=300 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-6660/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-6660/cache/tmp/cvmfs == env: GOSAMCONTRIB_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: ROOT_TTREECACHE_PREFILL=0 == env: GENREFLEX=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj6/bin/genreflex == env: VINCIADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vincia/2.2.04-pafccj5/share/Vincia/xmldoc == env: SRT_G4LEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4EMLOW/7.3/data/G4EMLOW7.3 == env: SRT_GENREFLEX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj6/bin/genreflex == env: SRT_GOSAMCONTRIB_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: SRT_ROOT_TTREECACHE_SIZE_SCRAMRTDEL=0 == env: SRT_EVTGENDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/evtgen/1.6.0-pafccj5/share == env: SRT_GENEVA_DATA_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geneva/1.0-RC3-pafccj8/share/Geneva == env: GFAL_CONFIG_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/gfal2.d/ == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=1000 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: SRT_CMSSW_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms == env: HEPPDT_PARAM_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj == env: SRT_LD_LIBRARY_PATH_SCRAMRT=/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20/biglib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/biglib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cuda/10.1.105-pafccj2/drivers == env: TMP=/disk/vc3-root/tmp/worker-230547-6660/t.425221/cctools-temp-t.425221.4PhZhS == env: PYTHONPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib/python2.7/site-packages:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/python2.7/site-packages:python:python: == env: PYTHON3PATH=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20/python:/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_20/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-tool-conf/45.0-pafccj26/lib/python3.6/site-packages == env: QTLIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/lib == env: SCONS_LIB_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/scons/3.0.1-pafccj/lib == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: COMPILER_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: FRONTIER_CLIENT=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/ == env: SRT_G4NEUTRONXSDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NEUTRONXS/1.4/data/G4NEUTRONXS1.4 == env: SRT_SHERPA_LIBRARY_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj2/lib/SHERPA-MC == env: VC3_ROOT_TAR=/usr/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CLHEP_PARAM_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2 == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-UFzuT1.wrapper == env: PYTHIA8DATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/share/Pythia8/xmldoc == env: HERWIGPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj3/share/Herwig == env: SRT_FRONTIER_CLIENT_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/ == env: SRT_COMPILER_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: SRT_CSC_TRACK_FINDER_DATA_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/CSCTrackFinderEmulation/1.2-pafccj/data/ == env: GCC_RUNTIME_ASAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: SRT_ROOT_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj12:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: CC=gcc == env: TEXMFHOME=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj8/share/Rivet/texmf == env: SRT_MLAS_DYNAMIC_CPU_ARCH_SCRAMRTDEL=0 == env: SRT_OPENBLAS_NUM_THREADS_SCRAMRTDEL=1 == env: SRT_GIT_TEMPLATE_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/git-core/templates == env: SRT_G4SAIDXSDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4SAIDDATA/1.1/data/G4SAIDDATA1.1 == env: CMSSW_VERSION=CMSSW_10_6_20 == env: SRT_GCC_RUNTIME_UBSAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libubsan.so == env: SRT_LANG_SCRAMRTDEL=C == env: CCTOOLS_RESOURCE_MONITOR_INFO=1029 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=1 == env: PARROT_DEBUG_FLAGS= == env: SHERPA_SHARE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj2/share/SHERPA-MC == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: CMS_OPENLOOPS_PREFIX=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openloops/2.1.0-pafccj2 == env: GIT_EXEC_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/libexec/git-core == env: LOCALRT=/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20 == env: CMSSW_BASE=/disk/vc3-root/tmp/worker-230547-6660/t.425221/CMSSW_10_6_20 == env: SRT_SCRAM_CXX11_ABI_SCRAMRTDEL=1 == env: SRT_VALGRIND_LIB_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/lib/valgrind == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_CRC_b3_postLHE.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=27072 == env: _=/usr/bin/env === wrapper ready @ Tue May 25 01:57:29 EDT 2021 ==== working directory before execution @ Tue May 25 01:57:29 EDT 2021 ==== == dir: total 884 == dir: -rwxr-xr-x 2 kmohrman campus 1576 May 25 01:56 0024_5241_report.json == dir: -rwxr-xr-x 2 kmohrman campus 1578 May 25 01:56 0025_2903_report.json == dir: -rwxr-xr-x 2 kmohrman campus 1570 May 25 01:56 0026_2402_report.json == dir: -rwxr-xr-x 2 kmohrman campus 1435 May 25 01:56 0042_3345_report.json == dir: drwxr-xr-x 18 kmohrman campus 215 May 25 01:57 CMSSW_10_6_20 == dir: drwxr-xr-x 2 kmohrman campus 71 May 25 01:56 bin == dir: -rwxr-xr-x 5 kmohrman campus 627272 May 24 21:03 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 May 25 01:56 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 May 25 01:56 cctools-temp-t.425221.4PhZhS == dir: -rw------- 1 kmohrman campus 51 May 25 01:57 cvmfschecksum.cms-ib.cern.ch == dir: -rw------- 1 kmohrman campus 51 May 25 01:57 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 May 25 01:57 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 May 25 01:56 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 May 25 01:56 librmonitor_helper.so.LqxmwG == dir: -rw-r--r-- 2 kmohrman campus 868 May 25 01:56 merge_cfg.py == dir: -rw-r--r-- 2 kmohrman campus 808 May 25 01:56 merge_reports.py == dir: -rw-r--r-- 2 kmohrman campus 2471 May 25 01:56 parameters.json == dir: -rw------- 2 kmohrman campus 9917 May 25 01:56 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 May 25 01:56 python == dir: -rw-r--r-- 5 kmohrman campus 570 May 24 21:03 report.json.in == dir: -rw-r--r-- 2 kmohrman campus 549 May 24 23:31 sandbox-CMSSW_10_6_20-slc7_amd64_gcc700.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 37 May 25 01:56 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 May 25 01:57 t_wrapper_ready == dir: -rw-r--r-- 1 kmohrman campus 11 May 25 01:57 t_wrapper_start == dir: -rwxr-xr-x 5 kmohrman campus 47217 May 24 21:03 task.py == dir: -rwxr-xr-x 5 kmohrman campus 5986 May 24 21:03 wrapper.sh >>> data is {u'files': {u'info': {}, u'output_info': {}, u'skipped': []}, u'cpu_time': 0, u'exe_exit_code': 0, u'events_written': 0, u'output_size': 0, u'task_exit_code': 0, u'output_storage_element': u'', u'cache': {u'start_size': 0, u'type': 2, u'end_size': 0}, u'stageout_exit_code': 0, u'output_bare_size': 0, u'transfers': defaultdict(, {}), u'task_timing': {u'wrapper_ready': 0, u'wrapper_start': 0, u'prologue_end': 0, u'epilogue_end': 0, u'stage_out_end': 0, u'stage_in_end': 0, u'processing_end': 0}, u'events_per_run': 0} @ Tue May 25 01:57:36 2021 >>> Trying hdfs client access method @ Tue May 25 01:57:36 2021 >>> executing 'timeout 300 hdfs dfs -fs hdfs://eddie.crc.nd.edu:19000 -get /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_245241.root MAOD-00000_245241.root' @ Tue May 25 01:57:36 2021 >> using /disk/vc3-root/tmp/worker-230547-6660/t.425221/cctools-temp-t.425221.4PhZhS/tmpOpFB4A to store command output >> cmd: timeout: failed to run command 'hdfs': No such file or directory >>>>> Unable to copy input with hdfs client @ Tue May 25 01:57:37 2021 >>> Trying xrootd access method @ Tue May 25 01:57:37 2021 >>> executing 'env XRD_LOGLEVEL=Debug timeout 300 xrdfs deepthought.crc.nd.edu stat /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_245241.root' @ Tue May 25 01:57:37 2021 >> using /disk/vc3-root/tmp/worker-230547-6660/t.425221/cctools-temp-t.425221.4PhZhS/tmphPZzVN to store command output >> cmd: [2021-05-25 01:57:37.252002 -0400][Warning][Utility ] Unable to process global config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 01:57:37.253476 -0400][Debug ][Utility ] Unable to process user config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 01:57:37.253740 -0400][Debug ][PlugInMgr ] Initializing plug-in manager... >> cmd: [2021-05-25 01:57:37.253805 -0400][Debug ][PlugInMgr ] No default plug-in, loading plug-in configs... >> cmd: [2021-05-25 01:57:37.253857 -0400][Debug ][PlugInMgr ] Processing plug-in definitions in /etc/xrootd/client.plugins.d... >> cmd: [2021-05-25 01:57:37.253967 -0400][Debug ][PlugInMgr ] Unable to process directory /etc/xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 01:57:37.254406 -0400][Debug ][PlugInMgr ] Processing plug-in definitions in /tmp/runos_singularity_home-224046566519442716283870413672516026873/.xrootd/client.plugins.d... >> cmd: [2021-05-25 01:57:37.254525 -0400][Debug ][PlugInMgr ] Unable to process directory /tmp/runos_singularity_home-224046566519442716283870413672516026873/.xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 01:57:37.254827 -0400][Debug ][App ] Executing: stat /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_245241.root >> cmd: [2021-05-25 01:57:37.255003 -0400][Debug ][Poller ] Available pollers: built-in >> cmd: [2021-05-25 01:57:37.255059 -0400][Debug ][Poller ] Attempting to create a poller according to preference: built-in >> cmd: [2021-05-25 01:57:37.255109 -0400][Debug ][Poller ] Creating poller: built-in >> cmd: [2021-05-25 01:57:37.255171 -0400][Debug ][Poller ] Creating and starting the built-in poller... >> cmd: [2021-05-25 01:57:37.255697 -0400][Debug ][Poller ] Using 1 poller threads >> cmd: [2021-05-25 01:57:37.255760 -0400][Debug ][TaskMgr ] Starting the task manager... >> cmd: [2021-05-25 01:57:37.255955 -0400][Debug ][TaskMgr ] Task manager started >> cmd: [2021-05-25 01:57:37.256031 -0400][Debug ][JobMgr ] Starting the job manager... >> cmd: [2021-05-25 01:57:37.256511 -0400][Debug ][JobMgr ] Job manager started, 3 workers >> cmd: [2021-05-25 01:57:37.256573 -0400][Debug ][TaskMgr ] Registering task: "FileTimer task" to be run at: [2021-05-25 01:57:37 -0400] >> cmd: [2021-05-25 01:57:37.256685 -0400][Debug ][PostMaster ] Creating new channel to: deepthought.crc.nd.edu:1094 1 stream(s) >> cmd: [2021-05-25 01:57:37.256776 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-05-25 01:57:37.258064 -0400][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" to be run at: [2021-05-25 01:57:52 -0400] >> cmd: [2021-05-25 01:57:37.259332 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 01:57:37.259545 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 01:57:37.259665 -0400][Debug ][Poller ] Adding socket 0x1cf9920 to the poller >> cmd: [2021-05-25 01:57:37.260032 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2021-05-25 01:57:37.260213 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-05-25 01:57:37.260774 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Got the server hand shake response (type: manager [], protocol version 500) >> cmd: [2021-05-25 01:57:37.261004 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] kXR_protocol successful (type: manager [], protocol version 500) >> cmd: [2021-05-25 01:57:37.264219 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=d12chas348.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-05-25 01:57:37.264706 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Logged in, session: dd410000cf3c0b004a0c000088460000 >> cmd: [2021-05-25 01:57:37.264798 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream 0 connected. >> cmd: [2021-05-25 01:57:37.264851 -0400][Debug ][Utility ] Monitor library name not set. No monitoring >> cmd: [2021-05-25 01:57:37.266947 -0400][Debug ][PostMaster ] Creating new channel to: primeradiant06.crc.nd.edu:1096 1 stream(s) >> cmd: [2021-05-25 01:57:37.267050 -0400][Debug ][PostMaster ] [primeradiant06.crc.nd.edu:1096 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-05-25 01:57:37.268702 -0400][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: primeradiant06.crc.nd.edu:1096" to be run at: [2021-05-25 01:57:52 -0400] >> cmd: [2021-05-25 01:57:37.269935 -0400][Debug ][PostMaster ] [primeradiant06.crc.nd.edu:1096] Found 1 address(es): [::ffff:149.165.243.14]:1096 >> cmd: [2021-05-25 01:57:37.270139 -0400][Debug ][AsyncSock ] [primeradiant06.crc.nd.edu:1096 #0.0] Attempting connection to [::ffff:149.165.243.14]:1096 >> cmd: [2021-05-25 01:57:37.270248 -0400][Debug ][Poller ] Adding socket 0x140016a0 to the poller >> cmd: [2021-05-25 01:57:37.270433 -0400][Debug ][AsyncSock ] [primeradiant06.crc.nd.edu:1096 #0.0] Async connection call returned >> cmd: [2021-05-25 01:57:37.270589 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-05-25 01:57:37.271102 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] Got the server hand shake response (type: server [], protocol version 500) >> cmd: [2021-05-25 01:57:37.271357 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] kXR_protocol successful (type: server [], protocol version 500) >> cmd: [2021-05-25 01:57:37.274456 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=d12chas348.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-05-25 01:57:37.274890 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] Logged in, session: be0302007030000023630000be030200 >> cmd: [2021-05-25 01:57:37.274943 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] Authentication is required: &P=gsi,v:10400,c:ssl,ca:ba240aa8.0|f5f0dfc2.0 >> cmd: [2021-05-25 01:57:37.274998 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] Sending authentication data >> cmd: [2021-05-25 01:57:37.283066 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] Trying to authenticate using gsi >> cmd: [2021-05-25 01:57:37.374762 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] Sending more authentication data for gsi >> cmd: [2021-05-25 01:57:37.387433 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] Authenticated with gsi. >> cmd: [2021-05-25 01:57:37.387565 -0400][Debug ][PostMaster ] [primeradiant06.crc.nd.edu:1096 #0] Stream 0 connected. >> cmd: [2021-05-25 01:58:37.614153 -0400][Debug ][AsyncSock ] [primeradiant06.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2021-05-25 01:58:37.614348 -0400][Debug ][Poller ] <[::ffff:10.32.84.203]:60888><--><[::ffff:149.165.243.14]:1096> Removing socket from the poller >> cmd: [2021-05-25 01:58:37.614638 -0400][Debug ][PostMaster ] [primeradiant06.crc.nd.edu:1096 #0] Recovering error for stream #0: [ERROR] Socket error. >> cmd: [2021-05-25 01:58:37.614720 -0400][Debug ][PostMaster ] [primeradiant06.crc.nd.edu:1096 #0] Reporting disconnection to queued message handlers. >> cmd: [2021-05-25 01:58:37.614800 -0400][Debug ][XRootD ] [primeradiant06.crc.nd.edu:1096] Handling error while processing kXR_stat (path: /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_245241.root, flags: none): [ERROR] Socket error. >> cmd: [2021-05-25 01:58:37.617778 -0400][Debug ][PostMaster ] Creating new channel to: primeradiant03.crc.nd.edu:1096 1 stream(s) >> cmd: [2021-05-25 01:58:37.617910 -0400][Debug ][PostMaster ] [primeradiant03.crc.nd.edu:1096 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-05-25 01:58:37.620641 -0400][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: primeradiant03.crc.nd.edu:1096" to be run at: [2021-05-25 01:58:52 -0400] >> cmd: [2021-05-25 01:58:37.622425 -0400][Debug ][PostMaster ] [primeradiant03.crc.nd.edu:1096] Found 1 address(es): [::ffff:149.165.243.11]:1096 >> cmd: [2021-05-25 01:58:37.622677 -0400][Debug ][AsyncSock ] [primeradiant03.crc.nd.edu:1096 #0.0] Attempting connection to [::ffff:149.165.243.11]:1096 >> cmd: [2021-05-25 01:58:37.622816 -0400][Debug ][Poller ] Adding socket 0x20001540 to the poller >> cmd: [2021-05-25 01:58:37.623076 -0400][Debug ][AsyncSock ] [primeradiant03.crc.nd.edu:1096 #0.0] Async connection call returned >> cmd: [2021-05-25 01:58:37.623276 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-05-25 01:58:37.623869 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Got the server hand shake response (type: server [], protocol version 500) >> cmd: [2021-05-25 01:58:37.624168 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] kXR_protocol successful (type: server [], protocol version 500) >> cmd: [2021-05-25 01:58:37.627971 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=d12chas348.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-05-25 01:58:37.631022 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Logged in, session: c11d01001c21000001150000c71d0100 >> cmd: [2021-05-25 01:58:37.631130 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Authentication is required: &P=gsi,v:10400,c:ssl,ca:ba240aa8.0|f5f0dfc2.0 >> cmd: [2021-05-25 01:58:37.631197 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Sending authentication data >> cmd: [2021-05-25 01:58:37.632782 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Trying to authenticate using gsi >> cmd: [2021-05-25 01:58:37.659434 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Sending more authentication data for gsi >> cmd: [2021-05-25 01:58:37.668714 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Authenticated with gsi. >> cmd: [2021-05-25 01:58:37.668865 -0400][Debug ][PostMaster ] [primeradiant03.crc.nd.edu:1096 #0] Stream 0 connected. >> cmd: [2021-05-25 01:59:37.944980 -0400][Debug ][AsyncSock ] [primeradiant03.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2021-05-25 01:59:37.945201 -0400][Debug ][Poller ] <[::ffff:10.32.84.203]:48580><--><[::ffff:149.165.243.11]:1096> Removing socket from the poller >> cmd: [2021-05-25 01:59:37.945467 -0400][Debug ][PostMaster ] [primeradiant03.crc.nd.edu:1096 #0] Recovering error for stream #0: [ERROR] Socket error. >> cmd: [2021-05-25 01:59:37.945549 -0400][Debug ][PostMaster ] [primeradiant03.crc.nd.edu:1096 #0] Reporting disconnection to queued message handlers. >> cmd: [2021-05-25 01:59:37.945629 -0400][Debug ][XRootD ] [primeradiant03.crc.nd.edu:1096] Handling error while processing kXR_stat (path: /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_245241.root?tried=primeradiant06.crc.nd.edu, flags: none): [ERROR] Socket error. >> cmd: [2021-05-25 01:59:37.948581 -0400][Debug ][PostMaster ] Creating new channel to: primeradiant05.crc.nd.edu:1096 1 stream(s) >> cmd: [2021-05-25 01:59:37.948719 -0400][Debug ][PostMaster ] [primeradiant05.crc.nd.edu:1096 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-05-25 01:59:37.950967 -0400][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: primeradiant05.crc.nd.edu:1096" to be run at: [2021-05-25 01:59:52 -0400] >> cmd: [2021-05-25 01:59:37.952492 -0400][Debug ][PostMaster ] [primeradiant05.crc.nd.edu:1096] Found 1 address(es): [::ffff:149.165.243.13]:1096 >> cmd: [2021-05-25 01:59:37.952746 -0400][Debug ][AsyncSock ] [primeradiant05.crc.nd.edu:1096 #0.0] Attempting connection to [::ffff:149.165.243.13]:1096 >> cmd: [2021-05-25 01:59:37.952888 -0400][Debug ][Poller ] Adding socket 0x24001540 to the poller >> cmd: [2021-05-25 01:59:37.953081 -0400][Debug ][AsyncSock ] [primeradiant05.crc.nd.edu:1096 #0.0] Async connection call returned >> cmd: [2021-05-25 01:59:37.953245 -0400][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-05-25 01:59:37.953766 -0400][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Got the server hand shake response (type: server [], protocol version 500) >> cmd: [2021-05-25 01:59:37.954046 -0400][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] kXR_protocol successful (type: server [], protocol version 500) >> cmd: [2021-05-25 01:59:37.957679 -0400][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=d12chas348.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-05-25 01:59:37.958239 -0400][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Logged in, session: 271e0100701f0000fb0b0000291e0100 >> cmd: [2021-05-25 01:59:37.958322 -0400][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Authentication is required: &P=gsi,v:10400,c:ssl,ca:ba240aa8.0|f5f0dfc2.0 >> cmd: [2021-05-25 01:59:37.958392 -0400][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Sending authentication data >> cmd: [2021-05-25 01:59:37.959834 -0400][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Trying to authenticate using gsi >> cmd: [2021-05-25 01:59:37.991887 -0400][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Sending more authentication data for gsi >> cmd: [2021-05-25 01:59:37.999125 -0400][Debug ][XRootDTransport ] [primeradiant05.crc.nd.edu:1096 #0.0] Authenticated with gsi. >> cmd: [2021-05-25 01:59:37.999260 -0400][Debug ][PostMaster ] [primeradiant05.crc.nd.edu:1096 #0] Stream 0 connected. >> cmd: Path: /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_245241.root >> cmd: Id: 0 >> cmd: Size: 78230173 >> cmd: MTime: 2021-05-20 13:55:39 >> cmd: Flags: 24 (Offline|IsReadable) >> cmd: [2021-05-25 01:59:38.038046 -0400][Debug ][JobMgr ] Stopping the job manager... >> cmd: [2021-05-25 01:59:38.038910 -0400][Debug ][JobMgr ] Job manager stopped >> cmd: [2021-05-25 01:59:38.039798 -0400][Debug ][TaskMgr ] Stopping the task manager... >> cmd: [2021-05-25 01:59:38.040259 -0400][Debug ][TaskMgr ] Task manager stopped >> cmd: [2021-05-25 01:59:38.040346 -0400][Debug ][Poller ] Stopping the poller... >> cmd: [2021-05-25 01:59:38.040915 -0400][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" >> cmd: [2021-05-25 01:59:38.041005 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-05-25 01:59:38.041087 -0400][Debug ][Poller ] <[::ffff:10.32.84.203]:32860><--><[::ffff:129.74.85.55]:1094> Removing socket from the poller >> cmd: [2021-05-25 01:59:38.041222 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Destroying stream >> cmd: [2021-05-25 01:59:38.041313 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-05-25 01:59:38.041395 -0400][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: primeradiant03.crc.nd.edu:1096" >> cmd: [2021-05-25 01:59:38.041466 -0400][Debug ][AsyncSock ] [primeradiant03.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2021-05-25 01:59:38.041571 -0400][Debug ][PostMaster ] [primeradiant03.crc.nd.edu:1096 #0] Destroying stream >> cmd: [2021-05-25 01:59:38.041643 -0400][Debug ][AsyncSock ] [primeradiant03.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2021-05-25 01:59:38.041717 -0400][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: primeradiant05.crc.nd.edu:1096" >> cmd: [2021-05-25 01:59:38.041783 -0400][Debug ][AsyncSock ] [primeradiant05.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2021-05-25 01:59:38.041851 -0400][Debug ][Poller ] <[::ffff:10.32.84.203]:59718><--><[::ffff:149.165.243.13]:1096> Removing socket from the poller >> cmd: [2021-05-25 01:59:38.041970 -0400][Debug ][PostMaster ] [primeradiant05.crc.nd.edu:1096 #0] Destroying stream >> cmd: [2021-05-25 01:59:38.042050 -0400][Debug ][AsyncSock ] [primeradiant05.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2021-05-25 01:59:38.042123 -0400][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: primeradiant06.crc.nd.edu:1096" >> cmd: [2021-05-25 01:59:38.042196 -0400][Debug ][AsyncSock ] [primeradiant06.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2021-05-25 01:59:38.042264 -0400][Debug ][PostMaster ] [primeradiant06.crc.nd.edu:1096 #0] Destroying stream >> cmd: [2021-05-25 01:59:38.042332 -0400][Debug ][AsyncSock ] [primeradiant06.crc.nd.edu:1096 #0.0] Closing the socket >>> will stream using xrootd instead of copying @ Tue May 25 01:59:38 2021 >>> Trying hdfs client access method @ Tue May 25 01:59:38 2021 >>> executing 'timeout 300 hdfs dfs -fs hdfs://eddie.crc.nd.edu:19000 -get /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_252903.root MAOD-00000_252903.root' @ Tue May 25 01:59:38 2021 >> using /disk/vc3-root/tmp/worker-230547-6660/t.425221/cctools-temp-t.425221.4PhZhS/tmpfWjFoy to store command output >> cmd: timeout: failed to run command 'hdfs': No such file or directory >>>>> Unable to copy input with hdfs client @ Tue May 25 01:59:38 2021 >>> Trying xrootd access method @ Tue May 25 01:59:38 2021 >>> executing 'env XRD_LOGLEVEL=Debug timeout 300 xrdfs deepthought.crc.nd.edu stat /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_252903.root' @ Tue May 25 01:59:38 2021 >> using /disk/vc3-root/tmp/worker-230547-6660/t.425221/cctools-temp-t.425221.4PhZhS/tmp1x39dt to store command output >> cmd: [2021-05-25 01:59:38.356692 -0400][Warning][Utility ] Unable to process global config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 01:59:38.357891 -0400][Debug ][Utility ] Unable to process user config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 01:59:38.358118 -0400][Debug ][PlugInMgr ] Initializing plug-in manager... >> cmd: [2021-05-25 01:59:38.358177 -0400][Debug ][PlugInMgr ] No default plug-in, loading plug-in configs... >> cmd: [2021-05-25 01:59:38.358223 -0400][Debug ][PlugInMgr ] Processing plug-in definitions in /etc/xrootd/client.plugins.d... >> cmd: [2021-05-25 01:59:38.358317 -0400][Debug ][PlugInMgr ] Unable to process directory /etc/xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 01:59:38.358680 -0400][Debug ][PlugInMgr ] Processing plug-in definitions in /tmp/runos_singularity_home-224046566519442716283870413672516026873/.xrootd/client.plugins.d... >> cmd: [2021-05-25 01:59:38.358778 -0400][Debug ][PlugInMgr ] Unable to process directory /tmp/runos_singularity_home-224046566519442716283870413672516026873/.xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 01:59:38.359049 -0400][Debug ][App ] Executing: stat /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_252903.root >> cmd: [2021-05-25 01:59:38.359200 -0400][Debug ][Poller ] Available pollers: built-in >> cmd: [2021-05-25 01:59:38.359246 -0400][Debug ][Poller ] Attempting to create a poller according to preference: built-in >> cmd: [2021-05-25 01:59:38.359288 -0400][Debug ][Poller ] Creating poller: built-in >> cmd: [2021-05-25 01:59:38.359342 -0400][Debug ][Poller ] Creating and starting the built-in poller... >> cmd: [2021-05-25 01:59:38.359793 -0400][Debug ][Poller ] Using 1 poller threads >> cmd: [2021-05-25 01:59:38.359858 -0400][Debug ][TaskMgr ] Starting the task manager... >> cmd: [2021-05-25 01:59:38.360026 -0400][Debug ][TaskMgr ] Task manager started >> cmd: [2021-05-25 01:59:38.360086 -0400][Debug ][JobMgr ] Starting the job manager... >> cmd: [2021-05-25 01:59:38.360505 -0400][Debug ][JobMgr ] Job manager started, 3 workers >> cmd: [2021-05-25 01:59:38.360558 -0400][Debug ][TaskMgr ] Registering task: "FileTimer task" to be run at: [2021-05-25 01:59:38 -0400] >> cmd: [2021-05-25 01:59:38.360657 -0400][Debug ][PostMaster ] Creating new channel to: deepthought.crc.nd.edu:1094 1 stream(s) >> cmd: [2021-05-25 01:59:38.360741 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-05-25 01:59:38.361822 -0400][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" to be run at: [2021-05-25 01:59:53 -0400] >> cmd: [2021-05-25 01:59:38.362834 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 01:59:38.363014 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 01:59:38.363123 -0400][Debug ][Poller ] Adding socket 0x1f82920 to the poller >> cmd: [2021-05-25 01:59:38.363750 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2021-05-25 01:59:38.363898 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-05-25 01:59:38.364741 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Got the server hand shake response (type: manager [], protocol version 500) >> cmd: [2021-05-25 01:59:38.364939 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] kXR_protocol successful (type: manager [], protocol version 500) >> cmd: [2021-05-25 01:59:38.368433 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=d12chas348.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-05-25 01:59:38.370390 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Logged in, session: c8450000cf3c0b00cb050000734a0000 >> cmd: [2021-05-25 01:59:38.370479 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream 0 connected. >> cmd: [2021-05-25 01:59:38.370527 -0400][Debug ][Utility ] Monitor library name not set. No monitoring >> cmd: [2021-05-25 01:59:38.373050 -0400][Debug ][PostMaster ] Creating new channel to: primeradiant04.crc.nd.edu:1096 1 stream(s) >> cmd: [2021-05-25 01:59:38.373155 -0400][Debug ][PostMaster ] [primeradiant04.crc.nd.edu:1096 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-05-25 01:59:38.375279 -0400][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: primeradiant04.crc.nd.edu:1096" to be run at: [2021-05-25 01:59:53 -0400] >> cmd: [2021-05-25 01:59:38.376389 -0400][Debug ][PostMaster ] [primeradiant04.crc.nd.edu:1096] Found 1 address(es): [::ffff:149.165.243.12]:1096 >> cmd: [2021-05-25 01:59:38.376570 -0400][Debug ][AsyncSock ] [primeradiant04.crc.nd.edu:1096 #0.0] Attempting connection to [::ffff:149.165.243.12]:1096 >> cmd: [2021-05-25 01:59:38.376671 -0400][Debug ][Poller ] Adding socket 0xf80016a0 to the poller >> cmd: [2021-05-25 01:59:38.376991 -0400][Debug ][AsyncSock ] [primeradiant04.crc.nd.edu:1096 #0.0] Async connection call returned >> cmd: [2021-05-25 01:59:38.377136 -0400][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-05-25 01:59:38.377553 -0400][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Got the server hand shake response (type: server [], protocol version 500) >> cmd: [2021-05-25 01:59:38.377750 -0400][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] kXR_protocol successful (type: server [], protocol version 500) >> cmd: [2021-05-25 01:59:38.380293 -0400][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=d12chas348.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-05-25 01:59:38.380804 -0400][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Logged in, session: b5b900001068000043010000b5b90000 >> cmd: [2021-05-25 01:59:38.380855 -0400][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Authentication is required: &P=gsi,v:10400,c:ssl,ca:ba240aa8.0|f5f0dfc2.0 >> cmd: [2021-05-25 01:59:38.380901 -0400][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Sending authentication data >> cmd: [2021-05-25 01:59:38.388667 -0400][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Trying to authenticate using gsi >> cmd: [2021-05-25 01:59:38.461546 -0400][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Sending more authentication data for gsi >> cmd: [2021-05-25 01:59:38.470953 -0400][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Authenticated with gsi. >> cmd: [2021-05-25 01:59:38.471072 -0400][Debug ][PostMaster ] [primeradiant04.crc.nd.edu:1096 #0] Stream 0 connected. >> cmd: Path: /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_252903.root >> cmd: Id: 0 >> cmd: Size: 78212962 >> cmd: MTime: 2021-05-20 15:23:11 >> cmd: Flags: 24 (Offline|IsReadable) >> cmd: [2021-05-25 01:59:38.474581 -0400][Debug ][JobMgr ] Stopping the job manager... >> cmd: [2021-05-25 01:59:38.475292 -0400][Debug ][JobMgr ] Job manager stopped >> cmd: [2021-05-25 01:59:38.475351 -0400][Debug ][TaskMgr ] Stopping the task manager... >> cmd: [2021-05-25 01:59:38.475591 -0400][Debug ][TaskMgr ] Task manager stopped >> cmd: [2021-05-25 01:59:38.475639 -0400][Debug ][Poller ] Stopping the poller... >> cmd: [2021-05-25 01:59:38.476008 -0400][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" >> cmd: [2021-05-25 01:59:38.476072 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-05-25 01:59:38.476125 -0400][Debug ][Poller ] <[::ffff:10.32.84.203]:32888><--><[::ffff:129.74.85.55]:1094> Removing socket from the poller >> cmd: [2021-05-25 01:59:38.476220 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Destroying stream >> cmd: [2021-05-25 01:59:38.476270 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-05-25 01:59:38.476322 -0400][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: primeradiant04.crc.nd.edu:1096" >> cmd: [2021-05-25 01:59:38.476366 -0400][Debug ][AsyncSock ] [primeradiant04.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2021-05-25 01:59:38.476409 -0400][Debug ][Poller ] <[::ffff:10.32.84.203]:54364><--><[::ffff:149.165.243.12]:1096> Removing socket from the poller >> cmd: [2021-05-25 01:59:38.476491 -0400][Debug ][PostMaster ] [primeradiant04.crc.nd.edu:1096 #0] Destroying stream >> cmd: [2021-05-25 01:59:38.476536 -0400][Debug ][AsyncSock ] [primeradiant04.crc.nd.edu:1096 #0.0] Closing the socket >>> will stream using xrootd instead of copying @ Tue May 25 01:59:38 2021 >>> Trying hdfs client access method @ Tue May 25 01:59:38 2021 >>> executing 'timeout 300 hdfs dfs -fs hdfs://eddie.crc.nd.edu:19000 -get /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_423345.root MAOD-00000_423345.root' @ Tue May 25 01:59:38 2021 >> using /disk/vc3-root/tmp/worker-230547-6660/t.425221/cctools-temp-t.425221.4PhZhS/tmpzRtyVP to store command output >> cmd: timeout: failed to run command 'hdfs': No such file or directory >>>>> Unable to copy input with hdfs client @ Tue May 25 01:59:38 2021 >>> Trying xrootd access method @ Tue May 25 01:59:38 2021 >>> executing 'env XRD_LOGLEVEL=Debug timeout 300 xrdfs deepthought.crc.nd.edu stat /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_423345.root' @ Tue May 25 01:59:38 2021 >> using /disk/vc3-root/tmp/worker-230547-6660/t.425221/cctools-temp-t.425221.4PhZhS/tmpdamoTF to store command output >> cmd: [2021-05-25 01:59:38.800561 -0400][Warning][Utility ] Unable to process global config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 01:59:38.801840 -0400][Debug ][Utility ] Unable to process user config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 01:59:38.802099 -0400][Debug ][PlugInMgr ] Initializing plug-in manager... >> cmd: [2021-05-25 01:59:38.802165 -0400][Debug ][PlugInMgr ] No default plug-in, loading plug-in configs... >> cmd: [2021-05-25 01:59:38.802213 -0400][Debug ][PlugInMgr ] Processing plug-in definitions in /etc/xrootd/client.plugins.d... >> cmd: [2021-05-25 01:59:38.802313 -0400][Debug ][PlugInMgr ] Unable to process directory /etc/xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 01:59:38.802696 -0400][Debug ][PlugInMgr ] Processing plug-in definitions in /tmp/runos_singularity_home-224046566519442716283870413672516026873/.xrootd/client.plugins.d... >> cmd: [2021-05-25 01:59:38.802799 -0400][Debug ][PlugInMgr ] Unable to process directory /tmp/runos_singularity_home-224046566519442716283870413672516026873/.xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 01:59:38.803110 -0400][Debug ][App ] Executing: stat /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_423345.root >> cmd: [2021-05-25 01:59:38.803281 -0400][Debug ][Poller ] Available pollers: built-in >> cmd: [2021-05-25 01:59:38.803328 -0400][Debug ][Poller ] Attempting to create a poller according to preference: built-in >> cmd: [2021-05-25 01:59:38.803373 -0400][Debug ][Poller ] Creating poller: built-in >> cmd: [2021-05-25 01:59:38.803430 -0400][Debug ][Poller ] Creating and starting the built-in poller... >> cmd: [2021-05-25 01:59:38.803923 -0400][Debug ][Poller ] Using 1 poller threads >> cmd: [2021-05-25 01:59:38.804002 -0400][Debug ][TaskMgr ] Starting the task manager... >> cmd: [2021-05-25 01:59:38.804179 -0400][Debug ][TaskMgr ] Task manager started >> cmd: [2021-05-25 01:59:38.804241 -0400][Debug ][JobMgr ] Starting the job manager... >> cmd: [2021-05-25 01:59:38.804626 -0400][Debug ][JobMgr ] Job manager started, 3 workers >> cmd: [2021-05-25 01:59:38.804681 -0400][Debug ][TaskMgr ] Registering task: "FileTimer task" to be run at: [2021-05-25 01:59:38 -0400] >> cmd: [2021-05-25 01:59:38.804789 -0400][Debug ][PostMaster ] Creating new channel to: deepthought.crc.nd.edu:1094 1 stream(s) >> cmd: [2021-05-25 01:59:38.804877 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-05-25 01:59:38.806067 -0400][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" to be run at: [2021-05-25 01:59:53 -0400] >> cmd: [2021-05-25 01:59:38.807315 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 01:59:38.807500 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 01:59:38.807610 -0400][Debug ][Poller ] Adding socket 0xcd4920 to the poller >> cmd: [2021-05-25 01:59:38.808205 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2021-05-25 01:59:38.808415 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-05-25 01:59:38.810078 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Got the server hand shake response (type: manager [], protocol version 500) >> cmd: [2021-05-25 01:59:38.810944 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] kXR_protocol successful (type: manager [], protocol version 500) >> cmd: [2021-05-25 01:59:38.815107 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=d12chas348.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-05-25 01:59:38.815976 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Logged in, session: cc450000cf3c0b00d1080000774a0000 >> cmd: [2021-05-25 01:59:38.816084 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream 0 connected. >> cmd: [2021-05-25 01:59:38.816141 -0400][Debug ][Utility ] Monitor library name not set. No monitoring >> cmd: [2021-05-25 01:59:38.817005 -0400][Debug ][PostMaster ] Creating new channel to: primeradiant03.crc.nd.edu:1096 1 stream(s) >> cmd: [2021-05-25 01:59:38.817102 -0400][Debug ][PostMaster ] [primeradiant03.crc.nd.edu:1096 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-05-25 01:59:38.819264 -0400][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: primeradiant03.crc.nd.edu:1096" to be run at: [2021-05-25 01:59:53 -0400] >> cmd: [2021-05-25 01:59:38.820978 -0400][Debug ][PostMaster ] [primeradiant03.crc.nd.edu:1096] Found 1 address(es): [::ffff:149.165.243.11]:1096 >> cmd: [2021-05-25 01:59:38.821224 -0400][Debug ][AsyncSock ] [primeradiant03.crc.nd.edu:1096 #0.0] Attempting connection to [::ffff:149.165.243.11]:1096 >> cmd: [2021-05-25 01:59:38.821354 -0400][Debug ][Poller ] Adding socket 0x640016a0 to the poller >> cmd: [2021-05-25 01:59:38.821575 -0400][Debug ][AsyncSock ] [primeradiant03.crc.nd.edu:1096 #0.0] Async connection call returned >> cmd: [2021-05-25 01:59:38.821719 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-05-25 01:59:38.822212 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Got the server hand shake response (type: server [], protocol version 500) >> cmd: [2021-05-25 01:59:38.822450 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] kXR_protocol successful (type: server [], protocol version 500) >> cmd: [2021-05-25 01:59:38.825545 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=d12chas348.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-05-25 01:59:38.826041 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Logged in, session: 9a1e01001c210000a8150000a01e0100 >> cmd: [2021-05-25 01:59:38.826118 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Authentication is required: &P=gsi,v:10400,c:ssl,ca:ba240aa8.0|f5f0dfc2.0 >> cmd: [2021-05-25 01:59:38.826182 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Sending authentication data >> cmd: [2021-05-25 01:59:38.836329 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Trying to authenticate using gsi >> cmd: [2021-05-25 01:59:38.919184 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Sending more authentication data for gsi >> cmd: [2021-05-25 01:59:38.926949 -0400][Debug ][XRootDTransport ] [primeradiant03.crc.nd.edu:1096 #0.0] Authenticated with gsi. >> cmd: [2021-05-25 01:59:38.927091 -0400][Debug ][PostMaster ] [primeradiant03.crc.nd.edu:1096 #0] Stream 0 connected. >> cmd: [2021-05-25 01:59:38.928245 -0400][Debug ][XRootD ] [primeradiant03.crc.nd.edu:1096] Handling error while processing kXR_stat (path: /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_423345.root, flags: none): [ERROR] Error response: Input/output error. >> cmd: [2021-05-25 01:59:38.929912 -0400][Debug ][XRootD ] [deepthought.crc.nd.edu:1094] Handling error while processing kXR_stat (path: /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_423345.root?tried=primeradiant03.crc.nd.edu&triedrc=fserr, flags: none): [ERROR] Error response: No such file or directory. >> cmd: [2021-05-25 01:59:38.930196 -0400][Error ][App ] Unable stat /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_423345.root: [ERROR] Server responded with an error: [3011] No servers are available to read the file. >> cmd: [ERROR] Server responded with an error: [3011] No servers are available to read the file. >> cmd: >> cmd: [2021-05-25 01:59:38.930645 -0400][Debug ][JobMgr ] Stopping the job manager... >> cmd: [2021-05-25 01:59:38.931556 -0400][Debug ][JobMgr ] Job manager stopped >> cmd: [2021-05-25 01:59:38.931649 -0400][Debug ][TaskMgr ] Stopping the task manager... >> cmd: [2021-05-25 01:59:38.931930 -0400][Debug ][TaskMgr ] Task manager stopped >> cmd: [2021-05-25 01:59:38.932007 -0400][Debug ][Poller ] Stopping the poller... >> cmd: [2021-05-25 01:59:38.932423 -0400][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" >> cmd: [2021-05-25 01:59:38.932499 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-05-25 01:59:38.932567 -0400][Debug ][Poller ] <[::ffff:10.32.84.203]:32892><--><[::ffff:129.74.85.55]:1094> Removing socket from the poller >> cmd: [2021-05-25 01:59:38.932677 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Destroying stream >> cmd: [2021-05-25 01:59:38.932741 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-05-25 01:59:38.932808 -0400][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: primeradiant03.crc.nd.edu:1096" >> cmd: [2021-05-25 01:59:38.932869 -0400][Debug ][AsyncSock ] [primeradiant03.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2021-05-25 01:59:38.932929 -0400][Debug ][Poller ] <[::ffff:10.32.84.203]:48602><--><[::ffff:149.165.243.11]:1096> Removing socket from the poller >> cmd: [2021-05-25 01:59:38.933043 -0400][Debug ][PostMaster ] [primeradiant03.crc.nd.edu:1096 #0] Destroying stream >> cmd: [2021-05-25 01:59:38.933114 -0400][Debug ][AsyncSock ] [primeradiant03.crc.nd.edu:1096 #0.0] Closing the socket >>> xrootd access to input file unavailable @ Tue May 25 01:59:38 2021 >>> Trying srm access method @ Tue May 25 01:59:38 2021 >>> executing '/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin/gfal-copy gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_423345.root MAOD-00000_423345.root' @ Tue May 25 01:59:38 2021 >> using /disk/vc3-root/tmp/worker-230547-6660/t.425221/cctools-temp-t.425221.4PhZhS/tmp_BUew0 to store command output >> cmd: Copying 27137616 bytes gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_423345.root => file:///disk/vc3-root/tmp/worker-230547-6660/t.425221/MAOD-00000_423345.root >>> Successfully copied input with SRM @ Tue May 25 01:59:43 2021 >>> Trying hdfs client access method @ Tue May 25 01:59:43 2021 >>> executing 'timeout 300 hdfs dfs -fs hdfs://eddie.crc.nd.edu:19000 -get /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_262402.root MAOD-00000_262402.root' @ Tue May 25 01:59:43 2021 >> using /disk/vc3-root/tmp/worker-230547-6660/t.425221/cctools-temp-t.425221.4PhZhS/tmpflMlnC to store command output >> cmd: timeout: failed to run command 'hdfs': No such file or directory >>>>> Unable to copy input with hdfs client @ Tue May 25 01:59:43 2021 >>> Trying xrootd access method @ Tue May 25 01:59:43 2021 >>> executing 'env XRD_LOGLEVEL=Debug timeout 300 xrdfs deepthought.crc.nd.edu stat /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_262402.root' @ Tue May 25 01:59:43 2021 >> using /disk/vc3-root/tmp/worker-230547-6660/t.425221/cctools-temp-t.425221.4PhZhS/tmpyzPfNE to store command output >> cmd: [2021-05-25 01:59:43.965750 -0400][Warning][Utility ] Unable to process global config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 01:59:43.967331 -0400][Debug ][Utility ] Unable to process user config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 01:59:43.967562 -0400][Debug ][PlugInMgr ] Initializing plug-in manager... >> cmd: [2021-05-25 01:59:43.967629 -0400][Debug ][PlugInMgr ] No default plug-in, loading plug-in configs... >> cmd: [2021-05-25 01:59:43.967686 -0400][Debug ][PlugInMgr ] Processing plug-in definitions in /etc/xrootd/client.plugins.d... >> cmd: [2021-05-25 01:59:43.967809 -0400][Debug ][PlugInMgr ] Unable to process directory /etc/xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 01:59:43.968275 -0400][Debug ][PlugInMgr ] Processing plug-in definitions in /tmp/runos_singularity_home-224046566519442716283870413672516026873/.xrootd/client.plugins.d... >> cmd: [2021-05-25 01:59:43.968417 -0400][Debug ][PlugInMgr ] Unable to process directory /tmp/runos_singularity_home-224046566519442716283870413672516026873/.xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 01:59:43.968642 -0400][Debug ][App ] Executing: stat /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_262402.root >> cmd: [2021-05-25 01:59:43.968775 -0400][Debug ][Poller ] Available pollers: built-in >> cmd: [2021-05-25 01:59:43.968832 -0400][Debug ][Poller ] Attempting to create a poller according to preference: built-in >> cmd: [2021-05-25 01:59:43.968888 -0400][Debug ][Poller ] Creating poller: built-in >> cmd: [2021-05-25 01:59:43.968952 -0400][Debug ][Poller ] Creating and starting the built-in poller... >> cmd: [2021-05-25 01:59:43.969440 -0400][Debug ][Poller ] Using 1 poller threads >> cmd: [2021-05-25 01:59:43.969525 -0400][Debug ][TaskMgr ] Starting the task manager... >> cmd: [2021-05-25 01:59:43.969713 -0400][Debug ][TaskMgr ] Task manager started >> cmd: [2021-05-25 01:59:43.969788 -0400][Debug ][JobMgr ] Starting the job manager... >> cmd: [2021-05-25 01:59:43.970300 -0400][Debug ][JobMgr ] Job manager started, 3 workers >> cmd: [2021-05-25 01:59:43.970374 -0400][Debug ][TaskMgr ] Registering task: "FileTimer task" to be run at: [2021-05-25 01:59:43 -0400] >> cmd: [2021-05-25 01:59:43.970472 -0400][Debug ][PostMaster ] Creating new channel to: deepthought.crc.nd.edu:1094 1 stream(s) >> cmd: [2021-05-25 01:59:43.970555 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-05-25 01:59:43.971885 -0400][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" to be run at: [2021-05-25 01:59:58 -0400] >> cmd: [2021-05-25 01:59:43.973369 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 01:59:43.973633 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 01:59:43.973785 -0400][Debug ][Poller ] Adding socket 0x48e920 to the poller >> cmd: [2021-05-25 01:59:43.974486 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2021-05-25 01:59:43.974723 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-05-25 01:59:43.975848 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Got the server hand shake response (type: manager [], protocol version 500) >> cmd: [2021-05-25 01:59:43.976160 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] kXR_protocol successful (type: manager [], protocol version 500) >> cmd: [2021-05-25 01:59:43.979924 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=d12chas348.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-05-25 01:59:43.980520 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Logged in, session: e8450000cf3c0b00d3090000934a0000 >> cmd: [2021-05-25 01:59:43.980638 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream 0 connected. >> cmd: [2021-05-25 01:59:43.980703 -0400][Debug ][Utility ] Monitor library name not set. No monitoring >> cmd: [2021-05-25 01:59:43.982753 -0400][Debug ][PostMaster ] Creating new channel to: primeradiant06.crc.nd.edu:1096 1 stream(s) >> cmd: [2021-05-25 01:59:43.982845 -0400][Debug ][PostMaster ] [primeradiant06.crc.nd.edu:1096 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-05-25 01:59:43.984633 -0400][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: primeradiant06.crc.nd.edu:1096" to be run at: [2021-05-25 01:59:58 -0400] >> cmd: [2021-05-25 01:59:43.985967 -0400][Debug ][PostMaster ] [primeradiant06.crc.nd.edu:1096] Found 1 address(es): [::ffff:149.165.243.14]:1096 >> cmd: [2021-05-25 01:59:43.986189 -0400][Debug ][AsyncSock ] [primeradiant06.crc.nd.edu:1096 #0.0] Attempting connection to [::ffff:149.165.243.14]:1096 >> cmd: [2021-05-25 01:59:43.986312 -0400][Debug ][Poller ] Adding socket 0x600016a0 to the poller >> cmd: [2021-05-25 01:59:43.986505 -0400][Debug ][AsyncSock ] [primeradiant06.crc.nd.edu:1096 #0.0] Async connection call returned >> cmd: [2021-05-25 01:59:43.986653 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-05-25 01:59:43.987191 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] Got the server hand shake response (type: server [], protocol version 500) >> cmd: [2021-05-25 01:59:43.987447 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] kXR_protocol successful (type: server [], protocol version 500) >> cmd: [2021-05-25 01:59:43.990880 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=d12chas348.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-05-25 01:59:43.991337 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] Logged in, session: 13050200703000002064000013050200 >> cmd: [2021-05-25 01:59:43.991404 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] Authentication is required: &P=gsi,v:10400,c:ssl,ca:ba240aa8.0|f5f0dfc2.0 >> cmd: [2021-05-25 01:59:43.991462 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] Sending authentication data >> cmd: [2021-05-25 01:59:43.999837 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] Trying to authenticate using gsi >> cmd: [2021-05-25 01:59:44.082573 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] Sending more authentication data for gsi >> cmd: [2021-05-25 01:59:44.095405 -0400][Debug ][XRootDTransport ] [primeradiant06.crc.nd.edu:1096 #0.0] Authenticated with gsi. >> cmd: [2021-05-25 01:59:44.095535 -0400][Debug ][PostMaster ] [primeradiant06.crc.nd.edu:1096 #0] Stream 0 connected. >> cmd: [2021-05-25 01:59:44.096618 -0400][Debug ][XRootD ] [primeradiant06.crc.nd.edu:1096] Handling error while processing kXR_stat (path: /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_262402.root, flags: none): [ERROR] Error response: Input/output error. >> cmd: [2021-05-25 01:59:44.098608 -0400][Debug ][PostMaster ] Creating new channel to: primeradiant04.crc.nd.edu:1096 1 stream(s) >> cmd: [2021-05-25 01:59:44.098740 -0400][Debug ][PostMaster ] [primeradiant04.crc.nd.edu:1096 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-05-25 01:59:44.100905 -0400][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: primeradiant04.crc.nd.edu:1096" to be run at: [2021-05-25 01:59:59 -0400] >> cmd: [2021-05-25 01:59:44.102392 -0400][Debug ][PostMaster ] [primeradiant04.crc.nd.edu:1096] Found 1 address(es): [::ffff:149.165.243.12]:1096 >> cmd: [2021-05-25 01:59:44.102646 -0400][Debug ][AsyncSock ] [primeradiant04.crc.nd.edu:1096 #0.0] Attempting connection to [::ffff:149.165.243.12]:1096 >> cmd: [2021-05-25 01:59:44.102787 -0400][Debug ][Poller ] Adding socket 0x68001540 to the poller >> cmd: [2021-05-25 01:59:44.103107 -0400][Debug ][AsyncSock ] [primeradiant04.crc.nd.edu:1096 #0.0] Async connection call returned >> cmd: [2021-05-25 01:59:44.103277 -0400][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-05-25 01:59:44.103881 -0400][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Got the server hand shake response (type: server [], protocol version 500) >> cmd: [2021-05-25 01:59:44.104191 -0400][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] kXR_protocol successful (type: server [], protocol version 500) >> cmd: [2021-05-25 01:59:44.107934 -0400][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=d12chas348.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-05-25 01:59:44.108580 -0400][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Logged in, session: bfb900001068000022090000bfb90000 >> cmd: [2021-05-25 01:59:44.108693 -0400][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Authentication is required: &P=gsi,v:10400,c:ssl,ca:ba240aa8.0|f5f0dfc2.0 >> cmd: [2021-05-25 01:59:44.108766 -0400][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Sending authentication data >> cmd: [2021-05-25 01:59:44.110118 -0400][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Trying to authenticate using gsi >> cmd: [2021-05-25 01:59:44.158641 -0400][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Sending more authentication data for gsi >> cmd: [2021-05-25 01:59:44.167621 -0400][Debug ][XRootDTransport ] [primeradiant04.crc.nd.edu:1096 #0.0] Authenticated with gsi. >> cmd: [2021-05-25 01:59:44.167779 -0400][Debug ][PostMaster ] [primeradiant04.crc.nd.edu:1096 #0] Stream 0 connected. >> cmd: Path: /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_262402.root >> cmd: Id: 0 >> cmd: Size: 78235819 >> cmd: MTime: 2021-05-20 16:52:08 >> cmd: Flags: 24 (Offline|IsReadable) >> cmd: [2021-05-25 01:59:44.194780 -0400][Debug ][JobMgr ] Stopping the job manager... >> cmd: [2021-05-25 01:59:44.195801 -0400][Debug ][JobMgr ] Job manager stopped >> cmd: [2021-05-25 01:59:44.195879 -0400][Debug ][TaskMgr ] Stopping the task manager... >> cmd: [2021-05-25 01:59:44.196151 -0400][Debug ][TaskMgr ] Task manager stopped >> cmd: [2021-05-25 01:59:44.196222 -0400][Debug ][Poller ] Stopping the poller... >> cmd: [2021-05-25 01:59:44.196655 -0400][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" >> cmd: [2021-05-25 01:59:44.196728 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-05-25 01:59:44.196795 -0400][Debug ][Poller ] <[::ffff:10.32.84.203]:32904><--><[::ffff:129.74.85.55]:1094> Removing socket from the poller >> cmd: [2021-05-25 01:59:44.196914 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Destroying stream >> cmd: [2021-05-25 01:59:44.196979 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-05-25 01:59:44.197063 -0400][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: primeradiant04.crc.nd.edu:1096" >> cmd: [2021-05-25 01:59:44.197124 -0400][Debug ][AsyncSock ] [primeradiant04.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2021-05-25 01:59:44.197199 -0400][Debug ][Poller ] <[::ffff:10.32.84.203]:54382><--><[::ffff:149.165.243.12]:1096> Removing socket from the poller >> cmd: [2021-05-25 01:59:44.197301 -0400][Debug ][PostMaster ] [primeradiant04.crc.nd.edu:1096 #0] Destroying stream >> cmd: [2021-05-25 01:59:44.197361 -0400][Debug ][AsyncSock ] [primeradiant04.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2021-05-25 01:59:44.197422 -0400][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: primeradiant06.crc.nd.edu:1096" >> cmd: [2021-05-25 01:59:44.197519 -0400][Debug ][AsyncSock ] [primeradiant06.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2021-05-25 01:59:44.197607 -0400][Debug ][Poller ] <[::ffff:10.32.84.203]:60932><--><[::ffff:149.165.243.14]:1096> Removing socket from the poller >> cmd: [2021-05-25 01:59:44.197737 -0400][Debug ][PostMaster ] [primeradiant06.crc.nd.edu:1096 #0] Destroying stream >> cmd: [2021-05-25 01:59:44.197804 -0400][Debug ][AsyncSock ] [primeradiant06.crc.nd.edu:1096 #0.0] Closing the socket >>> will stream using xrootd instead of copying @ Tue May 25 01:59:44 2021 >>> modified input files @ Tue May 25 01:59:44 2021 >> input: root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_245241.root >> input: root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_252903.root >> input: file:MAOD-00000_423345.root >> input: root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_262402.root >>> updated parameters are @ Tue May 25 01:59:44 2021 >> json: { >> json: "accelerate stage-in": 3, >> json: "arguments": [ >> json: "outputFile=MAOD-00000.root" >> json: ], >> json: "default ce": "T3_US_NotreDame", >> json: "default host": "earth.crc.nd.edu", >> json: "default se": "T3_US_NotreDame", >> json: "disable streaming": false, >> json: "epilogue": [ >> json: "python", >> json: "merge_reports.py", >> json: "report.json", >> json: "0026_2402_report.json", >> json: "0024_5241_report.json", >> json: "0025_2903_report.json", >> json: "0042_3345_report.json" >> json: ], >> json: "executable": "cmsRun", >> json: "file map": { >> json: "file:MAOD-00000_423345.root": "mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_423345.root", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_245241.root": "mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_245241.root", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_252903.root": "mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_252903.root", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_262402.root": "mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_262402.root" >> json: }, >> json: "gridpack": false, >> json: "input": [ >> json: "hdfs://eddie.crc.nd.edu:19000/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1", >> json: "file:///hadoop/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/" >> json: ], >> json: "mask": { >> json: "events": -1, >> json: "files": [ >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_245241.root", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_252903.root", >> json: "file:MAOD-00000_423345.root", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_262402.root" >> json: ], >> json: "lumis": null >> json: }, >> json: "monitoring": { >> json: "monitorid": null, >> json: "syncid": null, >> json: "taskid": "lobster_kmohrman_EFT_CRC_b3_postLHE_crc_20210518_1057_ef74fc80a747ad6e" >> json: }, >> json: "output": [ >> json: "hdfs://eddie.crc.nd.edu:19000/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1", >> json: "file:///hadoop/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/" >> json: ], >> json: "output files": [ >> json: [ >> json: "MAOD-00000.root", >> json: "mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_425221.root" >> json: ] >> json: ], >> json: "prologue": null, >> json: "pset": "merge_cfg.py", >> json: "want summary": true >> json: } >>> using sync CE T3_US_NotreDame @ Tue May 25 01:59:44 2021 >>> config file fragment @ Tue May 25 01:59:46 2021 >> pset: >> pset: import FWCore.ParameterSet.Config as cms >> pset: process.Timing = cms.Service("Timing", >> pset: useJobReport = cms.untracked.bool(True), >> pset: summaryOnly = cms.untracked.bool(True)) >> pset: >> pset: process.maxEvents = cms.untracked.PSet(input = cms.untracked.int32(-1)) >> pset: >> pset: import os >> pset: _, major, minor, _ = os.environ["CMSSW_VERSION"].split('_', 3) >> pset: if int(major) >= 7 and int(minor) >= 4: >> pset: xrdstats = cms.Service("XrdAdaptor::XrdStatisticsService", cms.untracked.PSet(reportToFJR = cms.untracked.bool(True))) >> pset: process.add_(xrdstats) >> pset: >> pset: for prod in process.producers.values(): >> pset: if prod.hasParameter('nEvents') and prod.type_() == 'ExternalLHEProducer': >> pset: prod.nEvents = cms.untracked.uint32(-1) >> pset: >> pset: process.source.fileNames = cms.untracked.vstring(['root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_245241.root', 'root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_252903.root', 'file:MAOD-00000_423345.root', 'root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_262402.root']) >> pset: if hasattr(process, 'options'): >> pset: process.options.wantSummary = cms.untracked.bool(True) >> pset: else: >> pset: process.options = cms.untracked.PSet(wantSummary = cms.untracked.bool(True)) >>> executing 'cmsRun -j report.xml merge_cfg_mod.py outputFile=MAOD-00000.root' @ Tue May 25 01:59:46 2021 >> using /disk/vc3-root/tmp/worker-230547-6660/t.425221/cctools-temp-t.425221.4PhZhS/tmpfK7xfn to store command output >> cmd: 25-May-2021 01:59:53 EDT Initiating request to open file root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_245241.root >> cmd: [2021-05-25 02:02:55.738884 -0400][Error ][XRootD ] [primeradiant06.crc.nd.edu:1096] Unable to get the response to request kXR_open (file: /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_245241.root, mode: 0660, flags: kXR_open_read kXR_async kXR_retstat ) >> cmd: %MSG-w XrdAdaptorInternal: file_open 25-May-2021 02:02:55 EDT pre-events >> cmd: Failed to open file at URL root://primeradiant06.crc.nd.edu:1096//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_245241.root. >> cmd: %MSG >> cmd: 25-May-2021 02:03:04 EDT Successfully opened file root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_245241.root >> cmd: Begin processing the 1st record. Run 1, Event 15, LumiSection 19013 on stream 0 at 25-May-2021 02:05:59.684 EDT >> cmd: 25-May-2021 02:06:29 EDT Closed file root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_245241.root >> cmd: 25-May-2021 02:06:29 EDT Initiating request to open file root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_252903.root >> cmd: 25-May-2021 02:06:31 EDT Successfully opened file root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_252903.root >> cmd: Begin processing the 1001st record. Run 1, Event 210, LumiSection 19264 on stream 0 at 25-May-2021 02:07:00.327 EDT >> cmd: 25-May-2021 02:07:02 EDT Closed file root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_252903.root >> cmd: 25-May-2021 02:07:02 EDT Initiating request to open file file:MAOD-00000_423345.root >> cmd: 25-May-2021 02:07:02 EDT Successfully opened file file:MAOD-00000_423345.root >> cmd: 25-May-2021 02:07:08 EDT Closed file file:MAOD-00000_423345.root >> cmd: 25-May-2021 02:07:08 EDT Initiating request to open file root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_262402.root >> cmd: 25-May-2021 02:07:21 EDT Successfully opened file root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_262402.root >> cmd: 25-May-2021 02:07:58 EDT Closed file root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_262402.root >> cmd: >> cmd: TrigReport ---------- Event Summary ------------ >> cmd: TrigReport Events total = 1839 passed = 1839 failed = 0 >> cmd: >> cmd: TrigReport ---------- Path Summary ------------ >> cmd: TrigReport Trig Bit# Executed Passed Failed Error Name >> cmd: >> cmd: TrigReport -------End-Path Summary ------------ >> cmd: TrigReport Trig Bit# Executed Passed Failed Error Name >> cmd: TrigReport 0 0 1839 1839 0 0 end >> cmd: >> cmd: TrigReport ------ Modules in End-Path: end ------------ >> cmd: TrigReport Trig Bit# Visited Passed Failed Error Name >> cmd: TrigReport 0 0 1839 1839 0 0 out >> cmd: >> cmd: TrigReport ---------- Module Summary ------------ >> cmd: TrigReport Visited Executed Passed Failed Error Name >> cmd: TrigReport 1839 1839 1839 0 0 end >> cmd: TrigReport 1839 1839 1839 0 0 out >> cmd: >> cmd: TimeReport ---------- Event Summary ---[sec]---- >> cmd: TimeReport event loop CPU/event = 0.016316 >> cmd: TimeReport event loop Real/event = 0.160755 >> cmd: TimeReport sum Streams Real/event = 0.031239 >> cmd: TimeReport efficiency CPU/Real/thread = 0.101496 >> cmd: >> cmd: TimeReport ---------- Path Summary ---[Real sec]---- >> cmd: TimeReport per event per exec Name >> cmd: TimeReport per event per exec Name >> cmd: >> cmd: TimeReport -------End-Path Summary ---[Real sec]---- >> cmd: TimeReport per event per exec Name >> cmd: TimeReport 0.031149 0.031149 end >> cmd: TimeReport per event per exec Name >> cmd: >> cmd: TimeReport ------ Modules in End-Path: end ---[Real sec]---- >> cmd: TimeReport per event per visit Name >> cmd: TimeReport 0.000090 0.000090 out >> cmd: TimeReport per event per visit Name >> cmd: >> cmd: TimeReport ---------- Module Summary ---[Real sec]---- >> cmd: TimeReport per event per exec per visit Name >> cmd: TimeReport 0.000002 0.000002 0.000002 end >> cmd: TimeReport 0.000090 0.000090 0.000090 out >> cmd: TimeReport per event per exec per visit Name >> cmd: >> cmd: T---Report end! >> cmd: >> cmd: TimeReport> Time report complete in 495.223 seconds >> cmd: Time Summary: >> cmd: - Min event: 0.00979805 >> cmd: - Max event: 16.5728 >> cmd: - Avg event: 0.0311528 >> cmd: - Total loop: 292.169 >> cmd: - Total init: 199.581 >> cmd: - Total job: 495.223 >> cmd: - EventSetup Lock: 0 >> cmd: - EventSetup Get: 0 >> cmd: Event Throughput: 6.29431 ev/s >> cmd: CPU Summary: >> cmd: - Total loop: 58.466 >> cmd: - Total init: 7.20619 >> cmd: - Total extra: 0 >> cmd: - Total job: 69.086 >> cmd: Processing Summary: >> cmd: - Number of Events: 1839 >> cmd: - Number of Global Begin Lumi Calls: 10 >> cmd: - Number of Global Begin Run Calls: 10 >> cmd: >> cmd: >> cmd: ============================================= >> cmd: >> cmd: MessageLogger Summary >> cmd: >> cmd: type category sev module subroutine count total >> cmd: ---- -------------------- -- ---------------- ---------------- ----- ----- >> cmd: 1 XrdAdaptorInternal -w file_open 1 1 >> cmd: 2 TimeReport -e AfterModEndJob 1 1 >> cmd: 3 fileAction -s file_close 4 4 >> cmd: 4 fileAction -s file_open 8 8 >> cmd: >> cmd: type category Examples: run/evt run/evt run/evt >> cmd: ---- -------------------- ---------------- ---------------- ---------------- >> cmd: 1 XrdAdaptorInternal pre-events >> cmd: 2 TimeReport PostGlobalEndRun >> cmd: 3 fileAction PostProcessEvent PostProcessEvent PostGlobalEndRun >> cmd: 4 fileAction pre-events pre-events PostProcessEvent >> cmd: >> cmd: Severity # Occurrences Total Occurrences >> cmd: -------- ------------- ----------------- >> cmd: Warning 1 1 >> cmd: Error 1 1 >> cmd: System 12 12 >> cmd: >> cmd: dropped waiting message count 0 >>> executable returned with exit code 0. @ Tue May 25 02:08:02 2021 >>> epilogue @ Tue May 25 02:08:15 2021 >>> executing 'python merge_reports.py report.json 0026_2402_report.json 0024_5241_report.json 0025_2903_report.json 0042_3345_report.json' @ Tue May 25 02:08:15 2021 >> using /disk/vc3-root/tmp/worker-230547-6660/t.425221/cctools-temp-t.425221.4PhZhS/tmpz69rkz to store command output >> cmd: >> merging 0026_2402_report.json >> cmd: >> merging 0024_5241_report.json >> cmd: >> merging 0025_2903_report.json >> cmd: >> merging 0042_3345_report.json >>> executing 'timeout 300 hdfs dfs -fs hdfs://eddie.crc.nd.edu:19000 -put MAOD-00000.root /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_425221.root' @ Tue May 25 02:08:24 2021 >> using /disk/vc3-root/tmp/worker-230547-6660/t.425221/cctools-temp-t.425221.4PhZhS/tmprdnjRT to store command output >> cmd: timeout: failed to run command 'hdfs': No such file or directory >>> Checking output file transfer. @ Tue May 25 02:08:24 2021 >>> executing 'env XRD_LOGLEVEL=Debug xrdcp MAOD-00000.root root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_425221.root' @ Tue May 25 02:08:24 2021 >> using /disk/vc3-root/tmp/worker-230547-6660/t.425221/cctools-temp-t.425221.4PhZhS/tmpi6nRgP to store command output >> cmd: [2021-05-25 02:08:24.470376 -0400][Warning][Utility ] Unable to process global config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 02:08:24.471429 -0400][Debug ][Utility ] Unable to process user config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 02:08:24.471619 -0400][Debug ][PlugInMgr ] Initializing plug-in manager... >> cmd: [2021-05-25 02:08:24.471668 -0400][Debug ][PlugInMgr ] No default plug-in, loading plug-in configs... >> cmd: [2021-05-25 02:08:24.471709 -0400][Debug ][PlugInMgr ] Processing plug-in definitions in /etc/xrootd/client.plugins.d... >> cmd: [2021-05-25 02:08:24.471794 -0400][Debug ][PlugInMgr ] Unable to process directory /etc/xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 02:08:24.472131 -0400][Debug ][PlugInMgr ] Processing plug-in definitions in /tmp/runos_singularity_home-224046566519442716283870413672516026873/.xrootd/client.plugins.d... >> cmd: [2021-05-25 02:08:24.472226 -0400][Debug ][PlugInMgr ] Unable to process directory /tmp/runos_singularity_home-224046566519442716283870413672516026873/.xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 02:08:24.472547 -0400][Debug ][Poller ] Available pollers: built-in >> cmd: [2021-05-25 02:08:24.472591 -0400][Debug ][Poller ] Attempting to create a poller according to preference: built-in >> cmd: [2021-05-25 02:08:24.472629 -0400][Debug ][Poller ] Creating poller: built-in >> cmd: [2021-05-25 02:08:24.472676 -0400][Debug ][Poller ] Creating and starting the built-in poller... >> cmd: [2021-05-25 02:08:24.473108 -0400][Debug ][Poller ] Using 1 poller threads >> cmd: [2021-05-25 02:08:24.473164 -0400][Debug ][TaskMgr ] Starting the task manager... >> cmd: [2021-05-25 02:08:24.473375 -0400][Debug ][TaskMgr ] Task manager started >> cmd: [2021-05-25 02:08:24.473477 -0400][Debug ][JobMgr ] Starting the job manager... >> cmd: [2021-05-25 02:08:24.474004 -0400][Debug ][JobMgr ] Job manager started, 3 workers >> cmd: [2021-05-25 02:08:24.474100 -0400][Debug ][TaskMgr ] Registering task: "FileTimer task" to be run at: [2021-05-25 02:08:24 -0400] >> cmd: [2021-05-25 02:08:24.474210 -0400][Debug ][PostMaster ] Creating new channel to: deepthought.crc.nd.edu:1094 1 stream(s) >> cmd: [2021-05-25 02:08:24.474306 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-05-25 02:08:24.475578 -0400][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" to be run at: [2021-05-25 02:08:39 -0400] >> cmd: [2021-05-25 02:08:24.476811 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 02:08:24.477037 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 02:08:24.477164 -0400][Debug ][Poller ] Adding socket 0xcba060 to the poller >> cmd: [2021-05-25 02:10:31.736264 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2021-05-25 02:10:31.736509 -0400][Error ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Unable to connect: Connection timed out >> cmd: [2021-05-25 02:10:31.736594 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-05-25 02:10:31.736686 -0400][Debug ][Poller ] <--> Removing socket from the poller >> cmd: [2021-05-25 02:10:31.736928 -0400][Error ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] elapsed = 127, pConnectionWindow = 120 seconds. >> cmd: [2021-05-25 02:10:31.739240 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 02:10:31.739570 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 02:10:31.739743 -0400][Debug ][Poller ] Adding socket 0xcba060 to the poller >> cmd: [2021-05-25 02:12:32.133272 -0400][Error ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Socket error while handshaking: [ERROR] Socket timeout >> cmd: [2021-05-25 02:12:32.133449 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-05-25 02:12:32.133536 -0400][Debug ][Poller ] <--> Removing socket from the poller >> cmd: [2021-05-25 02:12:32.133734 -0400][Error ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] elapsed = 121, pConnectionWindow = 120 seconds. >> cmd: [2021-05-25 02:12:32.135279 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 02:12:32.135551 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 02:12:32.135707 -0400][Debug ][Poller ] Adding socket 0xcba060 to the poller >> cmd: [2021-05-25 02:14:39.416136 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2021-05-25 02:14:39.416374 -0400][Error ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Unable to connect: Connection timed out >> cmd: [2021-05-25 02:14:39.416466 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-05-25 02:14:39.416545 -0400][Debug ][Poller ] <--> Removing socket from the poller >> cmd: [2021-05-25 02:14:39.416755 -0400][Error ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] elapsed = 127, pConnectionWindow = 120 seconds. >> cmd: [2021-05-25 02:14:39.418609 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 02:14:39.418879 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 02:14:39.419048 -0400][Debug ][Poller ] Adding socket 0xcba060 to the poller >> cmd: [2021-05-25 02:16:46.648161 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2021-05-25 02:16:46.648432 -0400][Error ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Unable to connect: Connection timed out >> cmd: [2021-05-25 02:16:46.648524 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-05-25 02:16:46.648601 -0400][Debug ][Poller ] <--> Removing socket from the poller >> cmd: [2021-05-25 02:16:46.648813 -0400][Error ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] elapsed = 127, pConnectionWindow = 120 seconds. >> cmd: [2021-05-25 02:16:46.650628 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 02:16:46.650889 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 02:16:46.651045 -0400][Debug ][Poller ] Adding socket 0xcba060 to the poller >> cmd: [2021-05-25 02:18:53.880139 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2021-05-25 02:18:53.880425 -0400][Error ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Unable to connect: Connection timed out >> cmd: [2021-05-25 02:18:53.880524 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-05-25 02:18:53.880610 -0400][Debug ][Poller ] <--> Removing socket from the poller >> cmd: [2021-05-25 02:18:53.880849 -0400][Error ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] elapsed = 127, pConnectionWindow = 120 seconds. >> cmd: [2021-05-25 02:18:53.880936 -0400][Error ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Unable to recover: [ERROR] Connection error. >> cmd: [2021-05-25 02:18:53.881045 -0400][Error ][XRootD ] [deepthought.crc.nd.edu:1094] Impossible to send message kXR_stat (path: /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_425221.root, flags: none). Trying to recover. >> cmd: [2021-05-25 02:18:53.881166 -0400][Debug ][XRootD ] [deepthought.crc.nd.edu:1094] Handling error while processing kXR_stat (path: /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_425221.root, flags: none): [FATAL] Connection error. >> cmd: [2021-05-25 02:18:53.882097 -0400][Debug ][Utility ] CopyProcess: 2 jobs to prepare >> cmd: [2021-05-25 02:18:53.882338 -0400][Error ][XRootD ] [deepthought.crc.nd.edu:1094] Unable to send the message kXR_stat (path: /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_425221.root, flags: none): [FATAL] Connection error >> cmd: Prepare: [FATAL] Connection error >> cmd: [2021-05-25 02:18:53.945815 -0400][Debug ][JobMgr ] Stopping the job manager... >> cmd: [2021-05-25 02:18:53.947781 -0400][Debug ][JobMgr ] Job manager stopped >> cmd: [2021-05-25 02:18:53.947894 -0400][Debug ][TaskMgr ] Stopping the task manager... >> cmd: [2021-05-25 02:18:53.948311 -0400][Debug ][TaskMgr ] Task manager stopped >> cmd: [2021-05-25 02:18:53.948390 -0400][Debug ][Poller ] Stopping the poller... >> cmd: [2021-05-25 02:18:53.948899 -0400][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" >> cmd: [2021-05-25 02:18:53.949000 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-05-25 02:18:53.949092 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Destroying stream >> cmd: [2021-05-25 02:18:53.949177 -0400][Debug ][Utility ] Monitor library name not set. No monitoring >> cmd: [2021-05-25 02:18:53.949232 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >>> Checking output file transfer. @ Tue May 25 02:18:53 2021 >>> executing '/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin/gfal-copy -f file:///disk/vc3-root/tmp/worker-230547-6660/t.425221/MAOD-00000.root gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_425221.root' @ Tue May 25 02:18:53 2021 >> using /disk/vc3-root/tmp/worker-230547-6660/t.425221/cctools-temp-t.425221.4PhZhS/tmp2xoUk3 to store command output >> cmd: gfal-copy error: 70 (Communication error on send) - globus_xio: Unable to connect to deepthought.crc.nd.edu:2811 globus_xio: System error in connect: Connection timed out globus_xio: A system call failed: Connection timed out >> cmd: Copying 254697594 bytes file:///disk/vc3-root/tmp/worker-230547-6660/t.425221/MAOD-00000.root => gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_425221.root >>> Checking output file transfer. @ Tue May 25 02:25:16 2021 >>> executing '/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin/gfal-copy -f file:///disk/vc3-root/tmp/worker-230547-6660/t.425221/MAOD-00000.root gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_425221.root' @ Tue May 25 02:25:16 2021 >> using /disk/vc3-root/tmp/worker-230547-6660/t.425221/cctools-temp-t.425221.4PhZhS/tmpFX5i5F to store command output >> cmd: gfal-copy error: 70 (Communication error on send) - globus_xio: Unable to connect to deepthought.crc.nd.edu:2811 globus_xio: System error in connect: Connection timed out globus_xio: A system call failed: Connection timed out >> cmd: Copying 254697594 bytes file:///disk/vc3-root/tmp/worker-230547-6660/t.425221/MAOD-00000.root => gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch3/postLHE_step/v1/mAOD_step_ttHJet_all22WCsStartPtCheckdim6TopMay20GST_run0/MAOD-00000_425221.root >>> Checking output file transfer. @ Tue May 25 02:31:39 2021 >> trace: Traceback (most recent call last): >> trace: File "task.py", line 268, in wrapper >> trace: result = fct(data, *args, **kwargs) >> trace: File "task.py", line 821, in copy_outputs >> trace: raise RuntimeError("no stage-out method succeeded") >> trace: RuntimeError: no stage-out method succeeded >>>>> call to 'copy_outputs' failed, exiting with exit code 210 @ Tue May 25 02:31:39 2021 Tue May 25 01:59:44 2021: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Tue May 25 01:59:44 2021: ApMon[WARNING]: Not sending parameters since no destination is defined. Tue May 25 01:59:44 2021: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. Tue May 25 02:08:02 2021: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Tue May 25 02:08:02 2021: ApMon[WARNING]: Not sending parameters since no destination is defined. Tue May 25 02:08:02 2021: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. >> Execution time 2063 >> Exiting with code 210 >> Reporting ExeExitCode 0 >> Reporting StageOutSE >> Reporting StageOutExitCode 210 Tue May 25 02:31:39 2021: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Tue May 25 02:31:40 2021: ApMon[WARNING]: Not sending parameters since no destination is defined. Tue May 25 02:31:40 2021: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. ==== working directory after execution @ Tue May 25 02:31:40 EDT 2021 ==== == dir: total 276204 == dir: -rwxr-xr-x 2 kmohrman campus 1576 May 25 01:56 0024_5241_report.json == dir: -rwxr-xr-x 2 kmohrman campus 1578 May 25 01:56 0025_2903_report.json == dir: -rwxr-xr-x 2 kmohrman campus 1570 May 25 01:56 0026_2402_report.json == dir: -rwxr-xr-x 2 kmohrman campus 1435 May 25 01:56 0042_3345_report.json == dir: drwxr-xr-x 18 kmohrman campus 215 May 25 01:57 CMSSW_10_6_20 == dir: -rw-r--r-- 1 kmohrman campus 254697594 May 25 02:08 MAOD-00000.root == dir: -rwxr-xr-x 1 kmohrman campus 27137616 May 25 01:59 MAOD-00000_423345.root == dir: drwxr-xr-x 2 kmohrman campus 71 May 25 01:56 bin == dir: -rwxr-xr-x 5 kmohrman campus 627272 May 24 21:03 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 May 25 01:56 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 May 25 02:31 cctools-temp-t.425221.4PhZhS == dir: -rw------- 1 kmohrman campus 51 May 25 01:57 cvmfschecksum.cms-ib.cern.ch == dir: -rw------- 1 kmohrman campus 51 May 25 01:57 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 May 25 01:57 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 May 25 01:56 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 May 25 01:56 librmonitor_helper.so.LqxmwG == dir: -rw-r--r-- 2 kmohrman campus 868 May 25 01:56 merge_cfg.py == dir: -rw-r--r-- 1 kmohrman campus 2381 May 25 01:59 merge_cfg_mod.py == dir: -rw-r--r-- 2 kmohrman campus 808 May 25 01:56 merge_reports.py == dir: -rw-r--r-- 2 kmohrman campus 2471 May 25 01:56 parameters.json == dir: -rw------- 2 kmohrman campus 9917 May 25 01:56 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 May 25 01:56 python == dir: -rw-r--r-- 1 kmohrman campus 2806 May 25 02:31 report.json == dir: -rw-r--r-- 5 kmohrman campus 570 May 24 21:03 report.json.in == dir: -rw-r--r-- 1 kmohrman campus 68247 May 25 02:08 report.xml == dir: -rw-r--r-- 1 kmohrman campus 5197 May 25 02:31 report.xml.gz == dir: -rw-r--r-- 2 kmohrman campus 549 May 24 23:31 sandbox-CMSSW_10_6_20-slc7_amd64_gcc700.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 37 May 25 01:56 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 May 25 01:57 t_wrapper_ready == dir: -rw-r--r-- 1 kmohrman campus 11 May 25 01:57 t_wrapper_start == dir: -rwxr-xr-x 5 kmohrman campus 47217 May 24 21:03 task.py == dir: -rwxr-xr-x 5 kmohrman campus 5986 May 24 21:03 wrapper.sh === wrapper done @ Tue May 25 02:31:41 EDT 2021 === final return status = 210 @ Tue May 25 02:31:41 EDT 2021