==== wrapper started @ Tue May 25 16:30:27 EDT 2021 ==== == startup: hostname: da-1080-005.crc.nd.edu == startup: kernel: Linux da-1080-005.crc.nd.edu 3.10.0-1160.el7.x86_64 #1 SMP Tue Aug 18 14:50:17 EDT 2020 x86_64 x86_64 x86_64 GNU/Linux ==== tracing google @ Tue May 25 16:30:32 EDT 2021 ==== wrapper.sh: line 20: traceroute: command not found ==== environment at startup @ Tue May 25 16:30:37 EDT 2021 ==== == env: VC3_VERSION_SED=4.2 == env: CCTOOLS_RESOURCE_PROCESS_START=1621974637468544 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: VC3_ROOT_GZIP=/usr/ == env: SHELL=/bin/sh == env: TERM=xterm-256color == env: MAKEFLAGS=-j4 == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-15795/t.229067/cctools-temp-t.229067.gL72J9 == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-15795/t.229067/librmonitor_helper.so.GJwIO0 == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: USER=kmohrman == env: TEMP=/disk/vc3-root/tmp/worker-230547-15795/t.229067/cctools-temp-t.229067.gL72J9 == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: LD_LIBRARY_PATH=/.singularity.d/libs == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_ROOT_MAKE=/usr/ == env: VC3_DISTFILES=/disk/vc3-distfiles == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-15795/cache/tmp == env: VC3_VERSION_TAR=1.26 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-D2yoRx == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: VC3_VERSION_GZIP=1.5 == env: VC3_ENV_TAG_GLOBAL=15541 == env: PATH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-D2yoRx == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PWD=/disk/vc3-root/tmp/worker-230547-15795/t.229067 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_FULL_SED=4.2.2 == env: VC3_VERSION_WHICH=2.20 == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-15795 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_ROOT_SED=/usr/ == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: CXX=g++ == env: SHLVL=3 == env: HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_MAKE=3.82 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: DISK=3000 == env: MEMORY=5000 == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: TMP=/disk/vc3-root/tmp/worker-230547-15795/t.229067/cctools-temp-t.229067.gL72J9 == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_VERSION_PKG_CONFIG=0.27 == env: VC3_ROOT_TAR=/usr/ == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-D2yoRx.wrapper == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: CC=gcc == env: CORES=3 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CCTOOLS_RESOURCE_MONITOR_INFO=1024 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_CRC_b4_postLHE.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=15353 == env: _=/usr/bin/env ==== cpu info @ Tue May 25 16:30:42 EDT 2021 ==== == cpu: processor : 0 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU E5645 @ 2.40GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1600.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 0 == cpu: cpu cores : 6 == cpu: apicid : 0 == cpu: initial apicid : 0 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4798.69 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 1 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU E5645 @ 2.40GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2400.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 0 == cpu: cpu cores : 6 == cpu: apicid : 32 == cpu: initial apicid : 32 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4805.13 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 2 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU E5645 @ 2.40GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1600.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 8 == cpu: cpu cores : 6 == cpu: apicid : 16 == cpu: initial apicid : 16 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4798.69 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 3 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU E5645 @ 2.40GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2400.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 8 == cpu: cpu cores : 6 == cpu: apicid : 48 == cpu: initial apicid : 48 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4805.13 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 4 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU E5645 @ 2.40GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2400.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 2 == cpu: cpu cores : 6 == cpu: apicid : 4 == cpu: initial apicid : 4 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4798.69 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 5 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU E5645 @ 2.40GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2400.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 2 == cpu: cpu cores : 6 == cpu: apicid : 36 == cpu: initial apicid : 36 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4805.13 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 6 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU E5645 @ 2.40GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1600.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 10 == cpu: cpu cores : 6 == cpu: apicid : 20 == cpu: initial apicid : 20 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4798.69 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 7 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU E5645 @ 2.40GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1880.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 10 == cpu: cpu cores : 6 == cpu: apicid : 52 == cpu: initial apicid : 52 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4805.13 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 8 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU E5645 @ 2.40GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2400.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 1 == cpu: cpu cores : 6 == cpu: apicid : 2 == cpu: initial apicid : 2 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4798.69 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 9 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU E5645 @ 2.40GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1640.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 1 == cpu: cpu cores : 6 == cpu: apicid : 34 == cpu: initial apicid : 34 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4805.13 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 10 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU E5645 @ 2.40GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2400.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 9 == cpu: cpu cores : 6 == cpu: apicid : 18 == cpu: initial apicid : 18 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4798.69 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 11 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU E5645 @ 2.40GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2040.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 9 == cpu: cpu cores : 6 == cpu: apicid : 50 == cpu: initial apicid : 50 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4805.13 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: === using CVMFS proxy: http://eddie.crc.nd.edu:3128 @ Tue May 25 16:31:07 EDT 2021 === using Frontier proxy: http://eddie.crc.nd.edu:3128 @ Tue May 25 16:31:07 EDT 2021 === parrot helper: /disk/vc3-root/tmp/worker-230547-15795/t.229067/lib/libparrot_helper.so @ Tue May 25 16:31:12 EDT 2021 ==== content of /disk/vc3-root/tmp/worker-230547-15795/cache/tmp @ Tue May 25 16:31:12 EDT 2021 ==== == cache: total 28 == cache: drwx------ 261 kmohrman campus 8192 May 25 16:30 ex_parrot_kmohrman == cache: -rw-r--r-- 1 kmohrman campus 10 May 25 14:55 hot_cache == cache: drwxr-x--- 260 kmohrman campus 8192 May 25 12:53 cvmfs === OSG certificate location: /cvmfs/oasis.opensciencegrid.org/mis/certificates @ Tue May 25 16:31:17 EDT 2021 === testing parrot usage @ Tue May 25 16:31:17 EDT 2021 === parrot OK @ Tue May 25 16:31:22 EDT 2021 === starting parrot to access CMSSW... @ Tue May 25 16:31:22 EDT 2021 ==== wrapper started @ Tue May 25 16:31:22 EDT 2021 ==== == startup: hostname: da-1080-005.crc.nd.edu == startup: kernel: Linux da-1080-005.crc.nd.edu 3.10.0-1160.el7.x86_64 #1 SMP Tue Aug 18 14:50:17 EDT 2020 x86_64 x86_64 x86_64 GNU/Linux ==== tracing google @ Tue May 25 16:31:22 EDT 2021 ==== wrapper.sh: line 20: traceroute: command not found ==== environment at startup @ Tue May 25 16:31:23 EDT 2021 ==== == env: VC3_VERSION_SED=4.2 == env: CCTOOLS_RESOURCE_PROCESS_START=1621974683005558 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/usr/ == env: LOBSTER_GFAL_COPY= == env: MAKEFLAGS=-j4 == env: PARROT_HELPER=/disk/vc3-root/tmp/worker-230547-15795/t.229067/lib/libparrot_helper.so == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-15795/t.229067/cctools-temp-t.229067.gL72J9 == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-15795/t.229067/librmonitor_helper.so.GJwIO0 == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: LD_LIBRARY_PATH=/.singularity.d/libs:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-15795/t.229067/cctools-temp-t.229067.gL72J9 == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/usr/ == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-D2yoRx == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-15795/cache/tmp == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: PARROT_CVMFS_REPO= == env: VC3_VERSION_GZIP=1.5 == env: PATH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ENV_TAG_GLOBAL=15541 == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-D2yoRx == env: PWD=/disk/vc3-root/tmp/worker-230547-15795/t.229067 == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_WHICH=2.20 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: LOBSTER_LCG_CP= == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-15795 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/usr/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: CXX=g++ == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: DISK=3000 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-15795/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-15795/cache/tmp/cvmfs == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=5000 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TMP=/disk/vc3-root/tmp/worker-230547-15795/t.229067/cctools-temp-t.229067.gL72J9 == env: PYTHONPATH=python: == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_ROOT_TAR=/usr/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-D2yoRx.wrapper == env: CC=gcc == env: CCTOOLS_RESOURCE_MONITOR_INFO=1024 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=3 == env: PARROT_DEBUG_FLAGS= == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_CRC_b4_postLHE.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=15353 == env: _=/usr/bin/env ==== cpu info @ Tue May 25 16:31:23 EDT 2021 ==== == cpu: processor : 0 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU E5645 @ 2.40GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2152.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 0 == cpu: cpu cores : 6 == cpu: apicid : 0 == cpu: initial apicid : 0 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4798.69 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 1 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU E5645 @ 2.40GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2304.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 0 == cpu: cpu cores : 6 == cpu: apicid : 32 == cpu: initial apicid : 32 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4805.13 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 2 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU E5645 @ 2.40GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1640.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 8 == cpu: cpu cores : 6 == cpu: apicid : 16 == cpu: initial apicid : 16 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4798.69 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 3 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU E5645 @ 2.40GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1616.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 8 == cpu: cpu cores : 6 == cpu: apicid : 48 == cpu: initial apicid : 48 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4805.13 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 4 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU E5645 @ 2.40GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1704.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 2 == cpu: cpu cores : 6 == cpu: apicid : 4 == cpu: initial apicid : 4 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4798.69 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 5 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU E5645 @ 2.40GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1600.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 2 == cpu: cpu cores : 6 == cpu: apicid : 36 == cpu: initial apicid : 36 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4805.13 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 6 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU E5645 @ 2.40GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 2112.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 10 == cpu: cpu cores : 6 == cpu: apicid : 20 == cpu: initial apicid : 20 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4798.69 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 7 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU E5645 @ 2.40GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1616.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 10 == cpu: cpu cores : 6 == cpu: apicid : 52 == cpu: initial apicid : 52 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4805.13 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 8 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU E5645 @ 2.40GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1824.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 1 == cpu: cpu cores : 6 == cpu: apicid : 2 == cpu: initial apicid : 2 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4798.69 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 9 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU E5645 @ 2.40GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1608.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 1 == cpu: cpu cores : 6 == cpu: apicid : 34 == cpu: initial apicid : 34 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4805.13 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 10 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU E5645 @ 2.40GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1648.000 == cpu: cache size : 12288 KB == cpu: physical id : 0 == cpu: siblings : 6 == cpu: core id : 9 == cpu: cpu cores : 6 == cpu: apicid : 18 == cpu: initial apicid : 18 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4798.69 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: == cpu: processor : 11 == cpu: vendor_id : GenuineIntel == cpu: cpu family : 6 == cpu: model : 44 == cpu: model name : Intel(R) Xeon(R) CPU E5645 @ 2.40GHz == cpu: stepping : 2 == cpu: microcode : 0x1f == cpu: cpu MHz : 1696.000 == cpu: cache size : 12288 KB == cpu: physical id : 1 == cpu: siblings : 6 == cpu: core id : 9 == cpu: cpu cores : 6 == cpu: apicid : 50 == cpu: initial apicid : 50 == cpu: fpu : yes == cpu: fpu_exception : yes == cpu: cpuid level : 11 == cpu: wp : yes == cpu: flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid dtherm ida arat spec_ctrl intel_stibp flush_l1d == cpu: bogomips : 4805.13 == cpu: clflush size : 64 == cpu: cache_alignment : 64 == cpu: address sizes : 40 bits physical, 48 bits virtual == cpu: power management: == cpu: === using parrot @ Tue May 25 16:31:24 EDT 2021 === sourcing CMS setup @ Tue May 25 16:31:24 EDT 2021 LibCvmfs version 2.4, revision 25 === sourcing OSG setup @ Tue May 25 16:31:25 EDT 2021 ==== environment after sourcing startup scripts @ Tue May 25 16:31:25 EDT 2021 ==== == env: VC3_VERSION_SED=4.2 == env: MANPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/man:/cvmfs/cms.cern.ch/share/man: == env: CCTOOLS_RESOURCE_PROCESS_START=1621974685922290 == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: GFAL_PLUGIN_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/gfal2-plugins/ == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/usr/ == env: LOBSTER_GFAL_COPY=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin/gfal-copy == env: VOMS_USERCONF=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/vomses == env: MAKEFLAGS=-j4 == env: GLOBUS_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-15795/t.229067/cctools-temp-t.229067.gL72J9 == env: PERL5LIB=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5 == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: CVSROOT=:gserver:cmssw.cvs.cern.ch:/local/reps/CMSSW == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-15795/t.229067/librmonitor_helper.so.GJwIO0 == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: X509_CERT_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/certificates == env: SCRAM_ARCH=slc7_amd64_gcc820 == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: LD_LIBRARY_PATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/dcap:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/lcgdm:/.singularity.d/libs:lib:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-15795/t.229067/cctools-temp-t.229067.gL72J9 == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/usr/ == env: OSG_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-D2yoRx == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-15795/cache/tmp == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: SITECONFIG_PATH=/cvmfs/cms.cern.ch/SITECONF/local == env: PARROT_CVMFS_REPO= == env: VC3_VERSION_GZIP=1.5 == env: PATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/sbin:/cvmfs/cms.cern.ch/common:/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ENV_TAG_GLOBAL=15541 == env: CMS_PATH=/cvmfs/cms.cern.ch == env: VC3_ROOT=/disk/vc3-root == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-D2yoRx == env: PWD=/disk/vc3-root/tmp/worker-230547-15795/t.229067 == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: VC3_VERSION_WHICH=2.20 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: X509_VOMS_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/vomsdir == env: LOBSTER_LCG_CP= == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-15795 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/usr/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: CXX=g++ == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: DISK=3000 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-15795/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-15795/cache/tmp/cvmfs == env: GFAL_CONFIG_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/gfal2.d/ == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=5000 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TMP=/disk/vc3-root/tmp/worker-230547-15795/t.229067/cctools-temp-t.229067.gL72J9 == env: PYTHONPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib/python2.7/site-packages:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/python2.7/site-packages:python:python: == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: VC3_ROOT_TAR=/usr/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-D2yoRx.wrapper == env: CC=gcc == env: CCTOOLS_RESOURCE_MONITOR_INFO=1024 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=3 == env: PARROT_DEBUG_FLAGS= == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_CRC_b4_postLHE.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=15353 == env: _=/usr/bin/env ==== proxy information @ Tue May 25 16:31:26 EDT 2021 ==== == proxy: subject : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman/CN=661123957 == proxy: issuer : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman == proxy: identity : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=kmohrman/CN=825714/CN=Kelci Ann Mohrman == proxy: type : RFC compliant proxy == proxy: strength : 1024 bits == proxy: path : proxy == proxy: timeleft : 136:17:53 ==== working directory at startup @ Tue May 25 16:31:26 EDT 2021 ==== == dir: total 860 == dir: -rw-r--r-- 2 kmohrman campus 4482 May 25 16:30 UL18_RECO_cfg.py == dir: drwxr-xr-x 2 kmohrman campus 71 May 25 16:30 bin == dir: -rwxr-xr-x 3 kmohrman campus 627272 May 25 12:52 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 May 25 16:30 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 May 25 16:30 cctools-temp-t.229067.gL72J9 == dir: -rw------- 1 kmohrman campus 51 May 25 16:31 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 May 25 16:31 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 May 25 16:30 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 May 25 16:30 librmonitor_helper.so.GJwIO0 == dir: -rw-r--r-- 2 kmohrman campus 2152 May 25 16:30 parameters.json == dir: -rw------- 2 kmohrman campus 9917 May 25 16:30 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 May 25 16:30 python == dir: -rw-r--r-- 3 kmohrman campus 570 May 25 12:52 report.json.in == dir: -rw-r--r-- 3 kmohrman campus 593 May 25 12:52 sandbox-CMSSW_10_6_17_patch1-slc7_amd64_gcc700.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 37 May 25 16:30 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 May 25 16:31 t_wrapper_start == dir: -rwxr-xr-x 3 kmohrman campus 47217 May 25 12:52 task.py == dir: -rwxr-xr-x 3 kmohrman campus 5986 May 25 12:52 wrapper.sh === creating new release CMSSW_10_6_17_patch1 for scram arch slc7_amd64_gcc700 @ Tue May 25 16:31:26 EDT 2021 WARNING: In non-interactive mode release checks e.g. deprecated releases, production architectures are disabled. === unpacking sandbox-CMSSW_10_6_17_patch1-slc7_amd64_gcc700.tar.bz2 @ Tue May 25 16:31:31 EDT 2021 ==== machine load @ Tue May 25 16:31:34 EDT 2021 ==== top: unknown option 'M' Usage: top -hv | -bcHiOSs -d secs -n max -u|U user -p pid(s) -o field -w [cols] ==== environment before execution @ Tue May 25 16:31:34 EDT 2021 ==== == env: G4LEVELGAMMADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4PhotonEvaporation/5.2/data/PhotonEvaporation5.2 == env: UTM_XSD_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj == env: SRT_G4LEVELGAMMADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4PhotonEvaporation/5.2/data/PhotonEvaporation5.2 == env: VC3_VERSION_SED=4.2 == env: CMSSW_RELEASE_BASE=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1 == env: SCRAMRT_SET=CMSSW:CMSSW_10_6_17_patch1:slc7_amd64_gcc700:V2_2_9_pre13:SRT_ == env: MANPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/man:/cvmfs/cms.cern.ch/share/man: == env: CCTOOLS_RESOURCE_PROCESS_START=1621974694982351 == env: CMSSW_FWLITE_INCLUDE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include == env: SRT_GCC_RUNTIME_ASAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: VC3_INSIDE_WRAPPER_SCRIPT=yes == env: ROOT_INCLUDE_PATH=/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/include/slc7_amd64_gcc700/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/include/LCG:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mctester/1.25.0a-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dd4hep/v01-10x-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtDesigner:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauolapp/1.1.5-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/charybdis/1.003-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include/SHERPA-MC:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtOpenGL:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtGui:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwig/6.521-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt3Support:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lwtnn/2.4-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4/10.4.3-pafccj2/include/Geant4:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/classlib/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cgal/4.2-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tkonlinesw/4.2.0-1_gcc7-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/starlight/r193-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtCore:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtXml:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mcdb/1.0.3-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libungif/4.1.4-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libtiff/4.0.3-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/highfive/2.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libpng/1.6.16-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pcre/8.37-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/include/xrootd/private:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/vdt/0.4.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/toprex/4.23-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tbb/2019_U3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauola/27.121.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sigcpp/2.6.2-pafccj/include/sigc++-2.0:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sqlite/3.22.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/protobuf/3.5.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pacparser/1.3.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/oracle/12.1.0.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/py2-numpy/1.16.2-nmpfii2/c-api/core/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/meschach/1.2.pCMS1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libuuid/2.22.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libunwind/1.2.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libhepml/0.2.1-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ktjet/1.06-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jimmy/4.2-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jemalloc/5.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hls/2019.08/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj10:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hector/1.3.4_patch1-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libjpeg-turbo/2.0.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/giflib/4.2.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gsl/2.2.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gdbm/1.10-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/freetype/2.5.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftw3/3.3.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftjet/1.5.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/expat/2.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dpm/1.8.0.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vecgeom/v00.05.00-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xerces-c/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xz/5.2.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dcap/2.47.8-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libxml2/2.9.1-pafccj/include/libxml2:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/curl/7.59.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cppunit/1.40.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openssl/1.0.2d-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia6/426-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/photos/215.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/zlib-x86_64/1.2.11-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/bz2lib/1.0.6-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/include/python2.7:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tinyxml2/6.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ittnotify/16.06.18-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj/include:/usr/local/include:/usr/include == env: INTEL_LICENSE_FILE=28518@lxlicen01.cern.ch,28518@lxlicen02.cern.ch,28518@lxlicen03.cern.ch == env: SRT_TEXMFHOME_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/share/Rivet/texmf == env: SRT_GEANT4_PARFULLCMS_CONFIG_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-parfullcms/2014.01.27-pafccj2/share/ParFullCMS == env: GFAL_PLUGIN_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/gfal2-plugins/ == env: PARROT_HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: TERM=xterm-256color == env: SHELL=/bin/sh == env: VC3_ROOT_GZIP=/usr/ == env: LOBSTER_GFAL_COPY=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin/gfal-copy == env: PDFPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/share == env: CMSSW_FULL_RELEASE_BASE=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17 == env: SRT_TNS_ADMIN_SCRAMRTDEL=/etc == env: VOMS_USERCONF=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/vomses == env: MAKEFLAGS=-j4 == env: ROOT_GCC_TOOLCHAIN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: GLOBUS_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr == env: TMPDIR=/disk/vc3-root/tmp/worker-230547-15795/t.229067/cctools-temp-t.229067.gL72J9 == env: G4FORCENUMBEROFTHREADS=max == env: OPENBLAS_NUM_THREADS=1 == env: SRT_PDFPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/share == env: PERL5LIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/share/perl5:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5/vendor_perl:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/perl5 == env: VC3_ROOT_WHICH=/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0 == env: CMSSW_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms == env: LHAPDF_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/share/LHAPDF == env: CVSROOT=:gserver:cmssw.cvs.cern.ch:/local/reps/CMSSW == env: LD_PRELOAD=/disk/vc3-root/tmp/worker-230547-15795/t.229067/librmonitor_helper.so.GJwIO0 == env: LOBSTER_CVMFS_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_PATH=./bin == env: CMSSW_GIT_HASH=CMSSW_10_6_17_patch1 == env: SRT_G4ABLADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ABLA/3.0/data/G4ABLA3.0 == env: QTDIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2 == env: SRT_SCONS_LIB_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/scons/3.0.1-pafccj/lib == env: OLDPWD=/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1 == env: LOBSTER_FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: G4NEUTRONXSDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NEUTRONXS/1.4/data/G4NEUTRONXS1.4 == env: QTINC=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include == env: X509_CERT_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/certificates == env: SCRAM_ARCH=slc7_amd64_gcc700 == env: GIT_SSL_CAINFO=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/ssl/certs/ca-bundle.crt == env: SRT_CMS_OPENLOOPS_PREFIX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openloops/2.1.0-pafccj2 == env: SRT_GIT_EXEC_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/libexec/git-core == env: SRT_THEPEGPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj/share/ThePEG == env: LOBSTER_CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: ROOT_TTREECACHE_SIZE=0 == env: EVTGENDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/evtgen/1.6.0-pafccj5/share == env: SRT_INTEL_LICENSE_FILE_SCRAMRTDEL=28518@lxlicen01.cern.ch,28518@lxlicen02.cern.ch,28518@lxlicen03.cern.ch == env: SRT_ROOT_INCLUDE_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/include/slc7_amd64_gcc700/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/include/LCG:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mctester/1.25.0a-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dd4hep/v01-10x-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtDesigner:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauolapp/1.1.5-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/charybdis/1.003-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include/SHERPA-MC:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtOpenGL:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtGui:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwig/6.521-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt3Support:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lwtnn/2.4-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4/10.4.3-pafccj2/include/Geant4:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/classlib/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cgal/4.2-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tkonlinesw/4.2.0-1_gcc7-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/starlight/r193-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/Qt:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtCore:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include/QtXml:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/mcdb/1.0.3-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libungif/4.1.4-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libtiff/4.0.3-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/highfive/2.0/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libpng/1.6.16-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pcre/8.37-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/include/xrootd/private:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/vdt/0.4.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/toprex/4.23-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tbb/2019_U3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tauola/27.121.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sigcpp/2.6.2-pafccj/include/sigc++-2.0:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sqlite/3.22.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/protobuf/3.5.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pacparser/1.3.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/oracle/12.1.0.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/py2-numpy/1.16.2-nmpfii2/c-api/core/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/meschach/1.2.pCMS1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libuuid/2.22.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libunwind/1.2.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libhepml/0.2.1-pafccj/interface:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ktjet/1.06-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jimmy/4.2-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/jemalloc/5.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hls/2019.08/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj10:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hector/1.3.4_patch1-pafccj8/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libjpeg-turbo/2.0.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/giflib/4.2.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gsl/2.2.1-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gdbm/1.10-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/freetype/2.5.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftw3/3.3.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fftjet/1.5.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/expat/2.1.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dpm/1.8.0.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vecgeom/v00.05.00-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xerces-c/3.1.3-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xz/5.2.2-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/dcap/2.47.8-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/libxml2/2.9.1-pafccj/include/libxml2:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/curl/7.59.0-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cppunit/1.40.1-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openssl/1.0.2d-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia6/426-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/photos/215.5-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/zlib-x86_64/1.2.11-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/bz2lib/1.0.6-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/include/python2.7:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/tinyxml2/6.2.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/ittnotify/16.06.18-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj/include:/usr/local/include:/usr/include == env: VC3_MACHINE_OS=Linux/redhat7.4.1708 == env: VC3_VERSION_FULL_TAR=1.26.0 == env: G4LEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4EMLOW/7.3/data/G4EMLOW7.3 == env: SRT_VINCIADATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vincia/2.2.04-pafccj5/share/Vincia/xmldoc == env: SRT_ROOT_TTREECACHE_PREFILL_SCRAMRTDEL=0 == env: OPAL_PREFIX=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openmpi/2.1.5-pafccj == env: USER=kmohrman == env: VC3_VERSION_FULL_CCTOOLS_WQ_WORKER=999.999.999 == env: ROOT_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj10:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: SHERPA_INCLUDE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include/SHERPA-MC == env: SRT_LHAPDF_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/lhapdf/6.2.1-pafccj3/share/LHAPDF == env: SRT_PYTHON27PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1/python:/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch-tool-conf/CMSSW_10_6_17/lib/python2.7/site-packages == env: LD_LIBRARY_PATH=/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1/biglib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/biglib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/biglib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/dcap:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/lcgdm:/.singularity.d/libs:lib:lib == env: VC3_BUILDER_PATH=/disk/vc3-builder == env: TEMP=/disk/vc3-root/tmp/worker-230547-15795/t.229067/cctools-temp-t.229067.gL72J9 == env: SRT_CMSSW_RELEASE_BASE_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1 == env: SRT_RIVET_ANALYSIS_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/lib == env: VC3_VERSION_VC3_BUILDER_HANDS=1.0 == env: SRT_PERL5LIB_SCRAMRT=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/perl5 == env: SRT_CMSSW_VERSION_SCRAMRTDEL=CMSSW_10_6_17_patch1 == env: VC3_DISTFILES=/disk/vc3-distfiles == env: VC3_ROOT_MAKE=/usr/ == env: GCC_RUNTIME_LSAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: SCRAM_CXX11_ABI=1 == env: VALGRIND_LIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/lib/valgrind == env: SRT_CMSSW_GIT_HASH_SCRAMRTDEL=CMSSW_10_6_17_patch1 == env: SRT_ROOTSYS_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/ == env: OSG_LOCATION=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64 == env: ENV=/disk/vc3-root/vc3-home/.vc3_sh-D2yoRx == env: VC3_VERSION_TAR=1.26 == env: WORKER_TMPDIR=/disk/vc3-root/tmp/worker-230547-15795/cache/tmp == env: G4NEUTRONHPDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NDL/4.5/data/G4NDL4.5 == env: GEANT4_PARFULLCMS_CONFIG_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-parfullcms/2014.01.27-pafccj2/share/ParFullCMS == env: FRONTIER_PROXY=http://eddie.crc.nd.edu:3128 == env: PARROT_ALLOW_SWITCHING_CVMFS_REPOSITORIES=TRUE == env: CSC_TRACK_FINDER_DATA_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/CSCTrackFinderEmulation/1.2-pafccj/data/ == env: SRT_QTINC_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/include == env: VC3_VERSION_CCTOOLS_WQ_WORKER=999.999 == env: G4ENSDFSTATEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ENSDFSTATE/2.2/data/G4ENSDFSTATE2.2 == env: G4RADIOACTIVEDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4RadioactiveDecay/5.2/data/RadioactiveDecay5.2 == env: ROOFITSYS=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/ == env: SRT_ROOFITSYS_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/ == env: SRT_G4RADIOACTIVEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4RadioactiveDecay/5.2/data/RadioactiveDecay5.2 == env: SRT_G4ENSDFSTATEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ENSDFSTATE/2.2/data/G4ENSDFSTATE2.2 == env: SRT_CLHEP_PARAM_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2 == env: G4ABLADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4ABLA/3.0/data/G4ABLA3.0 == env: VC3_VERSION_FULL_PKG_CONFIG=0.27.1 == env: SRT_SHERPA_INCLUDE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include/SHERPA-MC == env: SRT_G4FORCENUMBEROFTHREADS_SCRAMRTDEL=max == env: SRT_WORKER_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/blackhat/0.9.9-pafccj/share/blackhat/datafiles/ == env: SITECONFIG_PATH=/cvmfs/cms.cern.ch/SITECONF/local == env: PARROT_CVMFS_REPO= == env: VC3_VERSION_GZIP=1.5 == env: GCC_RUNTIME_TSAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libtsan.so == env: TNS_ADMIN=/etc == env: SRT_HEPPDT_PARAM_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj == env: PATH=/cvmfs/cms.cern.ch/share/overrides/bin:/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1/bin/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/bin:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/sbin:/cvmfs/cms.cern.ch/common:/disk/vc3-root/x86_64/redhat7.4.1708/which/v2.20.0/bin:/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin == env: VC3_ENV_TAG_GLOBAL=15541 == env: THEPEGPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/thepeg/2.2.0-pafccj/share/ThePEG == env: SRT_CMSSW_SEARCH_PATH_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1/poison:/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1/src:/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/data:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/poison:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/data == env: SRT_GIT_SSL_CAINFO_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/ssl/certs/ca-bundle.crt == env: SRT_GCC_RUNTIME_LSAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: CMS_PATH=/cvmfs/cms.cern.ch == env: VC3_ROOT=/disk/vc3-root == env: SRT_UTM_XSD_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/utm/utm_0.7.1-pafccj == env: SRT_PATH_SCRAMRT=/cvmfs/cms.cern.ch/share/overrides/bin:/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1/bin/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/bin:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/bin == env: VC3_SH_PROFILE_ENV=/disk/vc3-root/vc3-home/.vc3_sh-D2yoRx == env: RIVET_ANALYSIS_PATH=/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/lib == env: SRT_LOCALRT_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1 == env: SRT_CMSSW_BASE_SCRAMRTDEL=/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1 == env: PWD=/disk/vc3-root/tmp/worker-230547-15795/t.229067 == env: VC3_ROOT_PKG_CONFIG=/usr/ == env: PARROT_ENABLED=TRUE == env: VC3_VERSION_FULL_SED=4.2.2 == env: LOBSTER_OSG_VERSION=3.4 == env: PYTHON_VALGRIND_SUPP=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/share/valgrind/valgrind-python.supp == env: SRT_OPAL_PREFIX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openmpi/2.1.5-pafccj == env: VC3_VERSION_WHICH=2.20 == env: GCC_RUNTIME_UBSAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libubsan.so == env: LANG=C == env: SRT_QTDIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2 == env: MODULEPATH=/afs/crc.nd.edu/x86_64_linux/Modules/modules/development_tools_and_libraries:/afs/crc.nd.edu/x86_64_linux/Modules/modules/general_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/restricted_software:/afs/crc.nd.edu/x86_64_linux/Modules/modules/system_modules:/afs/crc.nd.edu/x86_64_linux/Modules/modules/deprecated_software:/afs/crc.nd.edu/x86_64_linux/Modules/current/modulefiles == env: VC3_MACHINE_GLIBC_VERSION=2.17 == env: SRT_G4NEUTRONHPDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NDL/4.5/data/G4NDL4.5 == env: X509_VOMS_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/grid-security/vomsdir == env: LOBSTER_LCG_CP= == env: SRT_SHERPA_SHARE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/share/SHERPA-MC == env: SRT_GCC_RUNTIME_TSAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libtsan.so == env: WORK_QUEUE_SANDBOX=/disk/vc3-root/tmp/worker-230547-15795 == env: CASCADE_PDFPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/share == env: SRT_ROOT_GCC_TOOLCHAIN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: SRT_CASCADE_PDFPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/cascade/2.2.04-pafccj3/share == env: WORKER_DATA_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/blackhat/0.9.9-pafccj/share/blackhat/datafiles/ == env: GIT_TEMPLATE_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/git-core/templates == env: G4SAIDXSDATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4SAIDDATA/1.1/data/G4SAIDDATA1.1 == env: MLAS_DYNAMIC_CPU_ARCH=0 == env: SRT_CMSSW_FULL_RELEASE_BASE_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17 == env: VC3_ROOT_CCTOOLS_WQ_WORKER=/disk/vc3-root/x86_64/redhat7.4.1708/cctools-wq-worker/v999.999.999 == env: PYTHON27PATH=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1/python:/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/coral/CORAL_2_3_21-pafccj7/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/xrootd/4.8.5-pafccj2/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/fastjet/3.3.0-pafccj/lib/python2.7/site-packages:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch-tool-conf/CMSSW_10_6_17/lib/python2.7/site-packages == env: SRT_CMSSW_FWLITE_INCLUDE_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/hepmc/2.06.07-pafccj/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2/include:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/boost/1.67.0-pafccj/include == env: VC3_MACHINE_TARGET=x86_64/redhat7.4.1708 == env: VC3_ROOT_SED=/usr/ == env: OASIS_CERTIFICATES=/cvmfs/oasis.opensciencegrid.org/mis/certificates == env: ROOTSYS=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/ == env: SRT_PYTHIA8DATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/share/Pythia8/xmldoc == env: SRT_HERWIGPATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj/share/Herwig == env: CXX=g++ == env: SRT_QTLIB_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/lib == env: SRT_PYTHON3PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1/python:/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch-tool-conf/CMSSW_10_6_17/lib/python3.6/site-packages == env: SHERPA_LIBRARY_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/lib/SHERPA-MC == env: SRT_PYTHON_VALGRIND_SUPP_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/python/2.7.14-pafccj/share/valgrind/valgrind-python.supp == env: HOME=/disk/vc3-root/vc3-home == env: SHLVL=3 == env: CMSSW_SEARCH_PATH=/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1/poison:/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1/src:/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/data:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/poison:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/src:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/data == env: VC3_VERSION_FULL_GZIP=1.5.0 == env: VC3_VERSION_MAKE=3.82 == env: GENEVA_DATA_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geneva/1.0-RC3-pafccj8/share/Geneva == env: DISK=3000 == env: PARROT_CACHE=/disk/vc3-root/tmp/worker-230547-15795/cache/tmp == env: PARROT_CVMFS_ALIEN_CACHE=/disk/vc3-root/tmp/worker-230547-15795/cache/tmp/cvmfs == env: GOSAMCONTRIB_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: ROOT_TTREECACHE_PREFILL=0 == env: GENREFLEX=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/bin/genreflex == env: VINCIADATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/vincia/2.2.04-pafccj5/share/Vincia/xmldoc == env: SRT_G4LEDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4EMLOW/7.3/data/G4EMLOW7.3 == env: SRT_GENREFLEX_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/lcg/root/6.14.09-pafccj5/bin/genreflex == env: SRT_GOSAMCONTRIB_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: SRT_ROOT_TTREECACHE_SIZE_SCRAMRTDEL=0 == env: SRT_EVTGENDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/evtgen/1.6.0-pafccj5/share == env: SRT_GENEVA_DATA_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geneva/1.0-RC3-pafccj8/share/Geneva == env: GFAL_CONFIG_DIR=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/etc/gfal2.d/ == env: VC3_VERSION_FULL_WHICH=2.20.0 == env: MEMORY=5000 == env: HTTP_PROXY=http://eddie.crc.nd.edu:3128 == env: SRT_CMSSW_DATA_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms == env: HEPPDT_PARAM_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/heppdt/3.03.00-pafccj == env: SRT_LD_LIBRARY_PATH_SCRAMRT=/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1/biglib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/biglib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/external/slc7_amd64_gcc700/lib:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/biglib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/llvm/7.1.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib == env: TMP=/disk/vc3-root/tmp/worker-230547-15795/t.229067/cctools-temp-t.229067.gL72J9 == env: PYTHONPATH=/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib/python2.7/site-packages:/cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.4/3.4.57/el7-x86_64/usr/lib64/python2.7/site-packages:python:python: == env: PYTHON3PATH=/cvmfs/cms.cern.ch/share/overrides/python:/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1/python:/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/python:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch/CMSSW_10_6_17_patch1/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/bin/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw/CMSSW_10_6_17/lib/slc7_amd64_gcc700:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/cmssw-patch-tool-conf/CMSSW_10_6_17/lib/python3.6/site-packages == env: QTLIB=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/qt/4.8.7-pafccj2/lib == env: SCONS_LIB_DIR=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/scons/3.0.1-pafccj/lib == env: VC3_INSTALL_USER_HOME=/disk/vc3-root/vc3-home == env: VC3_VERSION_FULL_VC3_BUILDER_HANDS=1.0.0 == env: COMPILER_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: FRONTIER_CLIENT=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/ == env: SRT_G4NEUTRONXSDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4NEUTRONXS/1.4/data/G4NEUTRONXS1.4 == env: SRT_SHERPA_LIBRARY_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/lib/SHERPA-MC == env: VC3_ROOT_TAR=/usr/ == env: VC3_VERSION_PKG_CONFIG=0.27 == env: CLHEP_PARAM_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/clhep/2.4.0.0-pafccj2 == env: CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 == env: VC3_SH_PROFILE_WRAPPER=/disk/vc3-root/vc3-home/.vc3_sh-D2yoRx.wrapper == env: PYTHIA8DATA=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/pythia8/240-pafccj5/share/Pythia8/xmldoc == env: HERWIGPATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/herwigpp/7.2.0-pafccj/share/Herwig == env: SRT_FRONTIER_CLIENT_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/frontier_client/2.9.1/ == env: SRT_COMPILER_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj == env: SRT_CSC_TRACK_FINDER_DATA_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/cms/CSCTrackFinderEmulation/1.2-pafccj/data/ == env: GCC_RUNTIME_ASAN=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libasan.so == env: SRT_ROOT_PATH_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/madgraph5amcatnlo/2.6.0-pafccj10:/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gosamcontrib/2.0-20150803-pafccj == env: CC=gcc == env: TEXMFHOME=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/rivet/2.7.0-pafccj7/share/Rivet/texmf == env: SRT_MLAS_DYNAMIC_CPU_ARCH_SCRAMRTDEL=0 == env: SRT_OPENBLAS_NUM_THREADS_SCRAMRTDEL=1 == env: SRT_GIT_TEMPLATE_DIR_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/share/git-core/templates == env: SRT_G4SAIDXSDATA_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/geant4-G4SAIDDATA/1.1/data/G4SAIDDATA1.1 == env: CMSSW_VERSION=CMSSW_10_6_17_patch1 == env: SRT_GCC_RUNTIME_UBSAN_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gcc/7.0.0-pafccj/lib64/libubsan.so == env: SRT_LANG_SCRAMRTDEL=C == env: CCTOOLS_RESOURCE_MONITOR_INFO=1024 == env: VC3_VERSION_FULL_MAKE=3.82.0 == env: CORES=3 == env: PARROT_DEBUG_FLAGS= == env: SHERPA_SHARE_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/sherpa/2.2.10-pafccj/share/SHERPA-MC == env: VC3_MACHINE_ARCH=x86_64 == env: VC3_ROOT_VC3_BUILDER_HANDS=/disk/vc3-root/x86_64/redhat7.4.1708/vc3-builder-hands/v1.0.0 == env: CMS_OPENLOOPS_PREFIX=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/openloops/2.1.0-pafccj2 == env: GIT_EXEC_PATH=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/git/2.19.0-pafccj/libexec/git-core == env: LOCALRT=/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1 == env: CMSSW_BASE=/disk/vc3-root/tmp/worker-230547-15795/t.229067/CMSSW_10_6_17_patch1 == env: SRT_SCRAM_CXX11_ABI_SCRAMRTDEL=1 == env: SRT_VALGRIND_LIB_SCRAMRTDEL=/cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/valgrind/3.13.0-pafccj/lib/valgrind == env: VC3_COMMAND_LINE=/disk/vc3-builder --var CCTOOLS_ND=lobster-171-cd5e3e2c-cvmfs-70dfa0d6 --require cctools-wq-worker -- work_queue_worker -M lobster_kmohrman_EFT_CRC_b4_postLHE.* -t 300 -C catalog.cse.nd.edu,backup-catalog.cse.nd.edu -d all -o worker.log --cores=12 --memory=16000 --disk=15353 == env: _=/usr/bin/env === wrapper ready @ Tue May 25 16:31:37 EDT 2021 ==== working directory before execution @ Tue May 25 16:31:38 EDT 2021 ==== == dir: total 868 == dir: drwxr-xr-x 18 kmohrman campus 215 May 25 16:31 CMSSW_10_6_17_patch1 == dir: -rw-r--r-- 2 kmohrman campus 4482 May 25 16:30 UL18_RECO_cfg.py == dir: drwxr-xr-x 2 kmohrman campus 71 May 25 16:30 bin == dir: -rwxr-xr-x 3 kmohrman campus 627272 May 25 12:52 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 May 25 16:30 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 May 25 16:30 cctools-temp-t.229067.gL72J9 == dir: -rw------- 1 kmohrman campus 51 May 25 16:31 cvmfschecksum.cms-ib.cern.ch == dir: -rw------- 1 kmohrman campus 51 May 25 16:31 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 May 25 16:31 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 May 25 16:30 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 May 25 16:30 librmonitor_helper.so.GJwIO0 == dir: -rw-r--r-- 2 kmohrman campus 2152 May 25 16:30 parameters.json == dir: -rw------- 2 kmohrman campus 9917 May 25 16:30 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 May 25 16:30 python == dir: -rw-r--r-- 3 kmohrman campus 570 May 25 12:52 report.json.in == dir: -rw-r--r-- 3 kmohrman campus 593 May 25 12:52 sandbox-CMSSW_10_6_17_patch1-slc7_amd64_gcc700.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 37 May 25 16:30 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 May 25 16:31 t_wrapper_ready == dir: -rw-r--r-- 1 kmohrman campus 11 May 25 16:31 t_wrapper_start == dir: -rwxr-xr-x 3 kmohrman campus 47217 May 25 12:52 task.py == dir: -rwxr-xr-x 3 kmohrman campus 5986 May 25 12:52 wrapper.sh >>> data is {u'files': {u'info': {}, u'output_info': {}, u'skipped': []}, u'cpu_time': 0, u'exe_exit_code': 0, u'events_written': 0, u'output_size': 0, u'task_exit_code': 0, u'output_storage_element': u'', u'cache': {u'start_size': 0, u'type': 2, u'end_size': 0}, u'stageout_exit_code': 0, u'output_bare_size': 0, u'transfers': defaultdict(, {}), u'task_timing': {u'wrapper_ready': 0, u'wrapper_start': 0, u'prologue_end': 0, u'epilogue_end': 0, u'stage_out_end': 0, u'stage_in_end': 0, u'processing_end': 0}, u'events_per_run': 0} @ Tue May 25 16:31:47 2021 >>> Trying hdfs client access method @ Tue May 25 16:31:47 2021 >>> executing 'timeout 300 hdfs dfs -fs hdfs://eddie.crc.nd.edu:19000 -get /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1/hlt_step_tttt_FourtopsMay3v1_run0/HLT-00000_226853.root HLT-00000_226853.root' @ Tue May 25 16:31:47 2021 >> using /disk/vc3-root/tmp/worker-230547-15795/t.229067/cctools-temp-t.229067.gL72J9/tmpWzp29Q to store command output >> cmd: timeout: failed to run command 'hdfs': No such file or directory >>>>> Unable to copy input with hdfs client @ Tue May 25 16:31:48 2021 >>> Trying xrootd access method @ Tue May 25 16:31:48 2021 >>> executing 'env XRD_LOGLEVEL=Debug timeout 300 xrdfs deepthought.crc.nd.edu stat /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1/hlt_step_tttt_FourtopsMay3v1_run0/HLT-00000_226853.root' @ Tue May 25 16:31:48 2021 >> using /disk/vc3-root/tmp/worker-230547-15795/t.229067/cctools-temp-t.229067.gL72J9/tmpm85KEr to store command output >> cmd: [2021-05-25 16:31:48.294051 -0400][Warning][Utility ] Unable to process global config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 16:31:48.295243 -0400][Debug ][Utility ] Unable to process user config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 16:31:48.295438 -0400][Debug ][PlugInMgr ] Initializing plug-in manager... >> cmd: [2021-05-25 16:31:48.295501 -0400][Debug ][PlugInMgr ] No default plug-in, loading plug-in configs... >> cmd: [2021-05-25 16:31:48.295555 -0400][Debug ][PlugInMgr ] Processing plug-in definitions in /etc/xrootd/client.plugins.d... >> cmd: [2021-05-25 16:31:48.295667 -0400][Debug ][PlugInMgr ] Unable to process directory /etc/xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 16:31:48.296065 -0400][Debug ][PlugInMgr ] Processing plug-in definitions in /tmp/runos_singularity_home-259401718237957129161913481113251717318/.xrootd/client.plugins.d... >> cmd: [2021-05-25 16:31:48.296188 -0400][Debug ][PlugInMgr ] Unable to process directory /tmp/runos_singularity_home-259401718237957129161913481113251717318/.xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 16:31:48.296382 -0400][Debug ][App ] Executing: stat /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1/hlt_step_tttt_FourtopsMay3v1_run0/HLT-00000_226853.root >> cmd: [2021-05-25 16:31:48.296498 -0400][Debug ][Poller ] Available pollers: built-in >> cmd: [2021-05-25 16:31:48.296553 -0400][Debug ][Poller ] Attempting to create a poller according to preference: built-in >> cmd: [2021-05-25 16:31:48.296606 -0400][Debug ][Poller ] Creating poller: built-in >> cmd: [2021-05-25 16:31:48.296665 -0400][Debug ][Poller ] Creating and starting the built-in poller... >> cmd: [2021-05-25 16:31:48.297321 -0400][Debug ][Poller ] Using 1 poller threads >> cmd: [2021-05-25 16:31:48.297404 -0400][Debug ][TaskMgr ] Starting the task manager... >> cmd: [2021-05-25 16:31:48.297618 -0400][Debug ][TaskMgr ] Task manager started >> cmd: [2021-05-25 16:31:48.297685 -0400][Debug ][JobMgr ] Starting the job manager... >> cmd: [2021-05-25 16:31:48.298025 -0400][Debug ][JobMgr ] Job manager started, 3 workers >> cmd: [2021-05-25 16:31:48.298106 -0400][Debug ][TaskMgr ] Registering task: "FileTimer task" to be run at: [2021-05-25 16:31:48 -0400] >> cmd: [2021-05-25 16:31:48.298197 -0400][Debug ][PostMaster ] Creating new channel to: deepthought.crc.nd.edu:1094 1 stream(s) >> cmd: [2021-05-25 16:31:48.298275 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-05-25 16:31:48.299998 -0400][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" to be run at: [2021-05-25 16:32:03 -0400] >> cmd: [2021-05-25 16:31:48.301302 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 16:31:48.301479 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 16:31:48.301594 -0400][Debug ][Poller ] Adding socket 0x1fa28a0 to the poller >> cmd: [2021-05-25 16:31:48.301930 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2021-05-25 16:31:48.302063 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-05-25 16:31:48.302625 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Got the server hand shake response (type: manager [], protocol version 500) >> cmd: [2021-05-25 16:31:48.302840 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] kXR_protocol successful (type: manager [], protocol version 500) >> cmd: [2021-05-25 16:31:48.307605 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=da-1080-005.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-05-25 16:31:48.308091 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Logged in, session: 6c2b0000b1db13005c0200006e2b0000 >> cmd: [2021-05-25 16:31:48.308196 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream 0 connected. >> cmd: [2021-05-25 16:31:48.308258 -0400][Debug ][Utility ] Monitor library name not set. No monitoring >> cmd: [2021-05-25 16:31:48.310750 -0400][Debug ][PostMaster ] Creating new channel to: primeradiant01.crc.nd.edu:1096 1 stream(s) >> cmd: [2021-05-25 16:31:48.310884 -0400][Debug ][PostMaster ] [primeradiant01.crc.nd.edu:1096 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-05-25 16:31:48.313243 -0400][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: primeradiant01.crc.nd.edu:1096" to be run at: [2021-05-25 16:32:03 -0400] >> cmd: [2021-05-25 16:31:48.314721 -0400][Debug ][PostMaster ] [primeradiant01.crc.nd.edu:1096] Found 1 address(es): [::ffff:149.165.243.5]:1096 >> cmd: [2021-05-25 16:31:48.314885 -0400][Debug ][AsyncSock ] [primeradiant01.crc.nd.edu:1096 #0.0] Attempting connection to [::ffff:149.165.243.5]:1096 >> cmd: [2021-05-25 16:31:48.314988 -0400][Debug ][Poller ] Adding socket 0x3c0016a0 to the poller >> cmd: [2021-05-25 16:31:48.315126 -0400][Debug ][AsyncSock ] [primeradiant01.crc.nd.edu:1096 #0.0] Async connection call returned >> cmd: [2021-05-25 16:31:48.315319 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-05-25 16:31:48.315730 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] Got the server hand shake response (type: server [], protocol version 500) >> cmd: [2021-05-25 16:31:48.315931 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] kXR_protocol successful (type: server [], protocol version 500) >> cmd: [2021-05-25 16:31:48.319317 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=da-1080-005.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-05-25 16:31:48.319906 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] Logged in, session: 1412000013690000be0a000014120000 >> cmd: [2021-05-25 16:31:48.319971 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] Authentication is required: &P=gsi,v:10400,c:ssl,ca:ba240aa8.0|f5f0dfc2.0 >> cmd: [2021-05-25 16:31:48.320027 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] Sending authentication data >> cmd: [2021-05-25 16:31:48.328021 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] Trying to authenticate using gsi >> cmd: [2021-05-25 16:31:48.413832 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] Sending more authentication data for gsi >> cmd: [2021-05-25 16:31:48.420625 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] Authenticated with gsi. >> cmd: [2021-05-25 16:31:48.420736 -0400][Debug ][PostMaster ] [primeradiant01.crc.nd.edu:1096 #0] Stream 0 connected. >> cmd: Path: /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1/hlt_step_tttt_FourtopsMay3v1_run0/HLT-00000_226853.root >> cmd: Id: 0 >> cmd: Size: 1135876665 >> cmd: MTime: 2021-05-25 17:40:12 >> cmd: Flags: 24 (Offline|IsReadable) >> cmd: [2021-05-25 16:31:48.423103 -0400][Debug ][JobMgr ] Stopping the job manager... >> cmd: [2021-05-25 16:31:48.423722 -0400][Debug ][JobMgr ] Job manager stopped >> cmd: [2021-05-25 16:31:48.423793 -0400][Debug ][TaskMgr ] Stopping the task manager... >> cmd: [2021-05-25 16:31:48.423981 -0400][Debug ][TaskMgr ] Task manager stopped >> cmd: [2021-05-25 16:31:48.424045 -0400][Debug ][Poller ] Stopping the poller... >> cmd: [2021-05-25 16:31:48.424352 -0400][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" >> cmd: [2021-05-25 16:31:48.424417 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-05-25 16:31:48.424474 -0400][Debug ][Poller ] <[::ffff:10.32.75.159]:46404><--><[::ffff:129.74.85.55]:1094> Removing socket from the poller >> cmd: [2021-05-25 16:31:48.424570 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Destroying stream >> cmd: [2021-05-25 16:31:48.424627 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-05-25 16:31:48.424683 -0400][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: primeradiant01.crc.nd.edu:1096" >> cmd: [2021-05-25 16:31:48.424735 -0400][Debug ][AsyncSock ] [primeradiant01.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2021-05-25 16:31:48.424790 -0400][Debug ][Poller ] <[::ffff:10.32.75.159]:41760><--><[::ffff:149.165.243.5]:1096> Removing socket from the poller >> cmd: [2021-05-25 16:31:48.424877 -0400][Debug ][PostMaster ] [primeradiant01.crc.nd.edu:1096 #0] Destroying stream >> cmd: [2021-05-25 16:31:48.424931 -0400][Debug ][AsyncSock ] [primeradiant01.crc.nd.edu:1096 #0.0] Closing the socket >>> will stream using xrootd instead of copying @ Tue May 25 16:31:48 2021 >>> Trying hdfs client access method @ Tue May 25 16:31:48 2021 >>> executing 'timeout 300 hdfs dfs -fs hdfs://eddie.crc.nd.edu:19000 -get /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1/hlt_step_tttt_FourtopsMay3v1_run0/HLT-00000_226280.root HLT-00000_226280.root' @ Tue May 25 16:31:48 2021 >> using /disk/vc3-root/tmp/worker-230547-15795/t.229067/cctools-temp-t.229067.gL72J9/tmpWU_amD to store command output >> cmd: timeout: failed to run command 'hdfs': No such file or directory >>>>> Unable to copy input with hdfs client @ Tue May 25 16:31:48 2021 >>> Trying xrootd access method @ Tue May 25 16:31:48 2021 >>> executing 'env XRD_LOGLEVEL=Debug timeout 300 xrdfs deepthought.crc.nd.edu stat /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1/hlt_step_tttt_FourtopsMay3v1_run0/HLT-00000_226280.root' @ Tue May 25 16:31:48 2021 >> using /disk/vc3-root/tmp/worker-230547-15795/t.229067/cctools-temp-t.229067.gL72J9/tmpc8N0U5 to store command output >> cmd: [2021-05-25 16:31:48.746018 -0400][Warning][Utility ] Unable to process global config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 16:31:48.747529 -0400][Debug ][Utility ] Unable to process user config file: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 16:31:48.747714 -0400][Debug ][PlugInMgr ] Initializing plug-in manager... >> cmd: [2021-05-25 16:31:48.747774 -0400][Debug ][PlugInMgr ] No default plug-in, loading plug-in configs... >> cmd: [2021-05-25 16:31:48.747826 -0400][Debug ][PlugInMgr ] Processing plug-in definitions in /etc/xrootd/client.plugins.d... >> cmd: [2021-05-25 16:31:48.747931 -0400][Debug ][PlugInMgr ] Unable to process directory /etc/xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 16:31:48.748341 -0400][Debug ][PlugInMgr ] Processing plug-in definitions in /tmp/runos_singularity_home-259401718237957129161913481113251717318/.xrootd/client.plugins.d... >> cmd: [2021-05-25 16:31:48.748457 -0400][Debug ][PlugInMgr ] Unable to process directory /tmp/runos_singularity_home-259401718237957129161913481113251717318/.xrootd/client.plugins.d: [ERROR] OS Error: No such file or directory >> cmd: [2021-05-25 16:31:48.748643 -0400][Debug ][App ] Executing: stat /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1/hlt_step_tttt_FourtopsMay3v1_run0/HLT-00000_226280.root >> cmd: [2021-05-25 16:31:48.748753 -0400][Debug ][Poller ] Available pollers: built-in >> cmd: [2021-05-25 16:31:48.748805 -0400][Debug ][Poller ] Attempting to create a poller according to preference: built-in >> cmd: [2021-05-25 16:31:48.748854 -0400][Debug ][Poller ] Creating poller: built-in >> cmd: [2021-05-25 16:31:48.748909 -0400][Debug ][Poller ] Creating and starting the built-in poller... >> cmd: [2021-05-25 16:31:48.749337 -0400][Debug ][Poller ] Using 1 poller threads >> cmd: [2021-05-25 16:31:48.749410 -0400][Debug ][TaskMgr ] Starting the task manager... >> cmd: [2021-05-25 16:31:48.749562 -0400][Debug ][TaskMgr ] Task manager started >> cmd: [2021-05-25 16:31:48.749622 -0400][Debug ][JobMgr ] Starting the job manager... >> cmd: [2021-05-25 16:31:48.749952 -0400][Debug ][JobMgr ] Job manager started, 3 workers >> cmd: [2021-05-25 16:31:48.750016 -0400][Debug ][TaskMgr ] Registering task: "FileTimer task" to be run at: [2021-05-25 16:31:48 -0400] >> cmd: [2021-05-25 16:31:48.750112 -0400][Debug ][PostMaster ] Creating new channel to: deepthought.crc.nd.edu:1094 1 stream(s) >> cmd: [2021-05-25 16:31:48.750196 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-05-25 16:31:48.751340 -0400][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" to be run at: [2021-05-25 16:32:03 -0400] >> cmd: [2021-05-25 16:31:48.752851 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 16:31:48.753023 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Attempting connection to [::ffff:129.74.85.55]:1094 >> cmd: [2021-05-25 16:31:48.753155 -0400][Debug ][Poller ] Adding socket 0x215c8a0 to the poller >> cmd: [2021-05-25 16:31:48.753594 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Async connection call returned >> cmd: [2021-05-25 16:31:48.753722 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-05-25 16:31:48.754210 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Got the server hand shake response (type: manager [], protocol version 500) >> cmd: [2021-05-25 16:31:48.754423 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] kXR_protocol successful (type: manager [], protocol version 500) >> cmd: [2021-05-25 16:31:48.758297 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=da-1080-005.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-05-25 16:31:48.758745 -0400][Debug ][XRootDTransport ] [deepthought.crc.nd.edu:1094 #0.0] Logged in, session: 712b0000b1db130081020000732b0000 >> cmd: [2021-05-25 16:31:48.758830 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Stream 0 connected. >> cmd: [2021-05-25 16:31:48.758885 -0400][Debug ][Utility ] Monitor library name not set. No monitoring >> cmd: [2021-05-25 16:31:48.761051 -0400][Debug ][PostMaster ] Creating new channel to: primeradiant01.crc.nd.edu:1096 1 stream(s) >> cmd: [2021-05-25 16:31:48.761131 -0400][Debug ][PostMaster ] [primeradiant01.crc.nd.edu:1096 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 >> cmd: [2021-05-25 16:31:48.762774 -0400][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: primeradiant01.crc.nd.edu:1096" to be run at: [2021-05-25 16:32:03 -0400] >> cmd: [2021-05-25 16:31:48.764312 -0400][Debug ][PostMaster ] [primeradiant01.crc.nd.edu:1096] Found 1 address(es): [::ffff:149.165.243.5]:1096 >> cmd: [2021-05-25 16:31:48.764468 -0400][Debug ][AsyncSock ] [primeradiant01.crc.nd.edu:1096 #0.0] Attempting connection to [::ffff:149.165.243.5]:1096 >> cmd: [2021-05-25 16:31:48.764565 -0400][Debug ][Poller ] Adding socket 0x940016a0 to the poller >> cmd: [2021-05-25 16:31:48.764724 -0400][Debug ][AsyncSock ] [primeradiant01.crc.nd.edu:1096 #0.0] Async connection call returned >> cmd: [2021-05-25 16:31:48.764887 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] Sending out the initial hand shake + kXR_protocol >> cmd: [2021-05-25 16:31:48.765297 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] Got the server hand shake response (type: server [], protocol version 500) >> cmd: [2021-05-25 16:31:48.765504 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] kXR_protocol successful (type: server [], protocol version 500) >> cmd: [2021-05-25 16:31:48.768843 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] Sending out kXR_login request, username: kmohrman, cgi: ?xrd.cc=us&xrd.tz=-5&xrd.appname=xrdfs&xrd.info=&xrd.hostname=da-1080-005.crc.nd.edu&xrd.rn=v4.8.5, dual-stack: false, private IPv4: true, private IPv6: false >> cmd: [2021-05-25 16:31:48.769264 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] Logged in, session: 15120000136900006702000015120000 >> cmd: [2021-05-25 16:31:48.769327 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] Authentication is required: &P=gsi,v:10400,c:ssl,ca:ba240aa8.0|f5f0dfc2.0 >> cmd: [2021-05-25 16:31:48.769381 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] Sending authentication data >> cmd: [2021-05-25 16:31:48.776833 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] Trying to authenticate using gsi >> cmd: [2021-05-25 16:31:48.855104 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] Sending more authentication data for gsi >> cmd: [2021-05-25 16:31:48.864915 -0400][Debug ][XRootDTransport ] [primeradiant01.crc.nd.edu:1096 #0.0] Authenticated with gsi. >> cmd: [2021-05-25 16:31:48.865370 -0400][Debug ][PostMaster ] [primeradiant01.crc.nd.edu:1096 #0] Stream 0 connected. >> cmd: Path: /store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1/hlt_step_tttt_FourtopsMay3v1_run0/HLT-00000_226280.root >> cmd: Id: 0 >> cmd: Size: 1139034532 >> cmd: MTime: 2021-05-25 17:40:22 >> cmd: Flags: 24 (Offline|IsReadable) >> cmd: [2021-05-25 16:31:48.868109 -0400][Debug ][JobMgr ] Stopping the job manager... >> cmd: [2021-05-25 16:31:48.868701 -0400][Debug ][JobMgr ] Job manager stopped >> cmd: [2021-05-25 16:31:48.868777 -0400][Debug ][TaskMgr ] Stopping the task manager... >> cmd: [2021-05-25 16:31:48.868969 -0400][Debug ][TaskMgr ] Task manager stopped >> cmd: [2021-05-25 16:31:48.869027 -0400][Debug ][Poller ] Stopping the poller... >> cmd: [2021-05-25 16:31:48.869668 -0400][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: deepthought.crc.nd.edu:1094" >> cmd: [2021-05-25 16:31:48.869737 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-05-25 16:31:48.869795 -0400][Debug ][Poller ] <[::ffff:10.32.75.159]:46410><--><[::ffff:129.74.85.55]:1094> Removing socket from the poller >> cmd: [2021-05-25 16:31:48.869890 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094 #0] Destroying stream >> cmd: [2021-05-25 16:31:48.869947 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094 #0.0] Closing the socket >> cmd: [2021-05-25 16:31:48.870005 -0400][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: primeradiant01.crc.nd.edu:1096" >> cmd: [2021-05-25 16:31:48.870284 -0400][Debug ][AsyncSock ] [primeradiant01.crc.nd.edu:1096 #0.0] Closing the socket >> cmd: [2021-05-25 16:31:48.870386 -0400][Debug ][Poller ] <[::ffff:10.32.75.159]:41766><--><[::ffff:149.165.243.5]:1096> Removing socket from the poller >> cmd: [2021-05-25 16:31:48.870490 -0400][Debug ][PostMaster ] [primeradiant01.crc.nd.edu:1096 #0] Destroying stream >> cmd: [2021-05-25 16:31:48.870548 -0400][Debug ][AsyncSock ] [primeradiant01.crc.nd.edu:1096 #0.0] Closing the socket >>> will stream using xrootd instead of copying @ Tue May 25 16:31:48 2021 >>> modified input files @ Tue May 25 16:31:48 2021 >> input: root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1/hlt_step_tttt_FourtopsMay3v1_run0/HLT-00000_226853.root >> input: root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1/hlt_step_tttt_FourtopsMay3v1_run0/HLT-00000_226280.root >>> updated parameters are @ Tue May 25 16:31:48 2021 >> json: { >> json: "accelerate stage-in": 3, >> json: "arguments": [], >> json: "cores": 3, >> json: "default ce": "T3_US_NotreDame", >> json: "default host": "earth.crc.nd.edu", >> json: "default se": "T3_US_NotreDame", >> json: "disable streaming": false, >> json: "epilogue": null, >> json: "executable": "cmsRun", >> json: "file map": { >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1/hlt_step_tttt_FourtopsMay3v1_run0/HLT-00000_226280.root": "hlt_step_tttt_FourtopsMay3v1_run0/HLT-00000_226280.root", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1/hlt_step_tttt_FourtopsMay3v1_run0/HLT-00000_226853.root": "hlt_step_tttt_FourtopsMay3v1_run0/HLT-00000_226853.root" >> json: }, >> json: "gridpack": false, >> json: "input": [ >> json: "hdfs://eddie.crc.nd.edu:19000/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1/", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1/", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1", >> json: "file:///hadoop/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1/" >> json: ], >> json: "mask": { >> json: "events": -1, >> json: "files": [ >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1/hlt_step_tttt_FourtopsMay3v1_run0/HLT-00000_226853.root", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1/hlt_step_tttt_FourtopsMay3v1_run0/HLT-00000_226280.root" >> json: ], >> json: "lumis": { >> json: "1": [ >> json: [ >> json: 2440, >> json: 2440 >> json: ], >> json: [ >> json: 13254, >> json: 13254 >> json: ] >> json: ] >> json: } >> json: }, >> json: "monitoring": { >> json: "monitorid": null, >> json: "syncid": null, >> json: "taskid": "lobster_kmohrman_EFT_CRC_b4_postLHE_crc_20210523_1338_122c596c29189b88" >> json: }, >> json: "output": [ >> json: "hdfs://eddie.crc.nd.edu:19000/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1/", >> json: "root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1/", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1", >> json: "gsiftp://deepthought.crc.nd.edu/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1", >> json: "file:///hadoop/store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1/" >> json: ], >> json: "output files": [ >> json: [ >> json: "RECO-00000.root", >> json: "reco_step_tttt_FourtopsMay3v1_run0/RECO-00000_229067.root" >> json: ] >> json: ], >> json: "prologue": null, >> json: "pset": "UL18_RECO_cfg.py", >> json: "want summary": true >> json: } >>> using sync CE T3_US_NotreDame @ Tue May 25 16:31:48 2021 >>> config file fragment @ Tue May 25 16:31:51 2021 >> pset: >> pset: import FWCore.ParameterSet.Config as cms >> pset: process.Timing = cms.Service("Timing", >> pset: useJobReport = cms.untracked.bool(True), >> pset: summaryOnly = cms.untracked.bool(True)) >> pset: >> pset: process.maxEvents = cms.untracked.PSet(input = cms.untracked.int32(-1)) >> pset: >> pset: import os >> pset: _, major, minor, _ = os.environ["CMSSW_VERSION"].split('_', 3) >> pset: if int(major) >= 7 and int(minor) >= 4: >> pset: xrdstats = cms.Service("XrdAdaptor::XrdStatisticsService", cms.untracked.PSet(reportToFJR = cms.untracked.bool(True))) >> pset: process.add_(xrdstats) >> pset: >> pset: for prod in process.producers.values(): >> pset: if prod.hasParameter('nEvents') and prod.type_() == 'ExternalLHEProducer': >> pset: prod.nEvents = cms.untracked.uint32(-1) >> pset: >> pset: process.source.fileNames = cms.untracked.vstring(['root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1/hlt_step_tttt_FourtopsMay3v1_run0/HLT-00000_226853.root', 'root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1/hlt_step_tttt_FourtopsMay3v1_run0/HLT-00000_226280.root']) >> pset: process.source.lumisToProcess = cms.untracked.VLuminosityBlockRange(['1:2440', '1:13254']) >> pset: if hasattr(process, 'options'): >> pset: process.options.wantSummary = cms.untracked.bool(True) >> pset: else: >> pset: process.options = cms.untracked.PSet(wantSummary = cms.untracked.bool(True)) >> pset: >> pset: if hasattr(process, 'options'): >> pset: process.options.numberOfThreads = cms.untracked.uint32(3) >> pset: process.options.numberOfStreams = cms.untracked.uint32(0) >> pset: else: >> pset: process.options = cms.untracked.PSet( >> pset: numberOfThreads = cms.untracked.uint32(3), >> pset: numberOfStreams = cms.untracked.uint32(0) >> pset: ) >>> executing 'cmsRun -j report.xml UL18_RECO_cfg_mod.py' @ Tue May 25 16:31:51 2021 >> using /disk/vc3-root/tmp/worker-230547-15795/t.229067/cctools-temp-t.229067.gL72J9/tmpC9gjEb to store command output 2021/05/25 17:02:26.94 parrot_run[23276] notice: warning: system call 101 (ptrace) not supported for program /cvmfs/cms.cern.ch/slc7_amd64_gcc700/external/gdb/8.1-pafccj/bin/gdb >> cmd: %MSG-i ThreadStreamSetup: (NoModuleName) 25-May-2021 16:32:28 EDT pre-events >> cmd: setting # threads 3 >> cmd: setting # streams 3 >> cmd: %MSG >> cmd: 25-May-2021 16:32:41 EDT Initiating request to open file root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1/hlt_step_tttt_FourtopsMay3v1_run0/HLT-00000_226853.root >> cmd: 25-May-2021 16:32:55 EDT Successfully opened file root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1/hlt_step_tttt_FourtopsMay3v1_run0/HLT-00000_226853.root >> cmd: %MSG-e TkDetLayers: ConversionTrackCandidateProducer:uncleanedOnlyConversionTrackCandidates@streamBeginRun 25-May-2021 16:35:40 EDT Run: 1 Stream: 1 >> cmd: ForwardDiskSectorBuilderFromDet: Trying to build Petal Wedge from Dets at different z positions !! Delta_z = -1.03584 >> cmd: %MSG >> cmd: Begin processing the 1st record. Run 1, Event 7, LumiSection 2440 on stream 0 at 25-May-2021 16:35:51.339 EDT >> cmd: Begin processing the 2nd record. Run 1, Event 1, LumiSection 2440 on stream 1 at 25-May-2021 16:35:51.342 EDT >> cmd: Begin processing the 3rd record. Run 1, Event 3, LumiSection 2440 on stream 2 at 25-May-2021 16:35:51.344 EDT >> cmd: Begin processing the 4th record. Run 1, Event 5, LumiSection 2440 on stream 1 at 25-May-2021 16:36:23.687 EDT >> cmd: Begin processing the 5th record. Run 1, Event 4, LumiSection 2440 on stream 0 at 25-May-2021 16:36:24.429 EDT >> cmd: Begin processing the 6th record. Run 1, Event 2, LumiSection 2440 on stream 2 at 25-May-2021 16:36:24.648 EDT >> cmd: Begin processing the 7th record. Run 1, Event 8, LumiSection 2440 on stream 1 at 25-May-2021 16:36:35.041 EDT >> cmd: Begin processing the 8th record. Run 1, Event 9, LumiSection 2440 on stream 0 at 25-May-2021 16:36:35.371 EDT >> cmd: Begin processing the 9th record. Run 1, Event 6, LumiSection 2440 on stream 2 at 25-May-2021 16:36:42.104 EDT >> cmd: Begin processing the 10th record. Run 1, Event 13, LumiSection 2440 on stream 1 at 25-May-2021 16:36:43.340 EDT >> cmd: Begin processing the 11th record. Run 1, Event 10, LumiSection 2440 on stream 0 at 25-May-2021 16:36:43.837 EDT >> cmd: Begin processing the 12th record. Run 1, Event 14, LumiSection 2440 on stream 1 at 25-May-2021 16:36:57.320 EDT >> cmd: Begin processing the 13th record. Run 1, Event 15, LumiSection 2440 on stream 2 at 25-May-2021 16:37:00.217 EDT >> cmd: Begin processing the 14th record. Run 1, Event 11, LumiSection 2440 on stream 0 at 25-May-2021 16:37:01.105 EDT >> cmd: Begin processing the 15th record. Run 1, Event 16, LumiSection 2440 on stream 2 at 25-May-2021 16:37:11.501 EDT >> cmd: Begin processing the 16th record. Run 1, Event 19, LumiSection 2440 on stream 0 at 25-May-2021 16:37:17.579 EDT >> cmd: Begin processing the 17th record. Run 1, Event 12, LumiSection 2440 on stream 1 at 25-May-2021 16:37:19.509 EDT >> cmd: Begin processing the 18th record. Run 1, Event 17, LumiSection 2440 on stream 2 at 25-May-2021 16:37:26.799 EDT >> cmd: Begin processing the 19th record. Run 1, Event 22, LumiSection 2440 on stream 0 at 25-May-2021 16:37:27.611 EDT >> cmd: Begin processing the 20th record. Run 1, Event 20, LumiSection 2440 on stream 0 at 25-May-2021 16:37:37.345 EDT >> cmd: Begin processing the 21st record. Run 1, Event 18, LumiSection 2440 on stream 1 at 25-May-2021 16:38:01.854 EDT >> cmd: Begin processing the 22nd record. Run 1, Event 24, LumiSection 2440 on stream 2 at 25-May-2021 16:38:02.940 EDT >> cmd: Begin processing the 23rd record. Run 1, Event 21, LumiSection 2440 on stream 0 at 25-May-2021 16:38:03.223 EDT >> cmd: Begin processing the 24th record. Run 1, Event 28, LumiSection 2440 on stream 2 at 25-May-2021 16:38:13.356 EDT >> cmd: %MSG-w OutOfBounds: TrackProducer:lowPtTripletStepTracks 25-May-2021 16:38:15 EDT Run: 1 Event: 28 >> cmd: Prob Q outside the bounds of the quality word. Defaulting to Prob=0. Prob = 1 QualityWord = 0 >> cmd: %MSG >> cmd: Begin processing the 25th record. Run 1, Event 25, LumiSection 2440 on stream 2 at 25-May-2021 16:38:20.380 EDT >> cmd: Begin processing the 26th record. Run 1, Event 27, LumiSection 2440 on stream 0 at 25-May-2021 16:38:26.194 EDT >> cmd: Begin processing the 27th record. Run 1, Event 23, LumiSection 2440 on stream 1 at 25-May-2021 16:38:27.531 EDT >> cmd: Begin processing the 28th record. Run 1, Event 33, LumiSection 2440 on stream 0 at 25-May-2021 16:38:32.036 EDT >> cmd: Begin processing the 29th record. Run 1, Event 26, LumiSection 2440 on stream 0 at 25-May-2021 16:38:40.851 EDT >> cmd: Begin processing the 30th record. Run 1, Event 29, LumiSection 2440 on stream 1 at 25-May-2021 16:38:41.800 EDT >> cmd: Begin processing the 31st record. Run 1, Event 31, LumiSection 2440 on stream 2 at 25-May-2021 16:38:43.387 EDT >> cmd: Begin processing the 32nd record. Run 1, Event 34, LumiSection 2440 on stream 0 at 25-May-2021 16:38:51.489 EDT >> cmd: Begin processing the 33rd record. Run 1, Event 30, LumiSection 2440 on stream 2 at 25-May-2021 16:38:54.662 EDT >> cmd: Begin processing the 34th record. Run 1, Event 32, LumiSection 2440 on stream 1 at 25-May-2021 16:39:03.371 EDT >> cmd: Begin processing the 35th record. Run 1, Event 35, LumiSection 2440 on stream 2 at 25-May-2021 16:39:14.622 EDT >> cmd: Begin processing the 36th record. Run 1, Event 36, LumiSection 2440 on stream 0 at 25-May-2021 16:39:19.854 EDT >> cmd: Begin processing the 37th record. Run 1, Event 39, LumiSection 2440 on stream 1 at 25-May-2021 16:39:28.642 EDT >> cmd: Begin processing the 38th record. Run 1, Event 38, LumiSection 2440 on stream 2 at 25-May-2021 16:39:37.433 EDT >> cmd: Begin processing the 39th record. Run 1, Event 40, LumiSection 2440 on stream 1 at 25-May-2021 16:39:37.456 EDT >> cmd: Begin processing the 40th record. Run 1, Event 41, LumiSection 2440 on stream 0 at 25-May-2021 16:39:41.344 EDT >> cmd: Begin processing the 41st record. Run 1, Event 37, LumiSection 2440 on stream 0 at 25-May-2021 16:39:51.667 EDT >> cmd: Begin processing the 42nd record. Run 1, Event 43, LumiSection 2440 on stream 2 at 25-May-2021 16:39:52.270 EDT >> cmd: Begin processing the 43rd record. Run 1, Event 45, LumiSection 2440 on stream 1 at 25-May-2021 16:39:52.636 EDT >> cmd: Begin processing the 44th record. Run 1, Event 42, LumiSection 2440 on stream 2 at 25-May-2021 16:40:02.224 EDT >> cmd: Begin processing the 45th record. Run 1, Event 44, LumiSection 2440 on stream 0 at 25-May-2021 16:40:05.094 EDT >> cmd: Begin processing the 46th record. Run 1, Event 47, LumiSection 2440 on stream 1 at 25-May-2021 16:40:13.387 EDT >> cmd: %MSG-w EnergyInDeadEB_FE: EcalRecHitProducer:ecalRecHit 25-May-2021 16:40:15 EDT Run: 1 Event: 47 >> cmd: TP energy in the dead TT = 50.5 at (EcalTT subDet Barrel iz + ieta 11 iphi 20) >> cmd: %MSG >> cmd: Begin processing the 47th record. Run 1, Event 46, LumiSection 2440 on stream 2 at 25-May-2021 16:40:22.464 EDT >> cmd: Begin processing the 48th record. Run 1, Event 49, LumiSection 2440 on stream 0 at 25-May-2021 16:40:29.251 EDT >> cmd: Begin processing the 49th record. Run 1, Event 51, LumiSection 2440 on stream 2 at 25-May-2021 16:40:39.883 EDT >> cmd: Begin processing the 50th record. Run 1, Event 50, LumiSection 2440 on stream 1 at 25-May-2021 16:40:41.023 EDT >> cmd: Begin processing the 51st record. Run 1, Event 48, LumiSection 2440 on stream 0 at 25-May-2021 16:40:42.628 EDT >> cmd: Begin processing the 52nd record. Run 1, Event 54, LumiSection 2440 on stream 2 at 25-May-2021 16:40:58.133 EDT >> cmd: Begin processing the 53rd record. Run 1, Event 53, LumiSection 2440 on stream 1 at 25-May-2021 16:41:00.728 EDT >> cmd: Begin processing the 54th record. Run 1, Event 52, LumiSection 2440 on stream 0 at 25-May-2021 16:41:09.164 EDT >> cmd: Begin processing the 55th record. Run 1, Event 58, LumiSection 2440 on stream 2 at 25-May-2021 16:41:09.903 EDT >> cmd: Begin processing the 56th record. Run 1, Event 59, LumiSection 2440 on stream 1 at 25-May-2021 16:41:17.720 EDT >> cmd: Begin processing the 57th record. Run 1, Event 57, LumiSection 2440 on stream 0 at 25-May-2021 16:41:24.364 EDT >> cmd: Begin processing the 58th record. Run 1, Event 55, LumiSection 2440 on stream 2 at 25-May-2021 16:41:25.362 EDT >> cmd: Begin processing the 59th record. Run 1, Event 61, LumiSection 2440 on stream 1 at 25-May-2021 16:41:32.535 EDT >> cmd: Begin processing the 60th record. Run 1, Event 60, LumiSection 2440 on stream 2 at 25-May-2021 16:41:36.391 EDT >> cmd: Begin processing the 61st record. Run 1, Event 64, LumiSection 2440 on stream 0 at 25-May-2021 16:41:58.822 EDT >> cmd: Begin processing the 62nd record. Run 1, Event 66, LumiSection 2440 on stream 1 at 25-May-2021 16:41:58.902 EDT >> cmd: Begin processing the 63rd record. Run 1, Event 56, LumiSection 2440 on stream 2 at 25-May-2021 16:41:59.292 EDT >> cmd: Begin processing the 64th record. Run 1, Event 62, LumiSection 2440 on stream 0 at 25-May-2021 16:42:09.965 EDT >> cmd: Begin processing the 65th record. Run 1, Event 63, LumiSection 2440 on stream 1 at 25-May-2021 16:42:13.261 EDT >> cmd: Begin processing the 66th record. Run 1, Event 65, LumiSection 2440 on stream 2 at 25-May-2021 16:42:19.001 EDT >> cmd: Begin processing the 67th record. Run 1, Event 67, LumiSection 2440 on stream 1 at 25-May-2021 16:42:24.978 EDT >> cmd: Begin processing the 68th record. Run 1, Event 71, LumiSection 2440 on stream 0 at 25-May-2021 16:42:26.464 EDT >> cmd: Begin processing the 69th record. Run 1, Event 69, LumiSection 2440 on stream 2 at 25-May-2021 16:42:29.634 EDT >> cmd: Begin processing the 70th record. Run 1, Event 72, LumiSection 2440 on stream 1 at 25-May-2021 16:42:33.300 EDT >> cmd: Begin processing the 71st record. Run 1, Event 70, LumiSection 2440 on stream 2 at 25-May-2021 16:42:35.495 EDT >> cmd: Begin processing the 72nd record. Run 1, Event 74, LumiSection 2440 on stream 0 at 25-May-2021 16:42:39.645 EDT >> cmd: Begin processing the 73rd record. Run 1, Event 73, LumiSection 2440 on stream 0 at 25-May-2021 16:42:47.620 EDT >> cmd: Begin processing the 74th record. Run 1, Event 68, LumiSection 2440 on stream 2 at 25-May-2021 16:42:49.803 EDT >> cmd: Begin processing the 75th record. Run 1, Event 76, LumiSection 2440 on stream 1 at 25-May-2021 16:43:02.317 EDT >> cmd: Begin processing the 76th record. Run 1, Event 75, LumiSection 2440 on stream 0 at 25-May-2021 16:43:03.782 EDT >> cmd: Begin processing the 77th record. Run 1, Event 79, LumiSection 2440 on stream 2 at 25-May-2021 16:43:14.222 EDT >> cmd: Begin processing the 78th record. Run 1, Event 78, LumiSection 2440 on stream 1 at 25-May-2021 16:43:15.653 EDT >> cmd: Begin processing the 79th record. Run 1, Event 77, LumiSection 2440 on stream 0 at 25-May-2021 16:43:24.605 EDT >> cmd: Begin processing the 80th record. Run 1, Event 80, LumiSection 2440 on stream 0 at 25-May-2021 16:43:36.439 EDT >> cmd: Begin processing the 81st record. Run 1, Event 82, LumiSection 2440 on stream 2 at 25-May-2021 16:43:51.089 EDT >> cmd: Begin processing the 82nd record. Run 1, Event 86, LumiSection 2440 on stream 1 at 25-May-2021 16:43:51.091 EDT >> cmd: Begin processing the 83rd record. Run 1, Event 84, LumiSection 2440 on stream 0 at 25-May-2021 16:43:51.572 EDT >> cmd: Begin processing the 84th record. Run 1, Event 83, LumiSection 2440 on stream 0 at 25-May-2021 16:43:57.102 EDT >> cmd: Begin processing the 85th record. Run 1, Event 81, LumiSection 2440 on stream 1 at 25-May-2021 16:43:59.302 EDT >> cmd: Begin processing the 86th record. Run 1, Event 85, LumiSection 2440 on stream 2 at 25-May-2021 16:44:05.087 EDT >> cmd: Begin processing the 87th record. Run 1, Event 88, LumiSection 2440 on stream 2 at 25-May-2021 16:44:13.492 EDT >> cmd: Begin processing the 88th record. Run 1, Event 90, LumiSection 2440 on stream 1 at 25-May-2021 16:44:17.752 EDT >> cmd: Begin processing the 89th record. Run 1, Event 87, LumiSection 2440 on stream 0 at 25-May-2021 16:44:19.115 EDT >> cmd: Begin processing the 90th record. Run 1, Event 89, LumiSection 2440 on stream 2 at 25-May-2021 16:44:19.365 EDT >> cmd: Begin processing the 91st record. Run 1, Event 93, LumiSection 2440 on stream 1 at 25-May-2021 16:44:25.386 EDT >> cmd: Begin processing the 92nd record. Run 1, Event 91, LumiSection 2440 on stream 2 at 25-May-2021 16:44:28.910 EDT >> cmd: Begin processing the 93rd record. Run 1, Event 96, LumiSection 2440 on stream 0 at 25-May-2021 16:44:30.350 EDT >> cmd: Begin processing the 94th record. Run 1, Event 94, LumiSection 2440 on stream 2 at 25-May-2021 16:44:40.069 EDT >> cmd: Begin processing the 95th record. Run 1, Event 101, LumiSection 2440 on stream 0 at 25-May-2021 16:44:41.358 EDT >> cmd: Begin processing the 96th record. Run 1, Event 92, LumiSection 2440 on stream 0 at 25-May-2021 16:44:45.009 EDT >> cmd: Begin processing the 97th record. Run 1, Event 97, LumiSection 2440 on stream 1 at 25-May-2021 16:44:45.012 EDT >> cmd: Begin processing the 98th record. Run 1, Event 95, LumiSection 2440 on stream 2 at 25-May-2021 16:44:47.814 EDT >> cmd: Begin processing the 99th record. Run 1, Event 98, LumiSection 2440 on stream 2 at 25-May-2021 16:44:53.852 EDT >> cmd: Begin processing the 100th record. Run 1, Event 102, LumiSection 2440 on stream 1 at 25-May-2021 16:45:00.881 EDT >> cmd: Begin processing the 101st record. Run 1, Event 103, LumiSection 2440 on stream 2 at 25-May-2021 16:45:02.861 EDT >> cmd: Begin processing the 102nd record. Run 1, Event 100, LumiSection 2440 on stream 0 at 25-May-2021 16:45:04.132 EDT >> cmd: %MSG-e TrajectoryNotPosDef: TrackProducer:pixelPairStepTracks 25-May-2021 16:45:11 EDT Run: 1 Event: 103 >> cmd: Trajectory covariance is not positive-definite >> cmd: %MSG >> cmd: Begin processing the 103rd record. Run 1, Event 99, LumiSection 2440 on stream 1 at 25-May-2021 16:45:15.206 EDT >> cmd: Begin processing the 104th record. Run 1, Event 105, LumiSection 2440 on stream 0 at 25-May-2021 16:45:16.948 EDT >> cmd: Begin processing the 105th record. Run 1, Event 108, LumiSection 2440 on stream 2 at 25-May-2021 16:45:22.263 EDT >> cmd: Begin processing the 106th record. Run 1, Event 106, LumiSection 2440 on stream 2 at 25-May-2021 16:45:34.431 EDT >> cmd: Begin processing the 107th record. Run 1, Event 104, LumiSection 2440 on stream 0 at 25-May-2021 16:45:38.712 EDT >> cmd: Begin processing the 108th record. Run 1, Event 107, LumiSection 2440 on stream 1 at 25-May-2021 16:45:40.333 EDT >> cmd: Begin processing the 109th record. Run 1, Event 109, LumiSection 2440 on stream 2 at 25-May-2021 16:45:44.143 EDT >> cmd: Begin processing the 110th record. Run 1, Event 110, LumiSection 2440 on stream 0 at 25-May-2021 16:45:47.986 EDT >> cmd: Begin processing the 111th record. Run 1, Event 111, LumiSection 2440 on stream 0 at 25-May-2021 16:46:06.701 EDT >> cmd: Begin processing the 112th record. Run 1, Event 115, LumiSection 2440 on stream 2 at 25-May-2021 16:46:07.741 EDT >> cmd: Begin processing the 113th record. Run 1, Event 113, LumiSection 2440 on stream 1 at 25-May-2021 16:46:20.881 EDT >> cmd: Begin processing the 114th record. Run 1, Event 114, LumiSection 2440 on stream 0 at 25-May-2021 16:46:21.869 EDT >> cmd: Begin processing the 115th record. Run 1, Event 116, LumiSection 2440 on stream 2 at 25-May-2021 16:46:22.290 EDT >> cmd: Begin processing the 116th record. Run 1, Event 112, LumiSection 2440 on stream 2 at 25-May-2021 16:46:30.628 EDT >> cmd: Begin processing the 117th record. Run 1, Event 117, LumiSection 2440 on stream 1 at 25-May-2021 16:46:30.631 EDT >> cmd: Begin processing the 118th record. Run 1, Event 120, LumiSection 2440 on stream 0 at 25-May-2021 16:46:34.700 EDT >> cmd: Begin processing the 119th record. Run 1, Event 118, LumiSection 2440 on stream 1 at 25-May-2021 16:46:51.791 EDT >> cmd: Begin processing the 120th record. Run 1, Event 121, LumiSection 2440 on stream 0 at 25-May-2021 16:46:51.794 EDT >> cmd: Begin processing the 121st record. Run 1, Event 122, LumiSection 2440 on stream 2 at 25-May-2021 16:46:53.317 EDT >> cmd: Begin processing the 122nd record. Run 1, Event 123, LumiSection 2440 on stream 2 at 25-May-2021 16:47:01.666 EDT >> cmd: Begin processing the 123rd record. Run 1, Event 119, LumiSection 2440 on stream 0 at 25-May-2021 16:47:07.586 EDT >> cmd: Begin processing the 124th record. Run 1, Event 127, LumiSection 2440 on stream 1 at 25-May-2021 16:47:08.363 EDT >> cmd: Begin processing the 125th record. Run 1, Event 124, LumiSection 2440 on stream 2 at 25-May-2021 16:47:12.671 EDT >> cmd: Begin processing the 126th record. Run 1, Event 126, LumiSection 2440 on stream 0 at 25-May-2021 16:47:22.515 EDT >> cmd: Begin processing the 127th record. Run 1, Event 130, LumiSection 2440 on stream 1 at 25-May-2021 16:47:22.660 EDT >> cmd: Begin processing the 128th record. Run 1, Event 125, LumiSection 2440 on stream 0 at 25-May-2021 16:47:30.047 EDT >> cmd: %MSG-w OutOfBounds: TrackProducer:initialStepTracks 25-May-2021 16:47:32 EDT Run: 1 Event: 125 >> cmd: Prob Q outside the bounds of the quality word. Defaulting to Prob=0. Prob = 1 QualityWord = 0 >> cmd: %MSG >> cmd: Begin processing the 129th record. Run 1, Event 129, LumiSection 2440 on stream 2 at 25-May-2021 16:47:34.100 EDT >> cmd: Begin processing the 130th record. Run 1, Event 133, LumiSection 2440 on stream 1 at 25-May-2021 16:47:37.449 EDT >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:pixelPairStepTracks 25-May-2021 16:47:41 EDT Run: 1 Event: 133 >> cmd: curv error not pos-def >> cmd: [ 5.98648 0.293908 23.7335 5.44279 284.672 >> cmd: 0.293908 -0.638487 0.102484 0.0222892 0.836612 >> cmd: 23.7335 0.102484 115.32 18.6596 398.552 >> cmd: 5.44279 0.0222892 18.6596 4.29782 224.786 >> cmd: 284.672 0.836612 398.552 224.786 21472.8 ] >> cmd: pos/mom/mf (12.9743,-23.488,39.4055) (0.143023,0.0946924,0.339423) (0.00104928,-0.00189956,3.80894) >> cmd: %MSG >> cmd: %MSG-w TrackNaN: TrackProducer:pixelPairStepTracks 25-May-2021 16:47:41 EDT Run: 1 Event: 133 >> cmd: Track has NaN or the cov is not pos-definite >> cmd: %MSG >> cmd: Begin processing the 131st record. Run 1, Event 128, LumiSection 2440 on stream 2 at 25-May-2021 16:47:47.361 EDT >> cmd: Begin processing the 132nd record. Run 1, Event 136, LumiSection 2440 on stream 1 at 25-May-2021 16:47:50.258 EDT >> cmd: Begin processing the 133rd record. Run 1, Event 132, LumiSection 2440 on stream 0 at 25-May-2021 16:47:50.998 EDT >> cmd: Begin processing the 134th record. Run 1, Event 131, LumiSection 2440 on stream 1 at 25-May-2021 16:47:59.335 EDT >> cmd: Begin processing the 135th record. Run 1, Event 134, LumiSection 2440 on stream 2 at 25-May-2021 16:48:00.294 EDT >> cmd: Begin processing the 136th record. Run 1, Event 137, LumiSection 2440 on stream 0 at 25-May-2021 16:48:03.330 EDT >> cmd: Begin processing the 137th record. Run 1, Event 138, LumiSection 2440 on stream 0 at 25-May-2021 16:48:11.599 EDT >> cmd: Begin processing the 138th record. Run 1, Event 140, LumiSection 2440 on stream 2 at 25-May-2021 16:48:13.040 EDT >> cmd: Begin processing the 139th record. Run 1, Event 135, LumiSection 2440 on stream 2 at 25-May-2021 16:48:19.477 EDT >> cmd: Begin processing the 140th record. Run 1, Event 142, LumiSection 2440 on stream 1 at 25-May-2021 16:48:19.933 EDT >> cmd: Begin processing the 141st record. Run 1, Event 141, LumiSection 2440 on stream 0 at 25-May-2021 16:48:20.120 EDT >> cmd: Begin processing the 142nd record. Run 1, Event 148, LumiSection 2440 on stream 1 at 25-May-2021 16:48:26.080 EDT >> cmd: Begin processing the 143rd record. Run 1, Event 139, LumiSection 2440 on stream 1 at 25-May-2021 16:48:29.893 EDT >> cmd: Begin processing the 144th record. Run 1, Event 143, LumiSection 2440 on stream 2 at 25-May-2021 16:48:37.105 EDT >> cmd: Begin processing the 145th record. Run 1, Event 147, LumiSection 2440 on stream 0 at 25-May-2021 16:48:45.568 EDT >> cmd: Begin processing the 146th record. Run 1, Event 145, LumiSection 2440 on stream 1 at 25-May-2021 16:48:47.510 EDT >> cmd: Begin processing the 147th record. Run 1, Event 144, LumiSection 2440 on stream 2 at 25-May-2021 16:48:50.765 EDT >> cmd: Begin processing the 148th record. Run 1, Event 153, LumiSection 2440 on stream 0 at 25-May-2021 16:48:55.956 EDT >> cmd: %MSG-e TrajectoryNotPosDef: TrackProducer:pixelPairStepTracks 25-May-2021 16:48:57 EDT Run: 1 Event: 145 >> cmd: Trajectory covariance is not positive-definite >> cmd: %MSG >> cmd: Begin processing the 149th record. Run 1, Event 151, LumiSection 2440 on stream 0 at 25-May-2021 16:49:02.734 EDT >> cmd: Begin processing the 150th record. Run 1, Event 150, LumiSection 2440 on stream 1 at 25-May-2021 16:49:12.032 EDT >> cmd: Begin processing the 151st record. Run 1, Event 149, LumiSection 2440 on stream 2 at 25-May-2021 16:49:14.725 EDT >> cmd: Begin processing the 152nd record. Run 1, Event 152, LumiSection 2440 on stream 0 at 25-May-2021 16:49:14.730 EDT >> cmd: Begin processing the 153rd record. Run 1, Event 146, LumiSection 2440 on stream 1 at 25-May-2021 16:49:22.173 EDT >> cmd: Begin processing the 154th record. Run 1, Event 157, LumiSection 2440 on stream 0 at 25-May-2021 16:49:25.852 EDT >> cmd: Begin processing the 155th record. Run 1, Event 159, LumiSection 2440 on stream 0 at 25-May-2021 16:49:35.651 EDT >> cmd: Begin processing the 156th record. Run 1, Event 156, LumiSection 2440 on stream 2 at 25-May-2021 16:49:41.334 EDT >> cmd: Begin processing the 157th record. Run 1, Event 155, LumiSection 2440 on stream 1 at 25-May-2021 16:49:42.514 EDT >> cmd: Begin processing the 158th record. Run 1, Event 154, LumiSection 2440 on stream 0 at 25-May-2021 16:49:48.944 EDT >> cmd: Begin processing the 159th record. Run 1, Event 158, LumiSection 2440 on stream 0 at 25-May-2021 16:49:56.734 EDT >> cmd: Begin processing the 160th record. Run 1, Event 160, LumiSection 2440 on stream 1 at 25-May-2021 16:49:59.436 EDT >> cmd: Begin processing the 161st record. Run 1, Event 161, LumiSection 2440 on stream 2 at 25-May-2021 16:50:00.708 EDT >> cmd: Begin processing the 162nd record. Run 1, Event 163, LumiSection 2440 on stream 0 at 25-May-2021 16:50:04.142 EDT >> cmd: Begin processing the 163rd record. Run 1, Event 162, LumiSection 2440 on stream 0 at 25-May-2021 16:50:12.197 EDT >> cmd: Begin processing the 164th record. Run 1, Event 164, LumiSection 2440 on stream 2 at 25-May-2021 16:50:12.235 EDT >> cmd: Begin processing the 165th record. Run 1, Event 165, LumiSection 2440 on stream 1 at 25-May-2021 16:50:14.893 EDT >> cmd: Begin processing the 166th record. Run 1, Event 166, LumiSection 2440 on stream 2 at 25-May-2021 16:50:19.795 EDT >> cmd: Begin processing the 167th record. Run 1, Event 168, LumiSection 2440 on stream 0 at 25-May-2021 16:50:31.306 EDT >> cmd: Begin processing the 168th record. Run 1, Event 167, LumiSection 2440 on stream 1 at 25-May-2021 16:50:35.511 EDT >> cmd: Begin processing the 169th record. Run 1, Event 169, LumiSection 2440 on stream 0 at 25-May-2021 16:50:47.646 EDT >> cmd: Begin processing the 170th record. Run 1, Event 174, LumiSection 2440 on stream 1 at 25-May-2021 16:50:49.046 EDT >> cmd: Begin processing the 171st record. Run 1, Event 171, LumiSection 2440 on stream 0 at 25-May-2021 16:50:55.551 EDT >> cmd: Begin processing the 172nd record. Run 1, Event 175, LumiSection 2440 on stream 2 at 25-May-2021 16:51:02.547 EDT >> cmd: Begin processing the 173rd record. Run 1, Event 172, LumiSection 2440 on stream 1 at 25-May-2021 16:51:03.910 EDT >> cmd: Begin processing the 174th record. Run 1, Event 170, LumiSection 2440 on stream 0 at 25-May-2021 16:51:05.285 EDT >> cmd: Begin processing the 175th record. Run 1, Event 176, LumiSection 2440 on stream 2 at 25-May-2021 16:51:09.009 EDT >> cmd: Begin processing the 176th record. Run 1, Event 179, LumiSection 2440 on stream 2 at 25-May-2021 16:51:18.111 EDT >> cmd: Begin processing the 177th record. Run 1, Event 173, LumiSection 2440 on stream 1 at 25-May-2021 16:51:37.151 EDT >> cmd: Begin processing the 178th record. Run 1, Event 177, LumiSection 2440 on stream 0 at 25-May-2021 16:51:37.287 EDT >> cmd: Begin processing the 179th record. Run 1, Event 178, LumiSection 2440 on stream 2 at 25-May-2021 16:51:37.366 EDT >> cmd: Begin processing the 180th record. Run 1, Event 183, LumiSection 2440 on stream 2 at 25-May-2021 16:51:49.154 EDT >> cmd: Begin processing the 181st record. Run 1, Event 181, LumiSection 2440 on stream 1 at 25-May-2021 16:51:49.443 EDT >> cmd: Begin processing the 182nd record. Run 1, Event 187, LumiSection 2440 on stream 0 at 25-May-2021 16:51:49.642 EDT >> cmd: Begin processing the 183rd record. Run 1, Event 182, LumiSection 2440 on stream 2 at 25-May-2021 16:51:53.770 EDT >> cmd: Begin processing the 184th record. Run 1, Event 180, LumiSection 2440 on stream 0 at 25-May-2021 16:52:05.890 EDT >> cmd: Begin processing the 185th record. Run 1, Event 184, LumiSection 2440 on stream 2 at 25-May-2021 16:52:09.514 EDT >> cmd: Begin processing the 186th record. Run 1, Event 188, LumiSection 2440 on stream 1 at 25-May-2021 16:52:16.484 EDT >> cmd: Begin processing the 187th record. Run 1, Event 192, LumiSection 2440 on stream 2 at 25-May-2021 16:52:21.920 EDT >> cmd: Begin processing the 188th record. Run 1, Event 186, LumiSection 2440 on stream 0 at 25-May-2021 16:52:25.178 EDT >> cmd: Begin processing the 189th record. Run 1, Event 191, LumiSection 2440 on stream 2 at 25-May-2021 16:52:33.482 EDT >> cmd: Begin processing the 190th record. Run 1, Event 190, LumiSection 2440 on stream 1 at 25-May-2021 16:52:33.811 EDT >> cmd: Begin processing the 191st record. Run 1, Event 185, LumiSection 2440 on stream 0 at 25-May-2021 16:52:48.565 EDT >> cmd: Begin processing the 192nd record. Run 1, Event 193, LumiSection 2440 on stream 2 at 25-May-2021 16:52:49.938 EDT >> cmd: Begin processing the 193rd record. Run 1, Event 189, LumiSection 2440 on stream 1 at 25-May-2021 16:52:51.639 EDT >> cmd: Begin processing the 194th record. Run 1, Event 194, LumiSection 2440 on stream 2 at 25-May-2021 16:53:00.703 EDT >> cmd: Begin processing the 195th record. Run 1, Event 195, LumiSection 2440 on stream 1 at 25-May-2021 16:53:10.827 EDT >> cmd: Begin processing the 196th record. Run 1, Event 197, LumiSection 2440 on stream 0 at 25-May-2021 16:53:12.005 EDT >> cmd: Begin processing the 197th record. Run 1, Event 199, LumiSection 2440 on stream 2 at 25-May-2021 16:53:16.232 EDT >> cmd: Begin processing the 198th record. Run 1, Event 196, LumiSection 2440 on stream 1 at 25-May-2021 16:53:16.970 EDT >> cmd: Begin processing the 199th record. Run 1, Event 200, LumiSection 2440 on stream 0 at 25-May-2021 16:53:24.741 EDT >> cmd: Begin processing the 200th record. Run 1, Event 201, LumiSection 2440 on stream 0 at 25-May-2021 16:53:32.519 EDT >> cmd: Begin processing the 201st record. Run 1, Event 203, LumiSection 2440 on stream 2 at 25-May-2021 16:53:36.528 EDT >> cmd: %MSG-w Muon: GlobalMuonProducer:displacedGlobalMuons 25-May-2021 16:53:45 EDT Run: 1 Event: 196 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w RecoMuon: GlobalMuonProducer:displacedGlobalMuons 25-May-2021 16:53:45 EDT Run: 1 Event: 196 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w GlobalMuon: GlobalMuonProducer:displacedGlobalMuons 25-May-2021 16:53:45 EDT Run: 1 Event: 196 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: %MSG-w GlobalTrajectoryBuilderBase: GlobalMuonProducer:displacedGlobalMuons 25-May-2021 16:53:45 EDT Run: 1 Event: 196 >> cmd: Failed to load tracker track trajectory >> cmd: %MSG >> cmd: Begin processing the 202nd record. Run 1, Event 202, LumiSection 2440 on stream 1 at 25-May-2021 16:53:46.892 EDT >> cmd: Begin processing the 203rd record. Run 1, Event 207, LumiSection 2440 on stream 2 at 25-May-2021 16:53:55.237 EDT >> cmd: Begin processing the 204th record. Run 1, Event 198, LumiSection 2440 on stream 0 at 25-May-2021 16:53:56.957 EDT >> cmd: Begin processing the 205th record. Run 1, Event 205, LumiSection 2440 on stream 1 at 25-May-2021 16:54:00.830 EDT >> cmd: Begin processing the 206th record. Run 1, Event 204, LumiSection 2440 on stream 2 at 25-May-2021 16:54:05.797 EDT >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:pixelPairStepTracks 25-May-2021 16:54:07 EDT Run: 1 Event: 205 >> cmd: curv error not pos-def >> cmd: [ 348774 0.339371 -26312.3 17.228 0.810998 >> cmd: 0.339371 0.000646481 -0.025603 1.58022e-05 0.00853284 >> cmd: -26312.3 -0.025603 1985.05 -1.30087 -0.0611846 >> cmd: 17.228 1.58022e-05 -1.30087 -0.0142563 2.78486e-05 >> cmd: 0.810998 0.00853284 -0.0611846 2.78486e-05 0.112679 ] >> cmd: pos/mom/mf (3.71487,-15.373,-1.58733) (76.3653,-318.182,-46.4259) (-2.81564e-05,0.000116518,3.81142) >> cmd: %MSG >> cmd: %MSG-w BasicTrajectoryState: TrackProducer:pixelPairStepTracks 25-May-2021 16:54:07 EDT Run: 1 Event: 205 >> cmd: local error not pos-def >> cmd: [ 348774 26314.4 -32.877 17.2287 -0.840874 >> cmd: 26314.4 1985.37 -2.48051 1.30103 -0.0634447 >> cmd: -32.877 -2.48051 0.00377161 -0.00162658 -0.00871211 >> cmd: 17.2287 1.30103 -0.00162658 -0.0142574-9.00942e-06 >> cmd: -0.840874 -0.0634447 -0.00871211-9.00942e-06 0.114948 ] >> cmd: pos/mom/mf (3.71487,-15.373,-1.58733) (76.3653,-318.182,-46.4259) (-2.81564e-05,0.000116518,3.81142) >> cmd: %MSG >> cmd: Begin processing the 207th record. Run 1, Event 206, LumiSection 2440 on stream 1 at 25-May-2021 16:54:16.971 EDT >> cmd: Begin processing the 208th record. Run 1, Event 210, LumiSection 2440 on stream 2 at 25-May-2021 16:54:20.763 EDT >> cmd: Begin processing the 209th record. Run 1, Event 208, LumiSection 2440 on stream 0 at 25-May-2021 16:54:21.134 EDT >> cmd: Begin processing the 210th record. Run 1, Event 209, LumiSection 2440 on stream 2 at 25-May-2021 16:54:29.688 EDT >> cmd: Begin processing the 211th record. Run 1, Event 215, LumiSection 2440 on stream 1 at 25-May-2021 16:54:30.512 EDT >> cmd: Begin processing the 212th record. Run 1, Event 212, LumiSection 2440 on stream 0 at 25-May-2021 16:54:40.744 EDT >> cmd: Begin processing the 213th record. Run 1, Event 211, LumiSection 2440 on stream 1 at 25-May-2021 16:54:41.259 EDT >> cmd: Begin processing the 214th record. Run 1, Event 214, LumiSection 2440 on stream 2 at 25-May-2021 16:54:44.177 EDT >> cmd: Begin processing the 215th record. Run 1, Event 216, LumiSection 2440 on stream 1 at 25-May-2021 16:54:51.716 EDT >> cmd: Begin processing the 216th record. Run 1, Event 221, LumiSection 2440 on stream 0 at 25-May-2021 16:55:00.000 EDT >> cmd: Begin processing the 217th record. Run 1, Event 213, LumiSection 2440 on stream 2 at 25-May-2021 16:55:02.451 EDT >> cmd: Begin processing the 218th record. Run 1, Event 219, LumiSection 2440 on stream 1 at 25-May-2021 16:55:03.746 EDT >> cmd: Begin processing the 219th record. Run 1, Event 218, LumiSection 2440 on stream 0 at 25-May-2021 16:55:15.035 EDT >> cmd: Begin processing the 220th record. Run 1, Event 220, LumiSection 2440 on stream 1 at 25-May-2021 16:55:19.442 EDT >> cmd: Begin processing the 221st record. Run 1, Event 217, LumiSection 2440 on stream 2 at 25-May-2021 16:55:48.540 EDT >> cmd: Begin processing the 222nd record. Run 1, Event 225, LumiSection 2440 on stream 1 at 25-May-2021 16:55:49.909 EDT >> cmd: Begin processing the 223rd record. Run 1, Event 222, LumiSection 2440 on stream 0 at 25-May-2021 16:55:50.497 EDT >> cmd: Begin processing the 224th record. Run 1, Event 224, LumiSection 2440 on stream 1 at 25-May-2021 16:56:00.493 EDT >> cmd: Begin processing the 225th record. Run 1, Event 226, LumiSection 2440 on stream 0 at 25-May-2021 16:56:01.506 EDT >> cmd: Begin processing the 226th record. Run 1, Event 228, LumiSection 2440 on stream 2 at 25-May-2021 16:56:05.191 EDT >> cmd: Begin processing the 227th record. Run 1, Event 223, LumiSection 2440 on stream 0 at 25-May-2021 16:56:13.592 EDT >> cmd: Begin processing the 228th record. Run 1, Event 229, LumiSection 2440 on stream 2 at 25-May-2021 16:56:18.578 EDT >> cmd: Begin processing the 229th record. Run 1, Event 230, LumiSection 2440 on stream 1 at 25-May-2021 16:56:19.262 EDT >> cmd: Begin processing the 230th record. Run 1, Event 227, LumiSection 2440 on stream 2 at 25-May-2021 16:56:29.187 EDT >> cmd: Begin processing the 231st record. Run 1, Event 232, LumiSection 2440 on stream 0 at 25-May-2021 16:56:29.189 EDT >> cmd: Begin processing the 232nd record. Run 1, Event 234, LumiSection 2440 on stream 1 at 25-May-2021 16:56:31.979 EDT >> cmd: Begin processing the 233rd record. Run 1, Event 231, LumiSection 2440 on stream 0 at 25-May-2021 16:56:37.781 EDT >> cmd: Begin processing the 234th record. Run 1, Event 236, LumiSection 2440 on stream 2 at 25-May-2021 16:56:45.918 EDT >> cmd: Begin processing the 235th record. Run 1, Event 233, LumiSection 2440 on stream 1 at 25-May-2021 16:57:05.563 EDT >> cmd: Begin processing the 236th record. Run 1, Event 237, LumiSection 2440 on stream 0 at 25-May-2021 16:57:05.566 EDT >> cmd: Begin processing the 237th record. Run 1, Event 239, LumiSection 2440 on stream 2 at 25-May-2021 16:57:07.125 EDT >> cmd: Begin processing the 238th record. Run 1, Event 238, LumiSection 2440 on stream 2 at 25-May-2021 16:57:20.647 EDT >> cmd: Begin processing the 239th record. Run 1, Event 235, LumiSection 2440 on stream 0 at 25-May-2021 16:57:24.465 EDT >> cmd: Begin processing the 240th record. Run 1, Event 240, LumiSection 2440 on stream 1 at 25-May-2021 16:57:25.113 EDT >> cmd: Begin processing the 241st record. Run 1, Event 242, LumiSection 2440 on stream 2 at 25-May-2021 16:57:49.096 EDT >> cmd: Begin processing the 242nd record. Run 1, Event 241, LumiSection 2440 on stream 0 at 25-May-2021 16:57:51.151 EDT >> cmd: Begin processing the 243rd record. Run 1, Event 245, LumiSection 2440 on stream 1 at 25-May-2021 16:57:57.152 EDT >> cmd: Begin processing the 244th record. Run 1, Event 248, LumiSection 2440 on stream 2 at 25-May-2021 16:58:00.279 EDT >> cmd: Begin processing the 245th record. Run 1, Event 244, LumiSection 2440 on stream 0 at 25-May-2021 16:58:07.005 EDT >> cmd: Begin processing the 246th record. Run 1, Event 243, LumiSection 2440 on stream 2 at 25-May-2021 16:58:07.322 EDT >> cmd: Begin processing the 247th record. Run 1, Event 249, LumiSection 2440 on stream 1 at 25-May-2021 16:58:08.402 EDT >> cmd: Begin processing the 248th record. Run 1, Event 247, LumiSection 2440 on stream 0 at 25-May-2021 16:58:20.678 EDT >> cmd: Begin processing the 249th record. Run 1, Event 246, LumiSection 2440 on stream 2 at 25-May-2021 16:58:21.674 EDT >> cmd: Begin processing the 250th record. Run 1, Event 255, LumiSection 2440 on stream 1 at 25-May-2021 16:58:26.982 EDT >> cmd: Begin processing the 251st record. Run 1, Event 251, LumiSection 2440 on stream 0 at 25-May-2021 16:58:33.939 EDT >> cmd: Begin processing the 252nd record. Run 1, Event 253, LumiSection 2440 on stream 2 at 25-May-2021 16:58:35.470 EDT >> cmd: Begin processing the 253rd record. Run 1, Event 256, LumiSection 2440 on stream 1 at 25-May-2021 16:58:36.106 EDT >> cmd: Begin processing the 254th record. Run 1, Event 254, LumiSection 2440 on stream 2 at 25-May-2021 16:58:44.253 EDT >> cmd: Begin processing the 255th record. Run 1, Event 260, LumiSection 2440 on stream 0 at 25-May-2021 16:58:45.514 EDT >> cmd: Begin processing the 256th record. Run 1, Event 250, LumiSection 2440 on stream 1 at 25-May-2021 16:58:53.345 EDT >> cmd: Begin processing the 257th record. Run 1, Event 259, LumiSection 2440 on stream 0 at 25-May-2021 16:58:57.875 EDT >> cmd: Begin processing the 258th record. Run 1, Event 258, LumiSection 2440 on stream 2 at 25-May-2021 16:59:10.179 EDT >> cmd: Begin processing the 259th record. Run 1, Event 252, LumiSection 2440 on stream 0 at 25-May-2021 16:59:11.107 EDT >> cmd: [2021-05-25 17:02:21.408504 -0400][Error ][XRootD ] [primeradiant05.crc.nd.edu:1096] Unable to get the response to request kXR_readv (handle: 0x00000000, chunks: 66, total size: 20515198) >> cmd: [2021-05-25 17:02:21.409456 -0400][Error ][File ] [0xc2a05000@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1/hlt_step_tttt_FourtopsMay3v1_run0/HLT-00000_226853.root?tried=primeradiant02.crc.nd.edu,primeradiant04.crc.nd.edu,primeradiant06.crc.nd.edu,primeradiant03.crc.nd.edu,primeradiant01.crc.nd.edu] Fatal file state error. Message kXR_readv (handle: 0x00000000, chunks: 66, total size: 20515198) returned with [ERROR] Operation expired >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 25-May-2021 17:02:21 EDT pre-events >> cmd: XrdRequestManager::handle(name='root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/FullR2/UL18/Round1/Batch4/postLHE_step/v1/hlt_step_tttt_FourtopsMay3v1_run0/HLT-00000_226853.root) failure when reading from primeradiant05.crc.nd.edu:1096 (site T3_US_NotreDame); failed with error '[ERROR] Operation expired' (errno=0, code=206). >> cmd: %MSG >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 25-May-2021 17:02:21 EDT pre-events >> cmd: Request failure when reading from primeradiant05.crc.nd.edu:1096 (site T3_US_NotreDame) >> cmd: %MSG >> cmd: %MSG-w XrdAdaptor: (NoModuleName) 25-May-2021 17:02:21 EDT pre-events >> cmd: Data is now served from instead of previous T3_US_NotreDame >> cmd: %MSG >> cmd: %MSG-w XrdAdaptorInternal: (NoModuleName) 25-May-2021 17:02:21 EDT pre-events >> cmd: Caught a CMSSW exception when running connection recovery. >> cmd: %MSG >> cmd: Begin processing the 260th record. Run 1, Event 261, LumiSection 2440 on stream 1 at 25-May-2021 17:02:21.426 EDT >> cmd: ----- Begin Fatal Exception >> cmd: >> cmd: A fatal system signal has occurred: segmentation violation >> cmd: The following is the call stack containing the origin of the signal. >> cmd: >> cmd: Tue May 25 17:02:21 EDT 2021 >> cmd: >> cmd: Current Modules: >> cmd: >> cmd: Module: none (crashed) >> cmd: Module: none >> cmd: Module: none[2021-05-25 17:02:24.575291 -0400][Error ][XRootDTransport ] Message 0xd4c06090, stream [1, 0] is a response that we're no longer interested in (timed out) >> cmd: >> cmd: >> cmd: A fatal system signal has occurred: segmentation violation >> cmd: 25-May-2021 17:02:21 EDT----------------------- >>> executable returned with exit code -11. @ Tue May 25 17:02:28 2021 >> trace: Traceback (most recent call last): >> trace: File "task.py", line 268, in wrapper >> trace: result = fct(data, *args, **kwargs) >> trace: File "task.py", line 897, in parse_fwk_report >> trace: report.parse(report_filename) >> trace: File "/disk/vc3-root/tmp/worker-230547-15795/t.229067/python/WMCore/FwkJobReport/Report.py", line 160, in parse >> trace: raise FwkJobReportException(msg) >> trace: FwkJobReportException: FwkJobReportException >> trace: Message: Error reading XML job report file, possibly corrupt XML File: >> trace: Details: no element found: line 1, column 0 >> trace: ModuleName : WMCore.FwkJobReport.Report >> trace: MethodName : parse >> trace: ClassInstance : None >> trace: FileName : /disk/vc3-root/tmp/worker-230547-15795/t.229067/python/WMCore/FwkJobReport/Report.py >> trace: ClassName : None >> trace: LineNumber : 160 >> trace: ErrorNr : 0 >> trace: >> trace: Traceback: >> trace: File "/disk/vc3-root/tmp/worker-230547-15795/t.229067/python/WMCore/FwkJobReport/Report.py", line 147, in parse >> trace: xmlToJobReport(self, xmlfile) >> trace: >> trace: File "/disk/vc3-root/tmp/worker-230547-15795/t.229067/python/WMCore/FwkJobReport/XMLParser.py", line 495, in xmlToJobReport >> trace: node = xmlFileToNode(xmlFile) >> trace: >> trace: File "/disk/vc3-root/tmp/worker-230547-15795/t.229067/python/WMCore/Algorithms/ParseXMLFile.py", line 67, in xmlFileToNode >> trace: build(node)) >> trace: >> trace: File "/disk/vc3-root/tmp/worker-230547-15795/t.229067/python/WMCore/Algorithms/ParseXMLFile.py", line 88, in expat_parse >> trace: parser.ParseFile(f) >> trace: >> trace: >>>>> call to 'parse_fwk_report' failed, exiting with exit code -11 @ Tue May 25 17:02:29 2021 Tue May 25 16:31:48 2021: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Tue May 25 16:31:49 2021: ApMon[WARNING]: Not sending parameters since no destination is defined. Tue May 25 16:31:49 2021: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. Tue May 25 17:02:28 2021: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Tue May 25 17:02:29 2021: ApMon[WARNING]: Not sending parameters since no destination is defined. Tue May 25 17:02:29 2021: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. >> Execution time -1621974682 >> Exiting with code -11 >> Reporting ExeExitCode -11 >> Reporting StageOutSE >> Reporting StageOutExitCode 0 Tue May 25 17:02:29 2021: ApMon[ERROR]: Error resolving cms-jobmon.cern.ch: [Errno -2] Name or service not known Tue May 25 17:02:30 2021: ApMon[WARNING]: Not sending parameters since no destination is defined. Tue May 25 17:02:30 2021: ApMon[DEBUG]: Closing UDP socket on ApMon object destroy. ==== working directory after execution @ Tue May 25 17:02:30 EDT 2021 ==== == dir: total 140768 == dir: drwxr-xr-x 18 kmohrman campus 215 May 25 16:31 CMSSW_10_6_17_patch1 == dir: -rw-r--r-- 1 kmohrman campus 143239712 May 25 16:59 RECO-00000.root == dir: -rw-r--r-- 2 kmohrman campus 4482 May 25 16:30 UL18_RECO_cfg.py == dir: -rw-r--r-- 1 kmohrman campus 6125 May 25 16:31 UL18_RECO_cfg_mod.py == dir: drwxr-xr-x 2 kmohrman campus 71 May 25 16:30 bin == dir: -rwxr-xr-x 3 kmohrman campus 627272 May 25 12:52 cctools-monitor == dir: -rw-r--r-- 1 kmohrman campus 0 May 25 16:30 cctools-monitor.summary == dir: drwxrwxrwx 2 kmohrman campus 6 May 25 17:02 cctools-temp-t.229067.gL72J9 == dir: -rw------- 1 kmohrman campus 51 May 25 16:31 cvmfschecksum.cms-ib.cern.ch == dir: -rw------- 1 kmohrman campus 51 May 25 16:31 cvmfschecksum.cms.cern.ch == dir: -rw------- 1 kmohrman campus 51 May 25 16:31 cvmfschecksum.oasis.opensciencegrid.org == dir: drwxr-xr-x 2 kmohrman campus 33 May 25 16:30 lib == dir: -rwxrwxrwx 1 kmohrman campus 146912 May 25 16:30 librmonitor_helper.so.GJwIO0 == dir: -rw-r--r-- 2 kmohrman campus 2152 May 25 16:30 parameters.json == dir: -rw------- 2 kmohrman campus 9917 May 25 16:30 proxy == dir: drwxr-xr-x 3 kmohrman campus 20 May 25 16:30 python == dir: -rw-r--r-- 1 kmohrman campus 742 May 25 17:02 report.json == dir: -rw-r--r-- 3 kmohrman campus 570 May 25 12:52 report.json.in == dir: -rw-r--r-- 1 kmohrman campus 0 May 25 16:31 report.xml == dir: -rw-r--r-- 1 kmohrman campus 31 May 25 17:02 report.xml.gz == dir: -rw-r--r-- 3 kmohrman campus 593 May 25 12:52 sandbox-CMSSW_10_6_17_patch1-slc7_amd64_gcc700.tar.bz2 == dir: drwxr-xr-x 4 kmohrman campus 37 May 25 16:30 siteconf == dir: -rw-r--r-- 1 kmohrman campus 11 May 25 16:31 t_wrapper_ready == dir: -rw-r--r-- 1 kmohrman campus 11 May 25 16:31 t_wrapper_start == dir: -rwxr-xr-x 3 kmohrman campus 47217 May 25 12:52 task.py == dir: -rwxr-xr-x 3 kmohrman campus 5986 May 25 12:52 wrapper.sh === wrapper done @ Tue May 25 17:02:30 EDT 2021 === final return status = 245 @ Tue May 25 17:02:31 EDT 2021