xrdcp -d 2 -f root://deepthought.crc.nd.edu//store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/mAOD_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17MiniAOD-00821ND_24549.root /dev/null [2022-05-13 16:45:21.809384 -0400][Debug ][Utility ] CopyProcess: 2 jobs to prepare [2022-05-13 16:45:21.809620 -0400][Debug ][Utility ] Creating a classic copy job, from root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/mAOD_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17MiniAOD-00821ND_24549.root to file://localhost/dev/null [2022-05-13 16:45:21.809693 -0400][Debug ][Utility ] Monitor library name not set. No monitoring [2022-05-13 16:45:21.809811 -0400][Debug ][Utility ] Env: trying to get a non-existent string entry: pollerpreference [2022-05-13 16:45:21.809869 -0400][Debug ][Poller ] Available pollers: built-in [2022-05-13 16:45:21.809919 -0400][Debug ][Poller ] Attempting to create a poller according to preference: built-in [2022-05-13 16:45:21.809968 -0400][Debug ][Poller ] Creating poller: built-in [2022-05-13 16:45:21.809996 -0400][Debug ][Poller ] Creating and starting the built-in poller... [2022-05-13 16:45:21.810254 -0400][Debug ][Poller ] Using 1 poller threads [2022-05-13 16:45:21.810292 -0400][Debug ][TaskMgr ] Starting the task manager... [2022-05-13 16:45:21.810357 -0400][Debug ][TaskMgr ] Task manager started [2022-05-13 16:45:21.810387 -0400][Debug ][JobMgr ] Starting the job manager... [2022-05-13 16:45:21.810527 -0400][Debug ][JobMgr ] Job manager started, 3 workers [2022-05-13 16:45:21.810562 -0400][Debug ][TaskMgr ] Registering task: "FileTimer task" to be run at: [2022-05-13 16:45:21 -0400] [2022-05-13 16:45:21.810726 -0400][Debug ][Utility ] Opening root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/mAOD_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17MiniAOD-00821ND_24549.root for reading [2022-05-13 16:45:21.810870 -0400][Debug ][File ] [0xfb691bd0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/mAOD_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17MiniAOD-00821ND_24549.root?xrdcl.requuid=780e9e03-e663-48cd-805c-24b689b916ef] Sending an open command [2022-05-13 16:45:21.810945 -0400][Debug ][ExDbgMsg ] [deepthought.crc.nd.edu:1094] MsgHandler created: 0xfb698b20 (message: kXR_open (file: /store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/mAOD_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17MiniAOD-00821ND_24549.root, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) ). [2022-05-13 16:45:21.811025 -0400][Debug ][PostMaster ] Creating new channel to: root://deepthought.crc.nd.edu:1094 [2022-05-13 16:45:21.811079 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Window: 1800 [2022-05-13 16:45:21.811126 -0400][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: root://deepthought.crc.nd.edu:1094" to be run at: [2022-05-13 16:45:36 -0400] [2022-05-13 16:45:21.811674 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 [2022-05-13 16:45:21.811726 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094.0] Attempting connection to [::ffff:129.74.85.55]:1094 [2022-05-13 16:45:21.811785 -0400][Debug ][Poller ] Adding socket 0xfb69a120 to the poller [2022-05-13 16:45:21.812058 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094.0] Async connection call returned [2022-05-13 16:45:21.812121 -0400][Error ][AsyncSock ] [deepthought.crc.nd.edu:1094.0] Unable to connect: connection refused [2022-05-13 16:45:21.812136 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094.0] Closing the socket [2022-05-13 16:45:21.812151 -0400][Debug ][Poller ] <--> Removing socket from the poller [2022-05-13 16:45:21.812190 -0400][Error ][PostMaster ] [deepthought.crc.nd.edu:1094] elapsed = 0, pConnectionWindow = 120 seconds. [2022-05-13 16:45:21.812201 -0400][Info ][PostMaster ] [deepthought.crc.nd.edu:1094] Attempting reconnection in 120 seconds. [2022-05-13 16:45:21.812214 -0400][Debug ][TaskMgr ] Registering task: "StreamConnectorTask for deepthought.crc.nd.edu:1094" to be run at: [2022-05-13 16:47:21 -0400] [2022-05-13 16:47:21.819820 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 [2022-05-13 16:47:21.819913 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094.0] Attempting connection to [::ffff:129.74.85.55]:1094 [2022-05-13 16:47:21.819975 -0400][Debug ][Poller ] Adding socket 0xfb69a120 to the poller [2022-05-13 16:47:21.820022 -0400][Debug ][TaskMgr ] Done with task: "StreamConnectorTask for deepthought.crc.nd.edu:1094" [2022-05-13 16:47:21.820144 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094.0] Async connection call returned [2022-05-13 16:47:21.820203 -0400][Error ][AsyncSock ] [deepthought.crc.nd.edu:1094.0] Unable to connect: connection refused [2022-05-13 16:47:21.820215 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094.0] Closing the socket [2022-05-13 16:47:21.820229 -0400][Debug ][Poller ] <--> Removing socket from the poller [2022-05-13 16:47:21.820263 -0400][Error ][PostMaster ] [deepthought.crc.nd.edu:1094] elapsed = 0, pConnectionWindow = 120 seconds. [2022-05-13 16:47:21.820274 -0400][Info ][PostMaster ] [deepthought.crc.nd.edu:1094] Attempting reconnection in 120 seconds. [2022-05-13 16:47:21.820287 -0400][Debug ][TaskMgr ] Registering task: "StreamConnectorTask for deepthought.crc.nd.edu:1094" to be run at: [2022-05-13 16:49:21 -0400] [2022-05-13 16:49:21.828803 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 [2022-05-13 16:49:21.828873 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094.0] Attempting connection to [::ffff:129.74.85.55]:1094 [2022-05-13 16:49:21.828926 -0400][Debug ][Poller ] Adding socket 0xfb69a120 to the poller [2022-05-13 16:49:21.828965 -0400][Debug ][TaskMgr ] Done with task: "StreamConnectorTask for deepthought.crc.nd.edu:1094" [2022-05-13 16:49:21.829177 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094.0] Async connection call returned [2022-05-13 16:49:21.829234 -0400][Error ][AsyncSock ] [deepthought.crc.nd.edu:1094.0] Unable to connect: connection refused [2022-05-13 16:49:21.829250 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094.0] Closing the socket [2022-05-13 16:49:21.829269 -0400][Debug ][Poller ] <--> Removing socket from the poller [2022-05-13 16:49:21.829307 -0400][Error ][PostMaster ] [deepthought.crc.nd.edu:1094] elapsed = 0, pConnectionWindow = 120 seconds. [2022-05-13 16:49:21.829319 -0400][Info ][PostMaster ] [deepthought.crc.nd.edu:1094] Attempting reconnection in 120 seconds. [2022-05-13 16:49:21.829332 -0400][Debug ][TaskMgr ] Registering task: "StreamConnectorTask for deepthought.crc.nd.edu:1094" to be run at: [2022-05-13 16:51:21 -0400] [2022-05-13 16:51:21.848587 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 [2022-05-13 16:51:21.848637 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094.0] Attempting connection to [::ffff:129.74.85.55]:1094 [2022-05-13 16:51:21.848676 -0400][Debug ][Poller ] Adding socket 0xfb69a120 to the poller [2022-05-13 16:51:21.848710 -0400][Debug ][TaskMgr ] Done with task: "StreamConnectorTask for deepthought.crc.nd.edu:1094" [2022-05-13 16:51:21.848920 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094.0] Async connection call returned [2022-05-13 16:51:21.848968 -0400][Error ][AsyncSock ] [deepthought.crc.nd.edu:1094.0] Unable to connect: connection refused [2022-05-13 16:51:21.848983 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094.0] Closing the socket [2022-05-13 16:51:21.849001 -0400][Debug ][Poller ] <--> Removing socket from the poller [2022-05-13 16:51:21.849041 -0400][Error ][PostMaster ] [deepthought.crc.nd.edu:1094] elapsed = 0, pConnectionWindow = 120 seconds. [2022-05-13 16:51:21.849053 -0400][Info ][PostMaster ] [deepthought.crc.nd.edu:1094] Attempting reconnection in 120 seconds. [2022-05-13 16:51:21.849066 -0400][Debug ][TaskMgr ] Registering task: "StreamConnectorTask for deepthought.crc.nd.edu:1094" to be run at: [2022-05-13 16:53:21 -0400] [2022-05-13 16:53:21.867845 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Found 1 address(es): [::ffff:129.74.85.55]:1094 [2022-05-13 16:53:21.867890 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094.0] Attempting connection to [::ffff:129.74.85.55]:1094 [2022-05-13 16:53:21.867926 -0400][Debug ][Poller ] Adding socket 0xfb69a120 to the poller [2022-05-13 16:53:21.867965 -0400][Debug ][TaskMgr ] Done with task: "StreamConnectorTask for deepthought.crc.nd.edu:1094" [2022-05-13 16:53:21.868173 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094.0] Async connection call returned [2022-05-13 16:53:21.868229 -0400][Error ][AsyncSock ] [deepthought.crc.nd.edu:1094.0] Unable to connect: connection refused [2022-05-13 16:53:21.868247 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094.0] Closing the socket [2022-05-13 16:53:21.868266 -0400][Debug ][Poller ] <--> Removing socket from the poller [2022-05-13 16:53:21.868302 -0400][Error ][PostMaster ] [deepthought.crc.nd.edu:1094] elapsed = 0, pConnectionWindow = 120 seconds. [2022-05-13 16:53:21.868324 -0400][Error ][PostMaster ] [deepthought.crc.nd.edu:1094] Unable to recover: [ERROR] Connection error. [2022-05-13 16:53:21.868342 -0400][Error ][XRootD ] [deepthought.crc.nd.edu:1094] Impossible to send message kXR_open (file: /store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/mAOD_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17MiniAOD-00821ND_24549.root, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ). Trying to recover. [2022-05-13 16:53:21.868361 -0400][Debug ][XRootD ] [deepthought.crc.nd.edu:1094] Handling error while processing kXR_open (file: /store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/mAOD_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17MiniAOD-00821ND_24549.root, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ): [FATAL] Connection error. [2022-05-13 16:53:21.868379 -0400][Debug ][ExDbgMsg ] [deepthought.crc.nd.edu:1094] Passing to the thread-pool MsgHandler: 0xfb698b20 (message: kXR_open (file: /store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/mAOD_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17MiniAOD-00821ND_24549.root, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) ). [2022-05-13 16:53:21.868621 -0400][Debug ][ExDbgMsg ] [deepthought.crc.nd.edu:1094] Calling MsgHandler: 0xfb698b20 (message: kXR_open (file: /store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/mAOD_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17MiniAOD-00821ND_24549.root, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) ) with status: [FATAL] Connection error. [2022-05-13 16:53:21.868733 -0400][Debug ][File ] [0xfb691bd0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/mAOD_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17MiniAOD-00821ND_24549.root?xrdcl.requuid=780e9e03-e663-48cd-805c-24b689b916ef] Open has returned with status [FATAL] Connection error [2022-05-13 16:53:21.868764 -0400][Debug ][File ] [0xfb691bd0@root://deepthought.crc.nd.edu:1094//store/user/kmohrman/FullProduction/Round6/Batch6/postLHE_step/v2/mAOD_step_ttllNuNuJetNoHiggs_HanV4ttXJetStartPtChecks_run2/HIG-RunIIFall17MiniAOD-00821ND_24549.root?xrdcl.requuid=780e9e03-e663-48cd-805c-24b689b916ef] Error while opening at deepthought.crc.nd.edu:1094: [FATAL] Connection error [2022-05-13 16:53:21.868803 -0400][Debug ][ExDbgMsg ] [deepthought.crc.nd.edu:1094] Destroying MsgHandler: 0xfb698b20. [0B/0B][100%][==================================================][0B/s] Run: [FATAL] Connection error: (source) [2022-05-13 16:53:21.869471 -0400][Debug ][JobMgr ] Stopping the job manager... [2022-05-13 16:53:21.869868 -0400][Debug ][JobMgr ] Job manager stopped [2022-05-13 16:53:21.869897 -0400][Debug ][TaskMgr ] Stopping the task manager... [2022-05-13 16:53:21.878589 -0400][Debug ][TaskMgr ] Task manager stopped [2022-05-13 16:53:21.878623 -0400][Debug ][Poller ] Stopping the poller... [2022-05-13 16:53:21.878748 -0400][Debug ][TaskMgr ] Requesting unregistration of: "TickGeneratorTask for: root://deepthought.crc.nd.edu:1094" [2022-05-13 16:53:21.878779 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094.0] Closing the socket [2022-05-13 16:53:21.878830 -0400][Debug ][PostMaster ] [deepthought.crc.nd.edu:1094] Destroying stream [2022-05-13 16:53:21.878878 -0400][Debug ][AsyncSock ] [deepthought.crc.nd.edu:1094.0] Closing the socket