Jobsub ID 24735.0@dunegpschedd01.fnal.gov
| Jobsub ID | 24735.0@dunegpschedd01.fnal.gov | |
| Workflow ID | 647 | |
| Stage ID | 1 | |
| User name | pgranger@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2025-08-16 08:03:47 | |
| Site | UK_Edinburgh | |
| Entry | DUNE_UK_SGridECDF_ce1 | |
| Last heartbeat | 2025-08-16 08:10:03 | |
| From worker node | Hostname | node2b06.ecdf.ed.ac.uk |
| cpuinfo | Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | outputting_failed | |
| Started | 2025-08-16 08:04:24 | |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6422149_780_20231204T120449Z_gen_g4_detsim_hitreco__20240509T202715Z_reco2.root fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65974923_257_20231201T071520Z_gen_g4_detsim_hitreco__20240507T192302Z_reco2.root | |
| Jobscript | Exit code | 0 |
| Real time | 5m (322s) | |
| CPU time | 1m (68s = 21%) | |
| Max RSS bytes | 1391235072 (1326 MiB) | |
| Outputting started | 2025-08-16 08:09:47 | |
| Output files | ||
| Finished | 2025-08-16 08:10:03 | |
| List job events Cached HTCondor job logs | ||
Jobscript log (last 10,000 characters)
kXR_read (handle: 0x00000000, offset: 1699269688, size: 147) ) with status: [SUCCESS] . [2025-08-16 09:09:45.729641 +0100][Debug ][ExDbgMsg ] [xrootd1.esc.qmul.ac.uk:1094] Destroying MsgHandler: 0x1b4c1060. [2025-08-16 09:09:45.729701 +0100][Debug ][File ] [0x1593a8c0@root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/fa/1b/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65974923_257_20231201T071520Z_gen_g4_detsim_hitreco__20240507T192302Z_reco2.root?xrdcl.requuid=ad8c4e52-9883-4ac0-861c-b39261cb735a] Sending a read command for handle 0x0 to xrootd1.esc.qmul.ac.uk:1094 [2025-08-16 09:09:45.729752 +0100][Debug ][ExDbgMsg ] [xrootd1.esc.qmul.ac.uk:1094] MsgHandler created: 0x11136110 (message: kXR_read (handle: 0x00000000, offset: 1699269835, size: 217) ). [2025-08-16 09:09:45.729859 +0100][Debug ][ExDbgMsg ] [xrootd1.esc.qmul.ac.uk:1094] Moving MsgHandler: 0x11136110 (message: kXR_read (handle: 0x00000000, offset: 1699269835, size: 217) ) from out-queu to in-queue. [2025-08-16 09:09:45.743081 +0100][Debug ][ExDbgMsg ] [msg: 0x1b4c1340] Assigned MsgHandler: 0x11136110. [2025-08-16 09:09:45.743135 +0100][Debug ][ExDbgMsg ] [handler: 0x11136110] Removed MsgHandler: 0x11136110 from the in-queue. [2025-08-16 09:09:45.743235 +0100][Debug ][ExDbgMsg ] [xrootd1.esc.qmul.ac.uk:1094] Calling MsgHandler: 0x11136110 (message: kXR_read (handle: 0x00000000, offset: 1699269835, size: 217) ) with status: [SUCCESS] . [2025-08-16 09:09:45.743289 +0100][Debug ][ExDbgMsg ] [xrootd1.esc.qmul.ac.uk:1094] Destroying MsgHandler: 0x11136110. [2025-08-16 09:09:45.743552 +0100][Debug ][File ] [0x1593a8c0@root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/fa/1b/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65974923_257_20231201T071520Z_gen_g4_detsim_hitreco__20240507T192302Z_reco2.root?xrdcl.requuid=ad8c4e52-9883-4ac0-861c-b39261cb735a] Sending a read command for handle 0x0 to xrootd1.esc.qmul.ac.uk:1094 [2025-08-16 09:09:45.743609 +0100][Debug ][ExDbgMsg ] [xrootd1.esc.qmul.ac.uk:1094] MsgHandler created: 0x11136110 (message: kXR_read (handle: 0x00000000, offset: 1698327542, size: 134) ). [2025-08-16 09:09:45.743726 +0100][Debug ][ExDbgMsg ] [xrootd1.esc.qmul.ac.uk:1094] Moving MsgHandler: 0x11136110 (message: kXR_read (handle: 0x00000000, offset: 1698327542, size: 134) ) from out-queu to in-queue. [2025-08-16 09:09:45.756896 +0100][Debug ][ExDbgMsg ] [msg: 0x1b4c15d0] Assigned MsgHandler: 0x11136110. [2025-08-16 09:09:45.756951 +0100][Debug ][ExDbgMsg ] [handler: 0x11136110] Removed MsgHandler: 0x11136110 from the in-queue. [2025-08-16 09:09:45.757052 +0100][Debug ][ExDbgMsg ] [xrootd1.esc.qmul.ac.uk:1094] Calling MsgHandler: 0x11136110 (message: kXR_read (handle: 0x00000000, offset: 1698327542, size: 134) ) with status: [SUCCESS] . [2025-08-16 09:09:45.757087 +0100][Debug ][ExDbgMsg ] [xrootd1.esc.qmul.ac.uk:1094] Destroying MsgHandler: 0x11136110. [2025-08-16 09:09:45.757163 +0100][Debug ][File ] [0x1593a8c0@root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/fa/1b/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65974923_257_20231201T071520Z_gen_g4_detsim_hitreco__20240507T192302Z_reco2.root?xrdcl.requuid=ad8c4e52-9883-4ac0-861c-b39261cb735a] Sending a read command for handle 0x0 to xrootd1.esc.qmul.ac.uk:1094 [2025-08-16 09:09:45.757214 +0100][Debug ][ExDbgMsg ] [xrootd1.esc.qmul.ac.uk:1094] MsgHandler created: 0x11136110 (message: kXR_read (handle: 0x00000000, offset: 1698327676, size: 140) ). [2025-08-16 09:09:45.757338 +0100][Debug ][ExDbgMsg ] [xrootd1.esc.qmul.ac.uk:1094] Moving MsgHandler: 0x11136110 (message: kXR_read (handle: 0x00000000, offset: 1698327676, size: 140) ) from out-queu to in-queue. [2025-08-16 09:09:45.770613 +0100][Debug ][ExDbgMsg ] [msg: 0x1b4c1530] Assigned MsgHandler: 0x11136110. [2025-08-16 09:09:45.770668 +0100][Debug ][ExDbgMsg ] [handler: 0x11136110] Removed MsgHandler: 0x11136110 from the in-queue. [2025-08-16 09:09:45.770769 +0100][Debug ][ExDbgMsg ] [xrootd1.esc.qmul.ac.uk:1094] Calling MsgHandler: 0x11136110 (message: kXR_read (handle: 0x00000000, offset: 1698327676, size: 140) ) with status: [SUCCESS] . [2025-08-16 09:09:45.770803 +0100][Debug ][ExDbgMsg ] [xrootd1.esc.qmul.ac.uk:1094] Destroying MsgHandler: 0x11136110. [2025-08-16 09:09:45.770865 +0100][Debug ][File ] [0x1593a8c0@root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/fa/1b/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65974923_257_20231201T071520Z_gen_g4_detsim_hitreco__20240507T192302Z_reco2.root?xrdcl.requuid=ad8c4e52-9883-4ac0-861c-b39261cb735a] Sending a read command for handle 0x0 to xrootd1.esc.qmul.ac.uk:1094 [2025-08-16 09:09:45.770915 +0100][Debug ][ExDbgMsg ] [xrootd1.esc.qmul.ac.uk:1094] MsgHandler created: 0xc06bc70 (message: kXR_read (handle: 0x00000000, offset: 1698327816, size: 211) ). [2025-08-16 09:09:45.771022 +0100][Debug ][ExDbgMsg ] [xrootd1.esc.qmul.ac.uk:1094] Moving MsgHandler: 0xc06bc70 (message: kXR_read (handle: 0x00000000, offset: 1698327816, size: 211) ) from out-queu to in-queue. [2025-08-16 09:09:45.784320 +0100][Debug ][ExDbgMsg ] [msg: 0x110e2120] Assigned MsgHandler: 0xc06bc70. [2025-08-16 09:09:45.784374 +0100][Debug ][ExDbgMsg ] [handler: 0xc06bc70] Removed MsgHandler: 0xc06bc70 from the in-queue. [2025-08-16 09:09:45.784475 +0100][Debug ][ExDbgMsg ] [xrootd1.esc.qmul.ac.uk:1094] Calling MsgHandler: 0xc06bc70 (message: kXR_read (handle: 0x00000000, offset: 1698327816, size: 211) ) with status: [SUCCESS] . [2025-08-16 09:09:45.784510 +0100][Debug ][ExDbgMsg ] [xrootd1.esc.qmul.ac.uk:1094] Destroying MsgHandler: 0xc06bc70. [2025-08-16 09:09:45.788407 +0100][Debug ][File ] [0x1593a8c0@root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/fa/1b/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65974923_257_20231201T071520Z_gen_g4_detsim_hitreco__20240507T192302Z_reco2.root?xrdcl.requuid=ad8c4e52-9883-4ac0-861c-b39261cb735a] Sending a close command for handle 0x0 to xrootd1.esc.qmul.ac.uk:1094 [2025-08-16 09:09:45.788558 +0100][Debug ][ExDbgMsg ] [xrootd1.esc.qmul.ac.uk:1094] MsgHandler created: 0xc057e70 (message: kXR_close (handle: 0x00000000) ). [2025-08-16 09:09:45.788604 +0100][Debug ][ExDbgMsg ] [xrootd1.esc.qmul.ac.uk:1094] Moving MsgHandler: 0xc057e70 (message: kXR_close (handle: 0x00000000) ) from out-queu to in-queue. [2025-08-16 09:09:45.803908 +0100][Debug ][ExDbgMsg ] [msg: 0x98edad0] Assigned MsgHandler: 0xc057e70. [2025-08-16 09:09:45.803930 +0100][Debug ][ExDbgMsg ] [handler: 0xc057e70] Removed MsgHandler: 0xc057e70 from the in-queue. [2025-08-16 09:09:45.803976 +0100][Debug ][ExDbgMsg ] [xrootd1.esc.qmul.ac.uk:1094] Calling MsgHandler: 0xc057e70 (message: kXR_close (handle: 0x00000000) ) with status: [SUCCESS] . [2025-08-16 09:09:45.803997 +0100][Debug ][File ] [0x1593a8c0@root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/fa/1b/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65974923_257_20231201T071520Z_gen_g4_detsim_hitreco__20240507T192302Z_reco2.root?xrdcl.requuid=ad8c4e52-9883-4ac0-861c-b39261cb735a] Close returned from xrootd1.esc.qmul.ac.uk:1094 with: [SUCCESS] [2025-08-16 09:09:45.804038 +0100][Debug ][ExDbgMsg ] [xrootd1.esc.qmul.ac.uk:1094] Destroying MsgHandler: 0xc057e70. [2025-08-16 09:09:46.031173 +0100][Debug ][JobMgr ] Stopping the job manager... [2025-08-16 09:09:46.031574 +0100][Debug ][JobMgr ] Job manager stopped [2025-08-16 09:09:46.031627 +0100][Debug ][TaskMgr ] Stopping the task manager... [2025-08-16 09:09:46.031732 +0100][Debug ][TaskMgr ] Task manager stopped [2025-08-16 09:09:46.031744 +0100][Debug ][Poller ] Stopping the poller... [2025-08-16 09:09:46.032117 +0100][Debug ][AsyncSock ] [xrootd1.esc.qmul.ac.uk:1094.0] Closing the socket [2025-08-16 09:09:46.032190 +0100][Debug ][Poller ] <[::ffff:192.41.105.39]:53746><--><[::ffff:194.36.11.135]:1094> Removing socket from the poller [2025-08-16 09:09:46.032467 +0100][Debug ][PostMaster ] [xrootd1.esc.qmul.ac.uk:1094] Destroying stream [2025-08-16 09:09:46.032549 +0100][Debug ][AsyncSock ] [xrootd1.esc.qmul.ac.uk:1094.0] Closing the socket lar exit code 0 === Start last 100 lines of lar log file === tail: cannot open '_reco_20250816T080433Z.log' for reading: No such file or directory === End last 100 lines of lar log file === processed files root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/5f/55/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6422149_780_20231204T120449Z_gen_g4_detsim_hitreco__20240509T202715Z_reco2.root root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/fa/1b/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65974923_257_20231201T071520Z_gen_g4_detsim_hitreco__20240507T192302Z_reco2.root .: total 34616 -rw-r--r-- 1 gl05pi6 eddie_users 21809061 Aug 16 09:09 jobscript.log -rw-r--r-- 1 gl05pi6 eddie_users 4465167 Aug 16 09:09 flatcaf.root -rw-r--r-- 1 gl05pi6 eddie_users 3637109 Aug 16 09:09 caf.root -rw-r--r-- 1 gl05pi6 eddie_users 3637109 Aug 16 09:09 caf_fd_hd_atmo_647_20250816T080433Z.root -rw-r--r-- 1 gl05pi6 eddie_users 1849762 Aug 16 09:09 caf_20250816T080433Z.log -rw-r--r-- 1 gl05pi6 eddie_users 377 Aug 16 09:09 caf_20250816T080433Z.file -rw-r--r-- 1 gl05pi6 eddie_users 377 Aug 16 09:09 caf_20250816T080433Z.pfns -rw-r--r-- 1 gl05pi6 eddie_users 377 Aug 16 09:04 file.list -rw-r--r-- 1 gl05pi6 eddie_users 377 Aug 16 09:09 justin-processed-pfns.txt -rw-r--r-- 1 gl05pi6 eddie_users 275 Aug 16 09:04 all-input-dids.txt -rw-r--r-- 1 gl05pi6 eddie_users 275 Aug 16 09:09 caf_20250816T080433Z.did -rw-r--r-- 1 gl05pi6 eddie_users 275 Aug 16 09:04 did.list