Jobsub ID 28510.132@dunegpschedd01.fnal.gov
| Jobsub ID | 28510.132@dunegpschedd01.fnal.gov | |
| Workflow ID | 1580 | |
| Stage ID | 1 | |
| User name | imawby@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 43200 (12 hours) | |
| Submitted time | 2025-08-19 12:37:57 | |
| Site | UK_Edinburgh | |
| Entry | DUNE_UK_SGridECDF_ce1_multicore | |
| Last heartbeat | 2025-08-19 12:46:47 | |
| From worker node | Hostname | node2b04.ecdf.ed.ac.uk |
| cpuinfo | Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Started | 2025-08-19 12:39:59 | |
| Input files | fardet-hd:nu_dune10kt_1x2x6_1100_443_20230826T034309Z_gen_g4_detsim_hitreco__20240229T180233Z_reco2.root | |
| Jobscript | Exit code | 0 |
| Real time | 5m (359s) | |
| CPU time | 3m (232s = 64%) | |
| Max RSS bytes | 1338785792 (1276 MiB) | |
| Outputting started | 2025-08-19 12:45:59 | |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/splitting_nu_3/fnal/01580/1/002/CheatingKalmanSplittingU_nu_dune10kt_1x2x6_1100_443_20230826T034309Z_gen_g4_detsim_hitreco__20240229T180233Z_reco2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/splitting_nu_3/fnal/01580/1/002/CheatingKalmanSplittingV_nu_dune10kt_1x2x6_1100_443_20230826T034309Z_gen_g4_detsim_hitreco__20240229T180233Z_reco2.root https://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/splitting_nu_3/fnal/01580/1/002/CheatingKalmanSplittingW_nu_dune10kt_1x2x6_1100_443_20230826T034309Z_gen_g4_detsim_hitreco__20240229T180233Z_reco2.root | |
| Finished | 2025-08-19 12:46:47 | |
| Saved logs | justin-logs:28510.132-dunegpschedd01.fnal.gov.logs.tgz | |
| List job events Cached HTCondor job logs | ||
Jobscript log (last 10,000 characters)
3:45:55.707342 +0100][Debug ][ExDbgMsg ][ 1305] [xrootd1.esc.qmul.ac.uk:1094] Moving MsgHandler: 0x1c37cc70 (message: kXR_read (handle: 0x00000000, offset: 1160621738, size: 156647) ) from out-queu to in-queue. [2025-08-19 13:45:55.720730 +0100][Debug ][ExDbgMsg ][ 1305] [msg: 0x19f56de0] Assigned MsgHandler: 0x1c37cc70. [2025-08-19 13:45:55.720787 +0100][Debug ][ExDbgMsg ][ 1305] [handler: 0x1c37cc70] Removed MsgHandler: 0x1c37cc70 from the in-queue. [2025-08-19 13:45:55.721569 +0100][Debug ][ExDbgMsg ][ 1305] [xrootd1.esc.qmul.ac.uk:1094] Calling MsgHandler: 0x1c37cc70 (message: kXR_read (handle: 0x00000000, offset: 1160621738, size: 156647) ) with status: [SUCCESS] . [2025-08-19 13:45:55.721593 +0100][Debug ][ExDbgMsg ][ 1305] [xrootd1.esc.qmul.ac.uk:1094] Destroying MsgHandler: 0x1c37cc70. [2025-08-19 13:45:55.736833 +0100][Debug ][File ][ 1305] [0xc9e1d00@root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/82/d1/nu_dune10kt_1x2x6_1100_443_20230826T034309Z_gen_g4_detsim_hitreco__20240229T180233Z_reco2.root?xrdcl.requuid=0270d608-4306-4fdd-8029-dce2d4ecc1b0] Sending a read command for handle 0x0 to xrootd1.esc.qmul.ac.uk:1094 [2025-08-19 13:45:55.736862 +0100][Debug ][ExDbgMsg ][ 1305] [xrootd1.esc.qmul.ac.uk:1094] MsgHandler created: 0x1881f530 (message: kXR_read (handle: 0x00000000, offset: 167326, size: 132) ). [2025-08-19 13:45:55.736991 +0100][Debug ][ExDbgMsg ][ 1305] [xrootd1.esc.qmul.ac.uk:1094] Moving MsgHandler: 0x1881f530 (message: kXR_read (handle: 0x00000000, offset: 167326, size: 132) ) from out-queu to in-queue. [2025-08-19 13:45:55.750553 +0100][Debug ][ExDbgMsg ][ 1305] [msg: 0x18188cc0] Assigned MsgHandler: 0x1881f530. [2025-08-19 13:45:55.750611 +0100][Debug ][ExDbgMsg ][ 1305] [handler: 0x1881f530] Removed MsgHandler: 0x1881f530 from the in-queue. [2025-08-19 13:45:55.750740 +0100][Debug ][ExDbgMsg ][ 1305] [xrootd1.esc.qmul.ac.uk:1094] Calling MsgHandler: 0x1881f530 (message: kXR_read (handle: 0x00000000, offset: 167326, size: 132) ) with status: [SUCCESS] . [2025-08-19 13:45:55.750808 +0100][Debug ][ExDbgMsg ][ 1305] [xrootd1.esc.qmul.ac.uk:1094] Destroying MsgHandler: 0x1881f530. [2025-08-19 13:45:55.750986 +0100][Debug ][File ][ 1305] [0xc9e1d00@root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/82/d1/nu_dune10kt_1x2x6_1100_443_20230826T034309Z_gen_g4_detsim_hitreco__20240229T180233Z_reco2.root?xrdcl.requuid=0270d608-4306-4fdd-8029-dce2d4ecc1b0] Sending a read command for handle 0x0 to xrootd1.esc.qmul.ac.uk:1094 [2025-08-19 13:45:55.751079 +0100][Debug ][ExDbgMsg ][ 1305] [xrootd1.esc.qmul.ac.uk:1094] MsgHandler created: 0x1881f530 (message: kXR_read (handle: 0x00000000, offset: 167458, size: 138) ). [2025-08-19 13:45:55.751180 +0100][Debug ][ExDbgMsg ][ 1305] [xrootd1.esc.qmul.ac.uk:1094] Moving MsgHandler: 0x1881f530 (message: kXR_read (handle: 0x00000000, offset: 167458, size: 138) ) from out-queu to in-queue. [2025-08-19 13:45:55.764549 +0100][Debug ][ExDbgMsg ][ 1305] [msg: 0x1810c2d0] Assigned MsgHandler: 0x1881f530. [2025-08-19 13:45:55.764606 +0100][Debug ][ExDbgMsg ][ 1305] [handler: 0x1881f530] Removed MsgHandler: 0x1881f530 from the in-queue. [2025-08-19 13:45:55.764697 +0100][Debug ][ExDbgMsg ][ 1305] [xrootd1.esc.qmul.ac.uk:1094] Calling MsgHandler: 0x1881f530 (message: kXR_read (handle: 0x00000000, offset: 167458, size: 138) ) with status: [SUCCESS] . [2025-08-19 13:45:55.764724 +0100][Debug ][ExDbgMsg ][ 1305] [xrootd1.esc.qmul.ac.uk:1094] Destroying MsgHandler: 0x1881f530. [2025-08-19 13:45:55.764892 +0100][Debug ][File ][ 1305] [0xc9e1d00@root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/82/d1/nu_dune10kt_1x2x6_1100_443_20230826T034309Z_gen_g4_detsim_hitreco__20240229T180233Z_reco2.root?xrdcl.requuid=0270d608-4306-4fdd-8029-dce2d4ecc1b0] Sending a read command for handle 0x0 to xrootd1.esc.qmul.ac.uk:1094 [2025-08-19 13:45:55.764996 +0100][Debug ][ExDbgMsg ][ 1305] [xrootd1.esc.qmul.ac.uk:1094] MsgHandler created: 0x1881f530 (message: kXR_read (handle: 0x00000000, offset: 157255, size: 3472) ). [2025-08-19 13:45:55.765102 +0100][Debug ][ExDbgMsg ][ 1305] [xrootd1.esc.qmul.ac.uk:1094] Moving MsgHandler: 0x1881f530 (message: kXR_read (handle: 0x00000000, offset: 157255, size: 3472) ) from out-queu to in-queue. [2025-08-19 13:45:55.778367 +0100][Debug ][ExDbgMsg ][ 1305] [msg: 0x19a8ca10] Assigned MsgHandler: 0x1881f530. [2025-08-19 13:45:55.778385 +0100][Debug ][ExDbgMsg ][ 1305] [handler: 0x1881f530] Removed MsgHandler: 0x1881f530 from the in-queue. [2025-08-19 13:45:55.778492 +0100][Debug ][ExDbgMsg ][ 1305] [xrootd1.esc.qmul.ac.uk:1094] Calling MsgHandler: 0x1881f530 (message: kXR_read (handle: 0x00000000, offset: 157255, size: 3472) ) with status: [SUCCESS] . [2025-08-19 13:45:55.778515 +0100][Debug ][ExDbgMsg ][ 1305] [xrootd1.esc.qmul.ac.uk:1094] Destroying MsgHandler: 0x1881f530. 19-Aug-2025 13:45:57 BST Closed output file "nu_dune10kt_1x2x6_1100_443_20230826T034309Z_gen_g4_detsim_hitreco__20240229T180233Z_reco2_reco2.root" [2025-08-19 13:45:57.692457 +0100][Debug ][File ][ 1305] [0xc9e1d00@root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/82/d1/nu_dune10kt_1x2x6_1100_443_20230826T034309Z_gen_g4_detsim_hitreco__20240229T180233Z_reco2.root?xrdcl.requuid=0270d608-4306-4fdd-8029-dce2d4ecc1b0] Sending a close command for handle 0x0 to xrootd1.esc.qmul.ac.uk:1094 [2025-08-19 13:45:57.692554 +0100][Debug ][ExDbgMsg ][ 1305] [xrootd1.esc.qmul.ac.uk:1094] MsgHandler created: 0x14cc3530 (message: kXR_close (handle: 0x00000000) ). [2025-08-19 13:45:57.692728 +0100][Debug ][ExDbgMsg ][ 1305] [xrootd1.esc.qmul.ac.uk:1094] Moving MsgHandler: 0x14cc3530 (message: kXR_close (handle: 0x00000000) ) from out-queu to in-queue. [2025-08-19 13:45:57.708292 +0100][Debug ][ExDbgMsg ][ 1305] [msg: 0x15074a80] Assigned MsgHandler: 0x14cc3530. [2025-08-19 13:45:57.708348 +0100][Debug ][ExDbgMsg ][ 1305] [handler: 0x14cc3530] Removed MsgHandler: 0x14cc3530 from the in-queue. [2025-08-19 13:45:57.708416 +0100][Debug ][ExDbgMsg ][ 1305] [xrootd1.esc.qmul.ac.uk:1094] Calling MsgHandler: 0x14cc3530 (message: kXR_close (handle: 0x00000000) ) with status: [SUCCESS] . [2025-08-19 13:45:57.708461 +0100][Debug ][File ][ 1305] [0xc9e1d00@root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/82/d1/nu_dune10kt_1x2x6_1100_443_20230826T034309Z_gen_g4_detsim_hitreco__20240229T180233Z_reco2.root?xrdcl.requuid=0270d608-4306-4fdd-8029-dce2d4ecc1b0] Close returned from xrootd1.esc.qmul.ac.uk:1094 with: [SUCCESS] [2025-08-19 13:45:57.708502 +0100][Debug ][ExDbgMsg ][ 1305] [xrootd1.esc.qmul.ac.uk:1094] Destroying MsgHandler: 0x14cc3530. 19-Aug-2025 13:45:57 BST Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/82/d1/nu_dune10kt_1x2x6_1100_443_20230826T034309Z_gen_g4_detsim_hitreco__20240229T180233Z_reco2.root" ================================================================================================================================ TimeTracker printout (sec) Min Avg Max Median RMS nEvts ================================================================================================================================ Full event 0.136812 2.09973 4.60744 2.01727 0.428512 100 -------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.0265388 0.0346088 0.0565369 0.0322797 0.00753904 100 reco:pandora:StandardPandora 0.102216 2.06207 4.54507 1.97791 0.426479 100 [art]:TriggerResults:TriggerResultInserter 1.0302e-05 1.39118e-05 3.8416e-05 1.32445e-05 3.1229e-06 100 end_path:out1:RootOutput 2.033e-06 2.64663e-06 1.0615e-05 2.475e-06 9.9584e-07 100 end_path:out1:RootOutput(write) 0.000721813 0.00288634 0.0165986 0.00208693 0.00246235 100 ================================================================================================================================ ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 2320.65 MB Peak resident set size usage (VmHWM): 1338.79 MB ==================================================================================================== Art has completed and will exit with status 0. [2025-08-19 13:45:58.520759 +0100][Debug ][JobMgr ][ 1305] Stopping the job manager... [2025-08-19 13:45:58.521828 +0100][Debug ][JobMgr ][ 1305] Job manager stopped [2025-08-19 13:45:58.522229 +0100][Debug ][TaskMgr ][ 1305] Stopping the task manager... [2025-08-19 13:45:58.522516 +0100][Debug ][TaskMgr ][ 1305] Task manager stopped [2025-08-19 13:45:58.522523 +0100][Debug ][Poller ][ 1305] Stopping the poller... [2025-08-19 13:45:58.522641 +0100][Debug ][AsyncSock ][ 1305] [xrootd1.esc.qmul.ac.uk:1094.0] Closing the socket [2025-08-19 13:45:58.522666 +0100][Debug ][Poller ][ 1305] <[::ffff:192.41.105.37]:46336><--><[::ffff:194.36.11.135]:1094> Removing socket from the poller [2025-08-19 13:45:58.522847 +0100][Debug ][PostMaster ][ 1305] [xrootd1.esc.qmul.ac.uk:1094] Destroying stream [2025-08-19 13:45:58.522985 +0100][Debug ][AsyncSock ][ 1305] [xrootd1.esc.qmul.ac.uk:1094.0] Closing the socket === End last 100 lines of lar log file ===