Jobsub ID 296474.4@dunegpschedd02.fnal.gov
| Jobsub ID | 296474.4@dunegpschedd02.fnal.gov |
| Workflow ID | 12511 |
| Stage ID | 1 |
| User name | imawby@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 1048576000 (1000 MiB) |
| Wall seconds limit | 7200 (2 hours) |
| Submitted time | 2026-01-29 10:25:50 |
| Site | UK_Edinburgh |
| Entry | DUNE_UK_SGridECDF_ce1_multicore |
| Last heartbeat | 2026-01-29 10:35:36 |
| From worker node | Hostname | node2b04.ecdf.ed.ac.uk |
| cpuinfo | Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 1048576000 (1000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-29 10:26:26 |
| Input files | fardet-hd:nu_dune10kt_1x2x6_1408_63_20230826T093305Z_gen_g4_detsim_hitreco__20240229T175628Z_reco2.root
|
| Jobscript | Exit code | 0 |
| Real time | 8m (530s) |
| CPU time | 5m (301s = 56%) |
| Max RSS bytes | 1212203008 (1156 MiB) |
| Outputting started | 2026-01-29 10:35:18 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/kalmanAlg_CHECK_nu_0/fnal/12511/1/001/ClusterValidation_WithAlg_nu_dune10kt_1x2x6_1408_63_20230826T093305Z_gen_g4_detsim_hitreco__20240229T175628Z_reco2.root
|
| Finished | 2026-01-29 10:35:36 |
| Saved logs | justin-logs:296474.4-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
DbgMsg ][ 1259] [ceph-svc15.gridpp.rl.ac.uk:1094] Destroying MsgHandler: 0x152ff120.
[2026-01-29 10:35:14.233782 +0000][Debug ][File ][ 1259] [0xaae32b0@root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/9e/84/nu_dune10kt_1x2x6_1408_63_20230826T093305Z_gen_g4_detsim_hitreco__20240229T175628Z_reco2.root?xrdcl.requuid=a90066c5-8ba9-4cc1-8dbc-3665c4c391e4] Sending a read command for handle 0x0 to ceph-svc15.gridpp.rl.ac.uk:1094
[2026-01-29 10:35:14.233840 +0000][Debug ][ExDbgMsg ][ 1259] [ceph-svc15.gridpp.rl.ac.uk:1094] MsgHandler created: 0x17209550 (message: kXR_read (handle: 0x00000000, offset: 171562, size: 132) ).
[2026-01-29 10:35:14.233906 +0000][Debug ][ExDbgMsg ][ 1259] [ceph-svc15.gridpp.rl.ac.uk:1094] Moving MsgHandler: 0x17209550 (message: kXR_read (handle: 0x00000000, offset: 171562, size: 132) ) from out-queu to in-queue.
[2026-01-29 10:35:14.319903 +0000][Debug ][ExDbgMsg ][ 1259] [msg: 0x1d339e80] Assigned MsgHandler: 0x17209550.
[2026-01-29 10:35:14.319932 +0000][Debug ][ExDbgMsg ][ 1259] [handler: 0x17209550] Removed MsgHandler: 0x17209550 from the in-queue.
[2026-01-29 10:35:14.319991 +0000][Debug ][ExDbgMsg ][ 1259] [ceph-svc15.gridpp.rl.ac.uk:1094] Calling MsgHandler: 0x17209550 (message: kXR_read (handle: 0x00000000, offset: 171562, size: 132) ) with status: [SUCCESS] .
[2026-01-29 10:35:14.320033 +0000][Debug ][ExDbgMsg ][ 1259] [ceph-svc15.gridpp.rl.ac.uk:1094] Destroying MsgHandler: 0x17209550.
[2026-01-29 10:35:14.320090 +0000][Debug ][File ][ 1259] [0xaae32b0@root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/9e/84/nu_dune10kt_1x2x6_1408_63_20230826T093305Z_gen_g4_detsim_hitreco__20240229T175628Z_reco2.root?xrdcl.requuid=a90066c5-8ba9-4cc1-8dbc-3665c4c391e4] Sending a read command for handle 0x0 to ceph-svc15.gridpp.rl.ac.uk:1094
[2026-01-29 10:35:14.320115 +0000][Debug ][ExDbgMsg ][ 1259] [ceph-svc15.gridpp.rl.ac.uk:1094] MsgHandler created: 0xd999d40 (message: kXR_read (handle: 0x00000000, offset: 171694, size: 138) ).
[2026-01-29 10:35:14.320281 +0000][Debug ][ExDbgMsg ][ 1259] [ceph-svc15.gridpp.rl.ac.uk:1094] Moving MsgHandler: 0xd999d40 (message: kXR_read (handle: 0x00000000, offset: 171694, size: 138) ) from out-queu to in-queue.
[2026-01-29 10:35:14.334411 +0000][Debug ][ExDbgMsg ][ 1259] [msg: 0x1d339e80] Assigned MsgHandler: 0xd999d40.
[2026-01-29 10:35:14.334419 +0000][Debug ][ExDbgMsg ][ 1259] [handler: 0xd999d40] Removed MsgHandler: 0xd999d40 from the in-queue.
[2026-01-29 10:35:14.334654 +0000][Debug ][ExDbgMsg ][ 1259] [ceph-svc15.gridpp.rl.ac.uk:1094] Calling MsgHandler: 0xd999d40 (message: kXR_read (handle: 0x00000000, offset: 171694, size: 138) ) with status: [SUCCESS] .
[2026-01-29 10:35:14.334679 +0000][Debug ][ExDbgMsg ][ 1259] [ceph-svc15.gridpp.rl.ac.uk:1094] Destroying MsgHandler: 0xd999d40.
[2026-01-29 10:35:14.334713 +0000][Debug ][File ][ 1259] [0xaae32b0@root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/9e/84/nu_dune10kt_1x2x6_1408_63_20230826T093305Z_gen_g4_detsim_hitreco__20240229T175628Z_reco2.root?xrdcl.requuid=a90066c5-8ba9-4cc1-8dbc-3665c4c391e4] Sending a read command for handle 0x0 to ceph-svc15.gridpp.rl.ac.uk:1094
[2026-01-29 10:35:14.334731 +0000][Debug ][ExDbgMsg ][ 1259] [ceph-svc15.gridpp.rl.ac.uk:1094] MsgHandler created: 0x19f6edc0 (message: kXR_read (handle: 0x00000000, offset: 172420, size: 1300) ).
[2026-01-29 10:35:14.334776 +0000][Debug ][ExDbgMsg ][ 1259] [ceph-svc15.gridpp.rl.ac.uk:1094] Moving MsgHandler: 0x19f6edc0 (message: kXR_read (handle: 0x00000000, offset: 172420, size: 1300) ) from out-queu to in-queue.
[2026-01-29 10:35:14.349111 +0000][Debug ][ExDbgMsg ][ 1259] [msg: 0x1d339e80] Assigned MsgHandler: 0x19f6edc0.
[2026-01-29 10:35:14.349130 +0000][Debug ][ExDbgMsg ][ 1259] [handler: 0x19f6edc0] Removed MsgHandler: 0x19f6edc0 from the in-queue.
[2026-01-29 10:35:14.349163 +0000][Debug ][ExDbgMsg ][ 1259] [ceph-svc15.gridpp.rl.ac.uk:1094] Calling MsgHandler: 0x19f6edc0 (message: kXR_read (handle: 0x00000000, offset: 172420, size: 1300) ) with status: [SUCCESS] .
[2026-01-29 10:35:14.349174 +0000][Debug ][ExDbgMsg ][ 1259] [ceph-svc15.gridpp.rl.ac.uk:1094] Destroying MsgHandler: 0x19f6edc0.
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
29-Jan-2026 10:35:16 GMT Closed output file "nu_dune10kt_1x2x6_1408_63_20230826T093305Z_gen_g4_detsim_hitreco__20240229T175628Z_reco2_reco2.root"
[2026-01-29 10:35:16.469609 +0000][Debug ][File ][ 1259] [0xaae32b0@root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/9e/84/nu_dune10kt_1x2x6_1408_63_20230826T093305Z_gen_g4_detsim_hitreco__20240229T175628Z_reco2.root?xrdcl.requuid=a90066c5-8ba9-4cc1-8dbc-3665c4c391e4] Sending a close command for handle 0x0 to ceph-svc15.gridpp.rl.ac.uk:1094
[2026-01-29 10:35:16.469698 +0000][Debug ][ExDbgMsg ][ 1259] [ceph-svc15.gridpp.rl.ac.uk:1094] MsgHandler created: 0x180be420 (message: kXR_close (handle: 0x00000000) ).
[2026-01-29 10:35:16.469888 +0000][Debug ][ExDbgMsg ][ 1259] [ceph-svc15.gridpp.rl.ac.uk:1094] Moving MsgHandler: 0x180be420 (message: kXR_close (handle: 0x00000000) ) from out-queu to in-queue.
[2026-01-29 10:35:16.488247 +0000][Debug ][ExDbgMsg ][ 1259] [msg: 0x14c3cc20] Assigned MsgHandler: 0x180be420.
[2026-01-29 10:35:16.488274 +0000][Debug ][ExDbgMsg ][ 1259] [handler: 0x180be420] Removed MsgHandler: 0x180be420 from the in-queue.
[2026-01-29 10:35:16.488311 +0000][Debug ][ExDbgMsg ][ 1259] [ceph-svc15.gridpp.rl.ac.uk:1094] Calling MsgHandler: 0x180be420 (message: kXR_close (handle: 0x00000000) ) with status: [SUCCESS] .
[2026-01-29 10:35:16.488345 +0000][Debug ][File ][ 1259] [0xaae32b0@root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/9e/84/nu_dune10kt_1x2x6_1408_63_20230826T093305Z_gen_g4_detsim_hitreco__20240229T175628Z_reco2.root?xrdcl.requuid=a90066c5-8ba9-4cc1-8dbc-3665c4c391e4] Close returned from ceph-svc15.gridpp.rl.ac.uk:1094 with: [SUCCESS]
[2026-01-29 10:35:16.488363 +0000][Debug ][ExDbgMsg ][ 1259] [ceph-svc15.gridpp.rl.ac.uk:1094] Destroying MsgHandler: 0x180be420.
29-Jan-2026 10:35:16 GMT Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/9e/84/nu_dune10kt_1x2x6_1408_63_20230826T093305Z_gen_g4_detsim_hitreco__20240229T175628Z_reco2.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 2.09844 3.1267 31.389 2.54451 2.97971 100
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.0595948 0.186618 0.409417 0.186108 0.0504635 100
reco:pandora:StandardPandora 1.9854 2.93258 31.1224 2.3304 2.96716 100
[art]:TriggerResults:TriggerResultInserter 1.125e-05 1.72014e-05 6.9462e-05 1.48435e-05 8.28238e-06 100
end_path:out1:RootOutput 1.913e-06 2.40686e-06 1.1376e-05 2.3025e-06 9.35214e-07 100
end_path:out1:RootOutput(write) 0.000779279 0.00735073 0.043978 0.00470589 0.00724669 100
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 2193.68 MB
Peak resident set size usage (VmHWM): 1212.2 MB
====================================================================================================
Art has completed and will exit with status 0.
[2026-01-29 10:35:16.863847 +0000][Debug ][JobMgr ][ 1259] Stopping the job manager...
[2026-01-29 10:35:16.864941 +0000][Debug ][JobMgr ][ 1259] Job manager stopped
[2026-01-29 10:35:16.865739 +0000][Debug ][TaskMgr ][ 1259] Stopping the task manager...
[2026-01-29 10:35:16.866092 +0000][Debug ][TaskMgr ][ 1259] Task manager stopped
[2026-01-29 10:35:16.866101 +0000][Debug ][Poller ][ 1259] Stopping the poller...
[2026-01-29 10:35:16.866357 +0000][Debug ][AsyncSock ][ 1259] [ceph-svc15.gridpp.rl.ac.uk:1094.0] Closing the socket
[2026-01-29 10:35:16.866393 +0000][Debug ][Poller ][ 1259] <[::ffff:192.41.105.37]:42938><--><[::ffff:130.246.179.19]:1094> Removing socket from the poller
[2026-01-29 10:35:16.866573 +0000][Debug ][PostMaster ][ 1259] [ceph-svc15.gridpp.rl.ac.uk:1094] Destroying stream
[2026-01-29 10:35:16.866631 +0000][Debug ][AsyncSock ][ 1259] [ceph-svc15.gridpp.rl.ac.uk:1094.0] Closing the socket
[2026-01-29 10:35:16.866660 +0000][Debug ][AsyncSock ][ 1259] [xrootd.echo.stfc.ac.uk:1094.0] Closing the socket
[2026-01-29 10:35:16.866683 +0000][Debug ][Poller ][ 1259] <[::ffff:192.41.105.37]:56926><--><[::ffff:130.246.217.9]:1094> Removing socket from the poller
[2026-01-29 10:35:16.866760 +0000][Debug ][PostMaster ][ 1259] [xrootd.echo.stfc.ac.uk:1094] Destroying stream
[2026-01-29 10:35:16.866803 +0000][Debug ][AsyncSock ][ 1259] [xrootd.echo.stfc.ac.uk:1094.0] Closing the socket
=== End last 100 lines of lar log file ===
